Automate Pagination Number Creation for Web Scraping | Clay

Automate Pagination Number Creation for Web Scraping

I want to scrape a database of 29 pages with a unique URL. I want to build a custom url for the pagination with a formula ?page=numberX But I don’t want to type manually the numbers, 1, 2, 3 - How can I create those number in a column ?

7 comments

Channeled
APP
·
·
To create a column of sequential numbers for pagination URLs, you can use Clay's number generator feature. Here's how: 1. Click "Add Column" above your table. 2. Choose "Number" as the column data type. 3. In the formula bar, enter a formula to generate sequential numbers. For example: =ROW() will create numbers starting from 1. 4. Once you have your number column, you can create a URL column using the "Merge columns" feature. 5. Combine your base URL with the number column using a formula like: ="[https://example.com/page?page=](https://example.com/page?page=)" & [Number Column] This will automatically generate your custom URLs for pagination. If you need further assistance, please request human help by clicking "Talk to a person" in the chat.
Sources: Hide, Re-order, Sort, Filter, Merge Columns Table columns | Documentation | Clay University
Pierre L.
·
·
Where is the formula bar ?
Channeled
APP
·
·
In Clay, there isn't a traditional formula bar like in spreadsheet software. Instead, you can create formulas by following these steps: 1. Click "Add Column" above your table. 2. Select "Formula" as the column type. 3. You'll see an AI Formula Generator box where you can type your instructions. 4. Use "/" to reference other columns in your formula. 5. Click "Generate Formula" to create your AI formula. 6. Review the sample output and click "Save Formula" if it looks correct. This process allows you to generate formulas using AI to transform your data easily. If you need more help with formulas, you can request human assistance by clicking "Talk to a person" in the chat.
Sources: Formulas Formula generator | Documentation | Clay University
Pierre L.
·
·
no it’s not working I cannot generate a list of numbers from 1 to 30
kushagra
·
·
hacky way that i use is get a column in sheet with numbers by dragging it across the column, then copy paste into a blank clay column not sure if that's the best way though
Pierre L.
·
·
Yes I did that too 🥲 🥲 sometimes stuff simple af seems overcomplicated in clay 😂
Bo (.
·
That’s actually a solid workaround — Right now, there’s no built-in way to auto-generate a list of numbers like 1–29 directly in Clay, so using a spreadsheet to create the numbers and then pasting them into a Clay column is the best method for now.