Accurate Methods to Count Total Pages on a Website

To find the total number of pages on a website, you can use our SimilarWeb integration. This feature retrieves the average pages per visit for a given domain through the "Get website pages per visit" action. To use this: 1. Select the table column with the company domain 2. Configure run settings (auto-update, conditional runs) This will show you how many pages visitors typically explore during a single visit.

Sources: Get website pages per visit with Similarweb | Clay.com SimilarWeb integration | Documentation | Clay University SimilarWeb integration | Documentation | Clay University

You can use two different approaches in Clay: 1. SimilarWeb integration's "Get website pages per visit" action shows the average number of pages visitors explore during a single visit. This gives you engagement metrics rather than total page count. 2. For a comprehensive list of actual pages, use the "Find Sitemap URLs for a Company Website" action. This retrieves subpage URLs from a website's sitemap by providing just the domain, giving you the total page count and all URLs.

Sources: Get website pages per visit with Similarweb | Clay.com Data points: Total Website Pages Per Visit | Clay.com Find Sitemap URLs for a Company Website with Clay

Hey Todd, thanks for reaching out—great question. Here’s a step-by-step approach to pull in indexed web pages: 1. Use a Google Search Operator Use the site: operator to narrow search results to a specific domain. For example: site:[clay.com](http://clay.com) 2. Build the Search URL Construct a Google search URL using this format: [https://www.google.com/search?q=site%3Aclay.com&hl=en&gl=us](https://www.google.com/search?q=site%3Aclay.com&hl=en&gl=us) You can do this in an AI formula column by programmatically generating the URL. 3. Use ZenRows or AI Column to Extract Results Feed the search URL into ZenRows or an AI column (e.g., using the Argon model), and prompt it to extract the indexed page links. 4. (Optional) Use a SERP API Alternatively, you can integrate a SERP API like Serper, which may let you programmatically query and return Google search results. This could streamline the process and be more cost efficient if you do this at scale. Let me know if you have any follow up questions! Have a great Tuesday Daniel