Does anyone know how to get Clay to test whether a webpage URL exists? Iโm trying to give Clay a list of website domains and then have it pull the โ/customersโ page URL for each one. I was thinking that maybe I can just append โ/customersโ after every company โ but of course, sometimes companies donโt call their case study page โ/customers.โ So I could maybe get Clay to test whether the page actually exists?
And we also have this cool one, this will extract the sitemap (all the url) of the website
also for free but you might have more chances to find customers pages
Hey Boo Is the above method works for linkedin also like if I provide the linkedin company url It can give the jobs url of company linkedin?
Nat A. you can also use claygent to find case study pages and return their urls. in my experience, this solution was more reliable than creating a specific url like /customers and checking whether it's valid or even getting all urls from the sitemap and then using ai to find the right one (quite often, sitemaps are super messy and include old urls, some test pages etc)