Optimizing Claygent to Verify Domain Functionality First

Hi claygent pros. I am using claygent to check domains and qualify the company whether it suits us or not. the problem occurs where the website doesnt work (company closed likely). The claygent is given a specific link to visit but in the first step noticing that the website has no info - it leaves the page and finds more info about the company on yelp or other website and this way retrives bad (outdated) information. Can I somehow prevent claygent from going to other websites or should I prompt it in a way to first determine whether the link works?

2 comments

Channeled
APP
·
·
When web scraping, it's important to first evaluate whether the data you need is more reliably available through alternative sources within Clay. For company information, you have a few options:1. Use Clay's enriched company actions or other built-in data providers for established companies. 2. Add a "last enriched by Clay" date to your records to track data freshness. This helps identify when information might be outdated and needs verification.If you specifically need to check website availability first, you can:** Use conditional runs in your Clay table to first verify if the website is accessible ** Only proceed with additional data gathering if the primary website check is successfulFor cases where websites are unavailable, consider using Clay's built-in data enrichment options rather than relying on web scraping from alternative sources. Sources: Intro to Web Scraping [Limitless Research] - Clay University Intro to CRM Data Enrichment [CRM Enrichment] - Clay University
Channeled
APP
·
·
Hi Vytautas M.! This thread was recently closed by our Support team. If you have a moment, please share your feedback: