Optimizing Claygent to Scrape and Score Unique Company Contacts

Hey everyone, i have a list of 20k contacts. many contacts are the same company. I want to use claygent to scrape the company website and determine if they are a good fit for our company and score them. i obviously dont want to burn credits for the same company if i already ran that value. Not having any luck with run conditions, i was thinking "do not run if value in /website is not unique" but no luck. Suggestions?

4 comments

Channeled
APP
·
·
To use Claygent for scraping and scoring company websites while avoiding duplicate credit usage, follow these steps: 1. Start with your list of 20k contacts. 2. Use Clay's reverse waterfall enrichment to find company domains from the contact information. 3. Create a "write to table" operation to store unique company domains. 4. Set up a Claygent operation to scrape and analyze the unique company websites. 5. Use Clay's scoring features to evaluate the companies based on the scraped data. 6. Add a run condition to your Claygent operation: "Run only if /website is unique in the table." This approach ensures you only scrape and score each unique company website once, saving credits and avoiding duplicates.
Sources: Lead Scoring [Clay 101] - Clay University Claygent: AI Web Scraper [Automated Outbound] - Clay University Data points: Scoring | Clay.com
Dave R.
·
·
the run condition is not working
Bo (.
·
·
Hi David,
You'd need to follow the principle here: https://www.loom.com/share/a39a4569d95244b7886026f3c70812c7
Each row doesn't have any knowledge of each other, which is why your approach isn't working. This workaround will help you identify all the duplicates inside the table, allowing you to use a run condition that only runs if the number is 1.
Formula for finding duplicate domains: {{Unique ID}}?({{Lookup Multiple Rows in Other Table}}?.records?.findIndex(r=> r['Unique ID']?.toString()==={{Unique ID}}?.toString())> -1?{{Lookup Multiple Rows in Other Table}}?.records?.findIndex(r=> r['Unique ID']?.toString()==={{Unique ID}}?.toString())+1:2):2
Channeled
APP
·
·