Tips to Speed Up Enrichment Process for Large Datasets

Dave R. · 2025-03-14T20:06:46.875671+00:00

Any tips on how to get an enrichment to run faster? I'm running a simple Lookup Single Row in Other Table on 10k rows and its been running for 20 minutes and still have 4k in queue.

To speed up your enrichment process for 10,000 rows, consider these strategies: 1. Use conditional runs: Apply filters or create a filtered view to enrich only the necessary rows. 2. Leverage existing data: Before running new enrichments, check if the data already exists in your CRM or another Clay table. Use our "write to table" feature to pull existing data, avoiding duplicate enrichments. 3. Process in smaller batches: If you're using external APIs (like Anthropic), try processing data in smaller batches of around 50 rows at a time to manage API limits. 4. Optimize your lookup criteria: Ensure you're using efficient lookup conditions to minimize processing time. Remember, only enrichment actions consume credits, so optimizing your process can save both time and resources.

Sources: Guide: Ways to save Clay credits | Documentation | Clay University Guide: Ways to save Clay credits | Documentation | Clay University

5 comments