how can i handle really low rate limit?
To handle low rate limits in Clay, you can: Set Rate Limits in HTTP API: - Use the "Request Limit" field to specify maximum allowed requests - Set "Duration (in ms)" for the time window (e.g., 1000 ms = 1 second) - Note: Rate limit must average at least 5 requests per second to work properly Process in Smaller Batches: - Try processing data in smaller batches, such as 200 rows at a time - For lower API tiers (like Anthropic tier 1), process around 50 rows at a time Use Conditional Runs: - Set up conditional formulas to only run enrichments when specific conditions are met, conserving credits and reducing API calls These methods help you stay within rate limits while controlling which data gets processed.
why can't i set low rate limit? processing in batch will consume a lot of time
Clay requires rate limits to average at least 5 requests per second to work properly. This minimum ensures the system functions correctly. For faster processing without long batch times, consider using Bulk API, which can process up to 10,000 rows in a single request and offers parallel processing capabilities. This significantly reduces the number of API calls needed and speeds up data transfer. You can also implement conditional runs to only process rows that meet specific criteria, conserving resources and reducing processing time.
how can i automate processing in smaller batches without being involved manually?
You can automate batch processing in Clay using Clay Scheduling. This feature lets you automatically run workflows on a schedule - daily, weekly, or monthly - without manual intervention. Set up Auto-Update with webhooks to automatically process new data as it comes in. When data is added to your table, it will automatically process in batches without requiring manual triggers. You can also create automated workflows where sales teams simply upload CSV files, and Clay handles the rest - enriching contacts, processing data in batches, and pushing results to your CRM automatically. This eliminates manual batch processing while maintaining the smaller batch sizes you need for rate limit compliance.