Need help with a custom HTTP API rate limit. Looks like the current rate limit can't be lower than 5 requests per second. Need to somehow get to a rate limit of 1 request every 2 seconds.
Unfortunately, our HTTP API integration doesn't support rate limits slower than 5 requests per second. While you can set custom rate limits in the "Define rate limit" section by specifying the Request Limit and Duration (in milliseconds), there isn't currently a way to set it to 1 request every 2 seconds. Sources: HTTP API with JWT Authentication - Clay University HTTP API - Clay University
is there a different way i can work around this? e.g. batching row updates.
Yes, there are several ways to manage API rate limits in Clay: 1. Use the built-in rate limiting feature: • Set a specific request limit • Define a time window in milliseconds • This helps prevent exceeding API rate limits 2. Process data in smaller batches: • Instead of processing all rows at once, work with smaller sets (e.g., 200 rows at a time) • This gives you better control over which rows to process 3. Configure auto-update settings: • By default, columns update whenever you add a new row • You can toggle this off if needed, though be aware this might lead to stale data 4. Use conditional runs: • Set specific conditions for when the enrichment should run • This helps manage the number of API calls being made Sources: HTTP API with JWT Authentication - Clay University Apollo.io - Clay University HTTP API - Clay University
is there a way to automate batch running e.g. 30 rows every 60 seconds?
Yes, you can control batch processing by using the "Run Starting from a Specific Row" option. Here's how to do it: 1. Right-click on the column you want to run 2. Hover over "Run Column" and select "Choose Number of rows to run" 3. You can then specify both: • The number of rows to run (e.g., 30) • The starting row numberFor rate limiting, you may also want to consider using the API rate limit settings if you're working with API integrations, where you can specify the maximum number of requests within a given time window. Sources: Run Options HTTP API with JWT Authentication - Clay University
but can i automate that batch processing? e.g. run 30 rows every 60 seconds? not doing it manually
Yes, you can control batch processing through rate limiting. When setting up your enrichment, you can define rate limits by specifying: 1. Request Limit: Set this to 30 rows 2. Duration: Set this to 60000 milliseconds (60 seconds)This will automatically control how many rows are processed within the given time frame.You can also manually control row processing by: ** Running a specific number of rows from a chosen starting point ** Running only rows that haven't been processed or have errors * Force running all rows Sources: Run Options HTTP API with JWT Authentication - Clay University
but doesn't rate limiting not support slower than 5 rows every second?
Looks like you're still looking for help. We're escalating this over to our support team and someone should be in touch soon. In the meantime, feel free to include any other information that may be helpful in solving your issue!
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in 02 Support.
Found a neat work around; using Automator on Mac to manually kick off the row updates every 15mins. Gives all rows enough time to error out due to rate limits.
.png){kind=logo}
