.png&w=3840&q=75){kind=logo}
Troubleshooting Rate Limit Issues for 200 Requests/Min Setting
Any idea why I'm getting rate limit too low? trying to set it at 200 requests / min
Any idea why I'm getting rate limit too low? trying to set it at 200 requests / min
For Google Sheets integrations, the default limit is 300 read requests per minute per project.To properly set up rate limiting in Clay:1. In the "Request Limit" field, enter your desired number of requests (in this case, 200) 2. In the "Duration (in ms)" field, enter the time window in milliseconds (1000 ms equals 1 second)If you're still experiencing issues, you may need to adjust these settings to stay within the API provider's limits. For Google Sheets specifically, you can set up to 300 requests per minute. Sources: HTTP API with JWT Authentication - Clay University HTTP API - Clay University
this did not answer my querstion -- isn't a google sheet integration
The rate limit of 200 requests per minute may be too high for Clay's webhook throughput limit, which is capped at 10 requests per second (or 600 milliseconds between requests).To set up a proper rate limit:1. In the Rate Limit field, specify your desired number of requests 2. In the Duration field, enter the time window in milliseconds (1000 ms = 1 second)For example, if you want to send 200 requests per minute, you should:** Set Request Limit to 200 ** Set Duration to 60000 (60 seconds in milliseconds)This helps prevent exceeding API rate limits while ensuring your requests are processed properly. Sources: HTTP API with JWT Authentication - Clay University HTTP API - Clay University Send Data from Google Sheets to Clay Using a Webhook
What? That's what I'm doing -- it's telling me 150 / 60000 is not a valid rate limit -- why?
Webhook sources in Clay have a fixed rate limit of 10 records per second (with a maximum burst capacity of 20 records). The rate limit you're trying to set (150 requests per 60 seconds) exceeds this built-in limit, which is why it's being rejected as invalid. Source: Import Data to Clay Using Webhooks
talk to person
Looks like you're still looking for help. We're escalating this over to our support team and someone should be in touch soon. In the meantime, feel free to include any other information that may be helpful in solving your issue!
Hi Mathew, thanks for reaching out! Which integration is this for? Do you mind sending the link to the table so we can take a look? https://downloads.intercomcdn.com/i/o/1171717996/ac7729f84b426e1d0358af02/image.png?expires=1732552200&signature=efa96cbe7b0fa9994dd87474d8c7bcfd73ba4a593762c203b12be14be5560298&req=dSEgF85%2FmohWX%2FMW1HO4zYTywSn5A5UU2BKsam%2FhVPscjg%3D%3D%0A
Mobile phone finder: https://app.clay.com/workspaces/423342/workbooks/wb_2yzrNp8cphiU/tables/t_g6XNC4yqigMb/views/gv_86Vu8v5hyjg7 Webhook Receiver: https://app.clay.com/workspaces/423342/workbooks/wb_2yzrNp8cphiU/tables/t_M3No2rSJCSCj/views/gv_ggWrZrZuP3h2 I fired off ~400 requests last night. The request queries Apollo for the person data, which sends a webhook when it's done searching for the phone number. It looks like the webhook did not get picked up for the vast majority of the requests.
2 questions:
What are the limitations on the webhook listener in Clay?
Why does it tell me that rate limit above was invalid?
Hey! Let me break down what's happening with those rate limits: 1. Apollo's limits are a bit tricky: - 200 requests per minute, BUT - Only 400-600 requests per hour - Once you hit these limits, it needs manual re-running (we can't bypass Apollo's limits) by clicking on the column header > run column > run errored rows. 2. For webhooks and API here are the specific limits: - Webhooks 10 records per second (can burst to 20) - WebhooksMax payload size: 100KB - API Need to average at least 5 requests per second - API timeframe needs to be between 1-900000ms (15 mins) This explains why you're hitting issues - your rate limit setup needs to stay within these bounds. The 150/60000 isn't working because it falls below that minimum 5 requests per second average we need. There's no other ways than manually re-run the rows for Apollo OR upgrade your Apollo plan to an higher tier with faster rate limits https://downloads.intercomcdn.com/i/o/w28k1kwz/1265227154/25cf5fe83c0191136b0b0f30baf7/CleanShot+2024-11-25+at+_04v2RephYp%402x.png?expires=1732563900&signature=1c4758a8287cf74e8a77fe1020db45319631e349722619b72ccdd9fe9fd552c4&req=dSIhE8t8moBaXfMW1HO4zRd1vGkYudO10M9FnIxsvErP%2BWkKgkFKKQ14WUAK%0AVpxO76%2F8QGaepevOWx8%3D%0A
So to confirm, the minimum rate limit for Clay (i.e. 5/sec) will trip Apollos rate limit (3.3/sec) correct?
So I'll need to manually run Apollo enrichments 200 rows at a time once per min
and only do that twice per hour
is that right?
Yeah you've got it! You can keep running rows until you hit Apollo's rate limit, then just re-run the failed ones after a minute passes. Keep doing that until you hit their hourly limit. Just watch out for those limits: - 200 per minute - 400-600 per hour Once you hit the hourly limit, you'll need to wait that out before running more.
Got it -- thank you