Hi Clay team,
I'm running a table using the UK Companies House API to check for registered charges. The API itself works fine, but when I try to run the table with 10,000 rows, I get a timeout error. This is likely due to the Companies House rate limit of 600 requests per 5 minutes (or effectively 2 per 1000ms).
I tried using the Custom Rate Limit feature to handle this, but it won’t let me set it to anything lower than 5 requests per 1000ms.
A couple of questions:
- 1.
Is there any way to reduce the rate limit below 5 per 1000ms?
- 2.
What's the rationale behind not allowing lower limits? Many public APIs have fairly strict rate caps, so being able to run large datasets slowly and reliably seems like the whole point of this feature.
- 3.
Are there plans to address this feature change in the near future?
