Any advice on interfacing with an API that requires 2 steps: Post and...

·

Any advice on interfacing with an API that requires 2 steps: Post and Get? Where the Get is not immediately accessible, requires periodic checks until data is ready.

9 comments

Clay Team
APP
·
·
Hey hey! Can you drop the URL for your table here? (if applicable) 🫶 Don't worry, only admins will be able to open your table 😉
Clay Team
APP
·
·
Hey Miles, thanks for reaching out! I'll tag Colin P. Maggie W. to help us with more technical insights when available!
Clay Team
APP
·
·
Also, miles, Could you share the link to your table?
Maggie W.
·
·
miles could you also link the API documentation you're looking to setup?
miles
·
·
https://app.clay.com/workspaces/143164/tables/t_PJqgSmIMzQS1/views/gv_zfSVaIWjbPdA
miles
·
·
for example https://www.scraping-bot.io/web-scraping-documentation/
miles
·
·
Maggie W. What would solve this (and a lot of unrelated other issues with rate limits, etc. on other APIs) would be the ability to conditionally auto-rerun rows periodically. e.g. rerun every 5 minutes if response contains "rate limit" or does not contain some parameter which would indicate a real success payload.
miles
·
·
Working with lots of other APIs which take some time to deliver results after an initial POST and when we do this programmatically we always have a timer function to rerun the GET until a condition is fulfilled.
Clay Team
APP
·
·
Ah, appreciate the follow-up, Miles. We don't currently have a way to re-run on a schedule or set a timer to API calls but was brought up for consideration, so hopefully, something along those lines will come very soon. Of course, if Maggie has some ideas of what else could be done, she'll let you know some insights :)