I have the $349/mo plan I am running a play pulling leads from LinkedIn with PB who comment then to clay there are 4k+ comments, but for some reason it only lets me have 2500 rows in my Ckay table I don't have a limit on, any ideas for why this is?
💤 You've caught us outside of our support hours (9am-9pm EST), but don't worry - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in the thread below so that we can help you as quickly as possible!
Hi Aaron! The issue is due to the fact that LinkedIn data through Phantombuster (PB) is limited to 2500 rows per page, and they don’t support pagination, meaning you only get one batch of data at a time. A workaround you can try is sending the data to a webhook instead. This way, you can handle larger data sets. Here’s a guide on how to do that with Phantombuster: Using Webhooks with PB, and how to set up webhooks with Clay: Intro to Webhooks and Inbound Lead Sources. Let me know if you need more help setting this up! 😊
Thanks !!! Yep and if the webhook method doesn’t work smoothly due to Phantombuster’s API limitations, running smaller batches (under 2500) is definitely a reliable alternative. This way, you can ensure that you capture all the data without hitting the row limit. Feel free to reach out if you run into any issues while setting it up or need further assistance. You’ve got this! 🎉
We haven't heard back from you in a bit, so we're going to go ahead and close things out here - feel free to let us know if you still need something!