Issue Running Zenrows Column Despite Correct Settings

Marielle C. · 2024-11-18 12:59:51.259985+00

Hi team, we've been trying to run this zenrows colum but still not running, everything from the settings are ok

Issue Running Zenrows Column Despite Correct Settings | Clay

13 comments

· Sorted by Oldest

Marielle C.
·
·
https://app.clay.com/workspaces/222291/tables/t_xRYxJSGifzX6/views/gv_or2nGU2zNw7i
Bruno R.
·
·
Hi Marielle, thanks for reaching out! It looks like there are some timeout issues in this table. The problem is that the API callback is taking too long to retrieve the scraped content. I recommend re-running the cells that have timed out to see if this temporarily resolves the issue. Here’s how you can do it: https://downloads.intercomcdn.com/i/o/w28k1kwz/1256263487/9b5b7cc73ded352f517f2dae149b/CleanShot+2024-11-18+at+10_43_22%402x.png?expires=1731946500&signature=84abaac97c170288d8f3696d017f8120c52a02647ca18e1cab2be8e31782c104&req=dSIiEMt4noVXXvMW1HO4zU4BWijNnS2v%2FE1y01vYsqh4mX4%2F3TMjLeLQ9i%2Bs%0A%2B3Bb%0A
Marielle C.
·
·
Hi Bruno R. thanks for the quick response, i contacted zenrows and they said we need to setup session cookies, is that possible with clay? thank you cc: Alexander T.
Loading attachments
Bruno R.
·
·
We are currently unable to set up session cookies with our Zenrows integration. The limitations you encountered are related to Zenrows' rate limits, and unfortunately, there isn't much we can do to address this at the moment.
Marielle C.
·
·
Thank you Bruno 🙏
Marielle C.
·
·
Hi Bruno, sorry for another follow up, was just curious what we did wrong, because we're able to run it in another table
Marielle C.
·
·
https://app.clay.com/workspaces/349199/tables/t_tdSDNyevTyKg/views/gv_8nmwuppcXNxB - table where it worked https://app.clay.com/workspaces/222291/tables/t_xRYxJSGifzX6/views/gv_or2nGU2zNw7i - table where we have the timed out issue Thank you so much for your help
Marielle C.
·
·
No problem tho, we used apify instead, but was just curious if its a permanent update for zenrows
Bo (.
·
·
I've just tested this as well and I'm still seeing the same blocking behavior. Let me explain what's happening: Similarweb has implemented session cookies validation - meaning their site needs visitors to be "identified" through the homepage first. Without these session cookies, Zenrows scraping attempts are being rejected. It seems like Zenrows support suggested previously to be using custom HTTP API columns to handle this (by getting session cookies first, then using them for scraping), implementing this would require: 1. Getting the proper CURL commands from them 2. Setting those up in Clay's HTTP API enrichment For now, the scraping won't work reliably even if you occasionally see it succeed. I know this isn't ideal for your workflow but great to hear you've found your way around with Apify. That's the clay spirit! :)
1
Marielle C.
·
·
Thank you, really appreciate this explanation
Bo (.
·
·
Welcome. I've also added your ticket to our engineering team's thread for this particular issue, I'll update you as soon as I have any news. If you don't need any other assistance for now, I'll go ahead and close this ticket. Feel free to reach out if you have any other questions!
Channeled
APP
·
·
Hi Marielle C.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:
Channeled
APP
·
·
Thank you so much for sharing your feedback Marielle C.!

Marielle C.
·
·
https://app.clay.com/workspaces/222291/tables/t_xRYxJSGifzX6/views/gv_or2nGU2zNw7i
Bruno R.
·
·
Hi Marielle, thanks for reaching out! It looks like there are some timeout issues in this table. The problem is that the API callback is taking too long to retrieve the scraped content. I recommend re-running the cells that have timed out to see if this temporarily resolves the issue. Here’s how you can do it: https://downloads.intercomcdn.com/i/o/w28k1kwz/1256263487/9b5b7cc73ded352f517f2dae149b/CleanShot+2024-11-18+at+10_43_22%402x.png?expires=1731946500&signature=84abaac97c170288d8f3696d017f8120c52a02647ca18e1cab2be8e31782c104&req=dSIiEMt4noVXXvMW1HO4zU4BWijNnS2v%2FE1y01vYsqh4mX4%2F3TMjLeLQ9i%2Bs%0A%2B3Bb%0A
Marielle C.
·
·
Hi Bruno R. thanks for the quick response, i contacted zenrows and they said we need to setup session cookies, is that possible with clay? thank you cc: Alexander T.
Loading attachments
Bruno R.
·
·
We are currently unable to set up session cookies with our Zenrows integration. The limitations you encountered are related to Zenrows' rate limits, and unfortunately, there isn't much we can do to address this at the moment.
Marielle C.
·
·
Thank you Bruno 🙏
Marielle C.
·
·
Hi Bruno, sorry for another follow up, was just curious what we did wrong, because we're able to run it in another table
Marielle C.
·
·
https://app.clay.com/workspaces/349199/tables/t_tdSDNyevTyKg/views/gv_8nmwuppcXNxB - table where it worked https://app.clay.com/workspaces/222291/tables/t_xRYxJSGifzX6/views/gv_or2nGU2zNw7i - table where we have the timed out issue Thank you so much for your help
Marielle C.
·
·
No problem tho, we used apify instead, but was just curious if its a permanent update for zenrows
Bo (.
·
·
I've just tested this as well and I'm still seeing the same blocking behavior. Let me explain what's happening: Similarweb has implemented session cookies validation - meaning their site needs visitors to be "identified" through the homepage first. Without these session cookies, Zenrows scraping attempts are being rejected. It seems like Zenrows support suggested previously to be using custom HTTP API columns to handle this (by getting session cookies first, then using them for scraping), implementing this would require: 1. Getting the proper CURL commands from them 2. Setting those up in Clay's HTTP API enrichment For now, the scraping won't work reliably even if you occasionally see it succeed. I know this isn't ideal for your workflow but great to hear you've found your way around with Apify. That's the clay spirit! :)
1
Marielle C.
·
·
Thank you, really appreciate this explanation
Bo (.
·
·
Welcome. I've also added your ticket to our engineering team's thread for this particular issue, I'll update you as soon as I have any news. If you don't need any other assistance for now, I'll go ahead and close this ticket. Feel free to reach out if you have any other questions!
Channeled
APP
·
·
Hi Marielle C.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:
Channeled
APP
·
·
Thank you so much for sharing your feedback Marielle C.!