Getting a lot of error’s when running trying to scrape a large website dataset at once with the zenrow integration. My guess is that it is because of the limited concurring requests. Does anyone knows the solution of this?
👋 Hey there! Our support team has got your message - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in this thread so that we can help you as quickly as possible!
Hey Rafael, thanks for reaching out! It looks like most of the errors you’re seeing are because the websites you’re trying to reach aren’t found. Could you check the error codes to confirm if any are related to concurrent limits? I wasn’t able to spot those in the logs. As for the cell data size exceeding limits, try limiting the output you’re requesting. Reducing the amount of data you get back should help resolve that issue. Let me know if you need further assistance! 😊 https://downloads.intercomcdn.com/i/o/w28k1kwz/1217283233/1ea924a9e56c004a9fd6dd339fe1/CleanShot+2024-10-15+at+_362jGl4Cbl%402x.png?expires=1729029600&signature=012100d8dfdfda9c25affb29386b4c0d518741d4fe189f1d894ff4a0f0aed905&req=dSImEct2noNcWvMW1HO4zbANGP9zBD0i2K4zqK9EwToH5qkqz0AFqIZkfKpN%0AYfqr%0A https://downloads.intercomcdn.com/i/o/w28k1kwz/1217283207/6be06725b88acc7840b99a3247ad/CleanShot+2024-10-15+at+_362jGl4Cbl%402x.png?expires=1729029600&signature=065d2a591776ab6245b6d17131c398079ef7692cc497f12765f1cc0f108e1ad7&req=dSImEct2noNfXvMW1HO4zctR8Pz4bIjFFt%2F1Z0Fq3Lpm9G%2BMdJ0%2FE9BcA23a%0Aer9P%0A https://downloads.intercomcdn.com/i/o/w28k1kwz/1217283190/d28a16ce80d28d7a1d108d31ac49/CleanShot+2024-10-15+at+_42Pi3V3GyS%402x.png?expires=1729029600&signature=c704be8d46da0e540f94391e58d03013d40e85cb69876bfddbae5e3154547d95&req=dSImEct2noBWWfMW1HO4zWyhq%2BpHyuCZkAe9rbpssw%2FTNB6whtKbP%2BmXQjnh%0A1eaR%0A https://downloads.intercomcdn.com/i/o/w28k1kwz/1217283132/6e54bb0882e590ae6fea4290df5a/CleanShot+2024-10-15+at+_45spMChVJs%402x.png?expires=1729029600&signature=db7517454e97990ee10ef7ac53ae87d9de444f7c48cf9213ecc83b0072b032a4&req=dSImEct2noBcW%2FMW1HO4zbk2BfXJTsPAAZkxcWm9YyAkkVrGG0jNFucs5QVI%0A4kGu%0A
Yes, you are right. That seems to be one of the errors which is the most common in the first couple of rows. But if you scroll further down you will see that the most common error by far is “Socket hang up”
followed by the error “cell data exceed the limit”
And when I run the “socket hand up” cells individually row by row, it works.
Hey Rafael! Sorry about this. We've escalated this to the team to troubleshoot and will get back as soon as we know more. Apologies for the inconvenience🙏🏽. I hope this was helpful. If there's anything else I can assist you with, please let me know!
Hey Rafael! Sorry about this. We've escalated this to the team to troubleshoot and will get back as soon as we know more. Apologies for the inconvenience🙏🏽.
Hey Rafael! Thanks for your patience. We checked this internally with the team, and the errors were due to the following: Zenrows server issues: At the time, the server experienced problems that caused the connection to close unexpectedly (cells with the "Socket Hang Up" error). These cells should return results (as long as the websites aren't invalid) when the integration re-runs. Outdated SSL certificates: For some company websites, their SSL certificates were out of date. When this happens, most browsers block the page because the outdated certificate indicates the site is no longer verified as secure. This applies to cells with the error: "The requested URL failed due to a server configuration or SSL certificate error." Zenrows will not return results for these pages. We recommend filtering your table to show the errored cells and re-running the integration for those. I've made a quick recording showing how to do this below. Let me know if you have any questions! https://downloads.intercomcdn.com/i/o/w28k1kwz/1223754077/d717d6be5b41627677a2da79c392/CleanShot+2024-10-21+at+20_44_09.gif?expires=1729541700&signature=32cbcc1af5422546ce1888cf8c42bb3601f3c5963266c50b9c56197f6f2e0eaa&req=dSIlFc57mYFYXvMW1HO4zcu5n%2Br8WbwADOYen8%2BmgjDrOvXW6jCEtDw37HoV%0A5fig%0A
.png){kind=logo}
