.png){kind=logo}
Clay Unable to Read Certain Websites: Troubleshooting Needed
I'm stuck on this: for some reason Clay won't read certain websites. Never had that problem before
When a website cannot be displayed, it's typically due to security settings that prevent the site from being embedded within another platform. This is a security measure implemented by the website itself to protect user security. In such cases, you'll need to open the page in a new window to view the content. Sources: Auto-dedupe ViewIn Advisory - Clay Expert | Clay.com
Martin··So, the Claygent scraper won't work on these websites?
- Martin··
Getting the same error in this configurtion
Claygent is our most powerful AI-based web scraper, specifically designed for retrieving unstructured data from various websites. When you encounter websites that seem unscrappable, you have several options in our scraping hierarchy: 1. Claygent - Our primary solution for general web and public infrastructure browsing 2. Zenrows - Excellent for bypassing traditional anti-scraping measures 3. Apify - For specific bulk scraping tasksZenrows in particular stands out for its exceptional ability to handle websites with robust protections against data collection, so it might be your best option for websites that are particularly difficult to access. Sources: Claygent: AI Web Scraper [Clay 101] - Clay University Deep Dive: Zenrows Scraping [Limitless Research] - Clay University Deep Dive: Clay Scrapers [Limitless Research] - Clay University
Looks like you're still looking for help. We're escalating this over to our support team and someone should be in touch soon. In the meantime, feel free to include any other information that may be helpful in solving your issue!
Stefano··Hi Martin, thank you for reaching out. Could you be more specific as to what you are trying to achieve and could you send the website over too?
- Martin··
Hi guys I think the screenshots are self explanatory. But let me know if they aren't. Both problematic websites are visible
Bo (.··Hey Martin! It sounds like we're hitting a LinkedIn no-data - basically if the company doesn't exist on LinkedIn, we can't find any lookalikes since there's nothing to compare against. Lookalike, finding employee, enriching the company all won't work since there's no matches !
- Martin··
Not the case. The companies exist on Linkedin. The problem is that Clay apparently can't read the content of their websites at all. Test with www.gxe.dk
- Bo (.··
Martin - Do you mind sending the link to the table so we can take a look? https://downloads.intercomcdn.com/i/o/1171717996/ac7729f84b426e1d0358af02/image.png?expires=1733930100&signature=6ebec5d2b9c16d270081d0a4c6c3bd264fd494c310a2c3bdba54abb536e1f86d&req=dSEgF85%2FmohWX%2FMW1HO4zYTywSj1BZcX2BKsam%2FhVPtldA%3D%3D%0A
- Bo (.··
Can you also send me their linkedin url of those companies
- Martin··
is it private in this chat?
- Martin··
well,. actually, we made changes to the structure of the table to circumvent this problem, so access to the table won't help
- Bo (.··
Table are only accessible by the support team so no worries about this here :)