.png){kind=logo}
Can Claygent scrap page source?
Can Claygent scrap page source?
Yes, Claygent can extract data from a web page's source code. It's designed to access and retrieve virtually any publicly available data point on the internet, including information from a page's source code. Claygent is an AI-based web scraper that's particularly effective at retrieving unstructured data from various web sources. However, it's important to note that Claygent can't access information hidden behind paywalls or password-protected areas.
Andi D.··i tried and i dont think Claygent is fetching full raw HTML or have access to application/ld+json content? Thoughts? Is it doable?
Claygent is designed to access and retrieve virtually any publicly available data from web pages, including body text and other content. However, it doesn't specifically fetch full raw HTML or "application/ld+json" content. For more structured data extraction, you might want to try our native scraper or the Clay Chrome Extension. The native scraper can extract body text from web pages, which could include some structured data. The Chrome Extension allows you to extract structured data from webpages and organize it into tables. If you need more specific capabilities or are encountering limitations, let me know, and I can provide further guidance or suggest alternatives.