Home
Events
Groups
Members

00 Clay Announcements
01 Community General
01 Props and Wins
01 Watercooler
01 Welcome and Intros
02 Bugs
02 Starting with Clay
02 Support
03 Feedback & Requests
03 Tutorials & Inspiration
04 FT Job Opps

Community Guidelines

Powered by Tightknit

Automating Monthly Data Scraping from Websites: Need Solutions

·

·

Hey everyone, does anyone know a way for clay to automatically scrape data from a website? For example https://railmarket.com/ I want this website to be automatically scraped once a month. Should I be using signal, custom signal does not find companies, so if anyone knows a way that would be really helpful!

Automating Monthly Data Scraping from Websites: Need Solutions | Clay

1 comment

· Sorted by newest

Loading comments

Clay
APP
·
·
You can scrape websites using our Chrome Extension, but it requires manual activation each time - there's no automatic monthly scraping feature. To scrape data: 1. Install the Clay Chrome Extension from Chrome Web Store 2. Navigate to your target website 3. Click the extension icon and select "Select Data" 4. Create custom recipes for non-mapped URLs by setting URL patterns and selecting specific attributes 5. Save your recipe and add data to workspace For individual pages, you can create recipes that work across similar page structures using URL patterns. Note: This is a manual process each time you want fresh data - Clay doesn't currently offer automated scheduled scraping.
Sources: Get transcript of any YouTube video in seconds | Clay Deep Dive: Clay Chrome Extension [Limitless Research] - Clay University Clay Chrome extension | Documentation | Clay University