Home
Events
Groups
Members

Clay Announcements
Clay Support
Discuss Anything
Feedback & Requests
GTM Career Advice
Introduce Yourself
Member Spotlight
Share Content and Events
Share Full-time Jobs
Share Part Time Jobs
Share Tables, Tools, and Workflows

Community Guidelines

University
Clay live events

Powered by Tightknit

Discuss Anything

Discuss Anything

How to Scrape the Web for Keywords Without a Company List

·

·

Hi, I am looking to get a list of companies/webpages that mention certain keywords in their docs and github repos.. is there a way for me to scrape the web for that? catch here is that I dont have a list of companies to extract it from but need to scrape the whole web

How to Scrape the Web for Keywords Without a Company List | Clay

4 comments

· Sorted by Oldest

Shafqat H.
·
·
Great setup you have! I specialize in running high-converting cold email campaigns, with laser-targeted lead lists that actually reply. (Example: Just last week, a SaaS client booked 5 demos in 3 days.) Let’s talk results
Jake G.
·
·
GitHub, yep use the Search API it's pretty robust. Re scraping the whole web, not possible unless you're google. Best bet would be to use common crawl data and do local analysis, or try search engine scrapes (can be done in clay with serper.dev + formulae)
🥰1
Ahmad A.
·
·
"Great setup you have! I help businesses run high-converting cold email campaigns with laser-targeted leads that actually reply. Example: Just last week, a SaaS client booked 5 demos in only 3 days. Let’s talk about getting you similar results." 🚀
Danny C.
·
·
does something like "github.com" ai inference yield the results? if yes, then can be automated with serper.dev or serpapi.com