Home

Clay Announcements
Discuss Anything
GTM Career Advice
Introduce Yourself
Member Spotlight
Share Content and Events
Share Full-time Jobs
Share Part Time Jobs
Share Tables, Tools, and Workflows

Community Guidelines

Hire GTME Talent
Explore Events

Powered by Tightknit

How to Scrape the Web for Keywords Without a Company List | Clay

Discuss Anything

Discuss Anything

How to Scrape the Web for Keywords Without a Company List

·Aug 11, 2025 07:56 AM·

Hi, I am looking to get a list of companies/webpages that mention certain keywords in their docs and github repos.. is there a way for me to scrape the web for that? catch here is that I dont have a list of companies to extract it from but need to scrape the whole web

4 comments

· Sorted by Oldest

Shafqat H.
·
·
Great setup you have! I specialize in running high-converting cold email campaigns, with laser-targeted lead lists that actually reply. (Example: Just last week, a SaaS client booked 5 demos in 3 days.) Let’s talk results
Jake G.
·
·
GitHub, yep use the Search API it's pretty robust. Re scraping the whole web, not possible unless you're google. Best bet would be to use common crawl data and do local analysis, or try search engine scrapes (can be done in clay with serper.dev + formulae)
🥰1
Ahmad A.
·
·
"Great setup you have! I help businesses run high-converting cold email campaigns with laser-targeted leads that actually reply. Example: Just last week, a SaaS client booked 5 demos in only 3 days. Let’s talk about getting you similar results." 🚀
Danny C.
·
·
does something like "github.com" ai inference yield the results? if yes, then can be automated with serper.dev or serpapi.com