Automating Patent Monitoring for Outreach: Web Scraping Solutions

·Apr 02, 2025 01:33 PM·

good morning. I want to keep an eye on a patent website so that when someone in my niche gets a patent, their name will flow into a clay table, get enriched, then added to a lemlist sequence for automatic outreach. I have the lemlist part, just don't know how to get the web page scrape. I have tried apify in the past but didn't have much luck. Any ideas?

11 comments

· Sorted by Oldest

kushagra t.
·
·
what was the issue with apify? does the patent website have a login? thinking out loud - maybe using a browse ai automation to scrape and push to clay can work
Wayne M.
·
·
Maybe I just can't figure out how to make it work. Here is the website: https://ppubs.uspto.gov/pubwebapp/static/pages/ppubsbasic.html
Wayne M.
·
·
what I want to do is create a search for several companies in my niche like whirlpool, electrolux, carrier, trane, etc. the result will list the patents but I am trying to get the names from the patent to be dropped into clay so I can enrich and send an automated email through lemlist to congratulate them and get on their radar. I have an apify account and a Browseai account. Any preference for this task?
Wayne M.
·
·
the names would come from the Inventor segment
Wayne M.
·
·
If I can get the link for the Text version, I built the table from there. Worst case I can go to the page and use the Clay import Extension, but that is still manual
kushagra t.
·
·
create a search for several companies in my niche like whirlpool, electrolux, carrier, trane - are you searching for patents where these folks are applicants?
kushagra t.
·
·
couple of options
if you are able to retrieve the pdf url (with token) - claygent can extract inventors, screenshot attached
bulk xml data is published weekly by USPTO, maybe that can work - still might be some manual work but only once weekly, https://developer.uspto.gov/product/patent-grant-full-text-dataxml
there's a search api that can potentially be used in clay it looks like (will need to test) - https://search.patentsview.org/docs/docs/Search%20API/SearchAPIReference
Wayne M.
·
·
i was able to get an api key from the ppubs.uspto.gov site but have no idea how to add the api into my table
Wayne M.
·
·
your image is exactly what i set up in clay manually from the text url instead of pdf, but same function
Wayne M.
·
·
you saw the site, could apify work on that site
kushagra t.
·
·
api should work best imo, if you have to scrape this is worth trying Instant web data scraper - Scrape any website on apify

Automating Patent Monitoring for Outreach: Web Scraping Solutions | Clay

kushagra t.
·
·
what was the issue with apify? does the patent website have a login? thinking out loud - maybe using a browse ai automation to scrape and push to clay can work
Wayne M.
·
·
Maybe I just can't figure out how to make it work. Here is the website: https://ppubs.uspto.gov/pubwebapp/static/pages/ppubsbasic.html
Wayne M.
·
·
what I want to do is create a search for several companies in my niche like whirlpool, electrolux, carrier, trane, etc. the result will list the patents but I am trying to get the names from the patent to be dropped into clay so I can enrich and send an automated email through lemlist to congratulate them and get on their radar. I have an apify account and a Browseai account. Any preference for this task?
Wayne M.
·
·
the names would come from the Inventor segment
Wayne M.
·
·
If I can get the link for the Text version, I built the table from there. Worst case I can go to the page and use the Clay import Extension, but that is still manual
kushagra t.
·
·
create a search for several companies in my niche like whirlpool, electrolux, carrier, trane - are you searching for patents where these folks are applicants?
kushagra t.
·
·
couple of options
if you are able to retrieve the pdf url (with token) - claygent can extract inventors, screenshot attached
bulk xml data is published weekly by USPTO, maybe that can work - still might be some manual work but only once weekly, https://developer.uspto.gov/product/patent-grant-full-text-dataxml
there's a search api that can potentially be used in clay it looks like (will need to test) - https://search.patentsview.org/docs/docs/Search%20API/SearchAPIReference
Wayne M.
·
·
i was able to get an api key from the ppubs.uspto.gov site but have no idea how to add the api into my table
Wayne M.
·
·
your image is exactly what i set up in clay manually from the text url instead of pdf, but same function
Wayne M.
·
·
you saw the site, could apify work on that site
kushagra t.
·
·
api should work best imo, if you have to scrape this is worth trying Instant web data scraper - Scrape any website on apify