How to Scrape Website Data and Identify Companies from Video Titles

I want to scrape a website and fill a clay table with the rows (companies that can be identified from said website). Is there a way to do that? Specifically the website contains a bunch of videos, and I want pass its contents through to some LLM to basically identify from the titles of the videos, which companies are being discussed (which would then populate my table)

6 comments

Channeled
APP
·
·
You can accomplish this using our Chrome Extension for web scraping and then process the data with an LLM: 1. Install the Clay Chrome Extension from the Chrome Web Store 2. Navigate to the website with videos 3. Use the extension to scrape video titles by clicking the Clay icon and selecting "Select Data" 4. Name and save your list, then add it to your workspace 5. Once in Clay, you can use our AI formulas to process the video titles and identify companies 6. The identified companies will automatically write to table in your Clay workspace For YouTube specifically, you can also use our YouTube transcript template to extract video content for more comprehensive analysis.
Sources: Scrape Website with Clay Deep Dive: Zenrows Scraping [Limitless Research] - Clay University Parse Data from URL with ScrapeMagic Get transcript of any YouTube video in seconds | Clay
Jonathan G.
·
·
But I want this scrape to happen once a day without me needing to manually do it
Bo (.
·
·
Hey, Yes, you can absolutely do that in Clay. Here’s how to set it up: 1. Scrape the Website 2. Extract Companies Using AI 3. Populate a New Table Use Write to Other Table to send the company names into a new Clay table for enrichment and outreach You can even schedule the scraping to run regularly using this guide: https://www.clay.com/university/guide/scheduled-columns Let me know if you’d like help setting up the prompt or flow.
Jonathan G.
·
·
Hey Bo, yeah I'd honestly love some help setting this up
Bo (.
·
·
Great. Which steps are you struggling with and in which table? Can you show us more details?
Channeled
APP
·
·
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in 02 Support.

How to Scrape Website Data and Identify Companies from Video Titles | Clay