.png){kind=logo}
Setting Up Clay for Scraping LinkedIn and Reddit Mentions
Hey team, I'd love to learn how I can set up Clay to scrape Linkedin and Reddit for any mentions of our category and populate the links to these threads/posts in a sheet.
Hey team, I'd love to learn how I can set up Clay to scrape Linkedin and Reddit for any mentions of our category and populate the links to these threads/posts in a sheet.
To scrape LinkedIn and Reddit for category mentions and populate links in a sheet, you can use Clay's integration with Apify. Here's a simplified process: 1. Use Apify's "Unlimited Reddit Web Scraper" for Reddit content. 2. For LinkedIn, consider using Apify or Phantombuster integrations, but be cautious as these use your LinkedIn account and may risk being blocked. 3. Configure the scrapers with your target keywords and URLs. 4. Use Clay to set up a table that pulls data from these Apify actors. 5. In your Clay table, you can extract specific data like post URLs, titles, and descriptions. 6. Use Clay's "write to table" feature to populate the scraped data into your desired sheet format. Remember to use these tools responsibly and in compliance with the platforms' terms of service. If you need more detailed guidance, please ask and I'll be happy to provide further information.
Not completely. I want to use Clay to find the threads on Reddit
To find Reddit threads related to your category using Clay, you can follow these steps: 1. Use Clay's integration with Apify's "Unlimited Reddit Web Scraper" actor. 2. Configure the scraper settings with your target keywords and URLs related to your category. 3. Set up a Clay table that pulls data from the Apify actor. 4. Use Clay's "write to table" feature to populate the scraped Reddit data into your desired sheet format. Alternatively, you can use Clay's Google search integration to find Reddit threads: 1. Create a new Clay table using the Google search template. 2. In the "Scrape Website" column, customize your search to include "site::[reddit.com](https:://reddit.com)" along with your category keywords. 3. Run the table to get search results linking directly to relevant Reddit threads. Both methods will help you discover Reddit discussions related to your category efficiently.
Hey there, thanks for reaching out! ☺️ For LinkedIn, you can use the Trigify action "Find prospects engaging with social content" to capture relevant mentions. For Reddit, this integration is in the works—stay tuned! In the meantime, you can set up a scheduled Google search (e.g., daily) to extract the latest results as a workaround. Once you have the data in your table, you can easily send it to a Google Sheet, Google Doc, or even share it via Slack. Let me know if you have any questions!
Pefect! We also figured it out in a slightly scrappy way using the new Reddit integration.
