Clay Icon

Searching for LinkedIn Scraping Tools for Recent User Activity

·
·

Hey! I am trying to find a way to scrape recent linkedin posts/likes/comments of roughly 10k people with profile URL. Is there an integration that I can use that works for A. these amount of profiles and B. is able to only scrape recent activities?

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    We have a few options that might help you with scraping recent LinkedIn activities: 1. Our "Social Posts" feature can find recent professional posts from specific individuals. You can use it as an import source or as an action/enrichment column to get posts, comments, shares, and likes. 2. We have a LinkedIn Community integration with an action called "Find Post Audience". This allows you to find who reacted to or commented on a LinkedIn post. You can provide a post URL or URN, choose the reaction type, and set a maximum number of results. For large-scale scraping of 10,000 profiles, you might need to consider using these features in combination or running multiple queries. Keep in mind that frequent large-scale scraping may risk account blocking, so use these tools judiciously. If you need more specific guidance on how to set this up for your use case, let me know and I can provide more details.

  • Avatar of Louis S.
    Louis S.
    ·
    ·

    For the first way I didnt find the setting to only scrape recent activities. And for the second way a post url is necessary. but i only have profile urls

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    To scrape recent LinkedIn activities for 10,000 profiles using only profile URLs, you can use our "Social Posts" feature. Here's how: 1. Use the "Social Posts" feature as an import source or action/enrichment column. 2. Input the LinkedIn profile URLs you have. 3. Optionally, use the "Post Date Filter" to specify how recent you want the activities to be. 4. You'll get posts, comments, shares, and likes for each profile. For large-scale scraping, you may need to run multiple queries. Be cautious, as frequent large-scale scraping could risk account blocking. If you need additional options, consider using Apify or Phantombuster integrations, or try Claygent, our AI research tool with web access. For more specific guidance, you may want to request human assistance.

  • Avatar of Louis S.
    Louis S.
    ·
    ·

    Where do I find this? Optionally, use the "Post Date Filter" to specify how recent you want the activities to be.

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    You can find the "Post Date Filter" option when using the "Find Recent Posts by User or Company" action in our "Social Posts" feature. It's an optional input field where you can specify a date to filter posts. You can enter a specific date or use relative dates like "30 days ago". This will return only posts after the date you've entered, allowing you to focus on recent activities. If you need more detailed guidance on using this feature, please let me know, and I'll be happy to help further.

  • Avatar of Louis S.
    Louis S.
    ·
    ·

    I dont find Find Recent Posts by User or Company

  • Avatar of Louis S.
    Louis S.
    ·
    ·

    can u help me with that one?

  • Avatar of Bo (.
    Bo (.
    ·
    ·

    Hey! The integration usually pulls the most recent activities first, so you don’t need to worry about it prioritizing older posts—if you’re seeing those, it’s likely because no recent ones were available. To avoid using older data, you can add filters or formulas to exclude posts beyond a certain date or limit results to the most recent ones only. Let me know if you want help setting that up.

  • Avatar of Louis S.
    Louis S.
    ·
    ·

    Thanks a lot to you Bo (.! All fine

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·
  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Thank you so much for sharing your feedback ​Louis S.​!