Best Methods for Scraping LinkedIn Activity with Web Agents
Hey everyone, I wonder how I can best set up a reliable Web Agent to scrape LinkedIn activity. I was testing several approaches (Apify through API, Apify on their interface, Clay's "Find post" enrichment and Claygent) and the only reliable ones seem to be the filter in LinkedIn SalesNav and Phantombuster which both come with their own disadvantages. I would love if you could help me solve this use case but also if you could generally help me understand how Claygent works and when it might not be reliable. I was running several variations of prompt (see in thread) on GPT 4o and Claude Haiku but did not get consistent or always accurate results on the LinkedIn activity of that person. For example, the agents would output that there was no recent activity of that person while there actually was some (example in thread). Is it generally impossible to get this from LinkedIn?