How Does Claygent Successfully Visit LinkedIn Profiles Despite Scraper Restrictions?

·Jun 02, 2026 01:07 PM·

Hi, Does anyone understand how Claygent visits Linkedin profiles. Linkedin is very harsh on scrapers, and with every scraper I've tried, I eventually hit a roadblock. How does Claygent do it?

11 comments

· Sorted by Oldest

Jeremy R.
·
·
Yes. Not many people know this, but… Claygent doesn't visit LinkedIn profiles live. It pulls MixRank data via a Langchain tool-call. So, in many cases, when you request LinkedIn data via Claygent (w/ an API key) it's cheaper than spending Claygent credits on their LinkedIn enrichment column directly (which also calls MixRank). Hope this helps!
Elric L.
·
·
so what's the best way to get live linkedin data from a profile?
Jeremy R.
·
(edited)·
The data Clay provides is pretty darn close to live. Otherwise, use an HTTP API column to ping a vendor that specifically scrapes data live from LinkedIn (maybe from Apify). But the last time I looked into this, it was more expensive overall.
1
Elric L.
·
·
"the data clay provides is pretty darn close to live" it really depends. i worked with a customer where some prospects changed jobs two years ago and weren't updated in clay data, so i use "enrich person" to get the live data.
Jeremy R.
·
·
Right, the first part of your message refers to “Find People” data, which is bad >50% of the time. The second part of your message refers to “Enrich Person”, which is the thing I've been talking about this whole time. Clay uses MixRank to fuel their “live data” enrichment (aka “Enrich Person”). And it's the same source used in a tool-call by Claygent when LinkedIn data is requested.
Sandro T.
·
·
Thank you Jeremy R., really helpful
Elric L.
·
·
yes exactly! ah got you! sorry I didn't understand. do you use MixRank Jeremy R. directly?
swaroop m.
·
·
Elric L. I've tried using claude code with browser harness to scrape linkedin it has worked for me but it's slow because it literally opens linkedin in your browser and scans through the profile
Elric L.
·
·
i wouldn't use that; you can get your account blocked/banned. i got blocked already doing that.
Jeremy R.
·
·
I don't use MixRank directly. I use Clay’s MixRank (aka “Enrich Person”) plus a custom “contact washing machine” workflow that flags the bad contacts
swaroop m.
·
·
Elric L. ohh i see, anyways I use it on my secondary account so I can experiment with it

How Does Claygent Successfully Visit LinkedIn Profiles Despite Scraper Restrictions? | Clay

Jeremy R.
·
·
Yes. Not many people know this, but… Claygent doesn't visit LinkedIn profiles live. It pulls MixRank data via a Langchain tool-call. So, in many cases, when you request LinkedIn data via Claygent (w/ an API key) it's cheaper than spending Claygent credits on their LinkedIn enrichment column directly (which also calls MixRank). Hope this helps!
Elric L.
·
·
so what's the best way to get live linkedin data from a profile?
Jeremy R.
·
(edited)·
The data Clay provides is pretty darn close to live. Otherwise, use an HTTP API column to ping a vendor that specifically scrapes data live from LinkedIn (maybe from Apify). But the last time I looked into this, it was more expensive overall.
1
Elric L.
·
·
"the data clay provides is pretty darn close to live" it really depends. i worked with a customer where some prospects changed jobs two years ago and weren't updated in clay data, so i use "enrich person" to get the live data.
Jeremy R.
·
·
Right, the first part of your message refers to “Find People” data, which is bad >50% of the time. The second part of your message refers to “Enrich Person”, which is the thing I've been talking about this whole time. Clay uses MixRank to fuel their “live data” enrichment (aka “Enrich Person”). And it's the same source used in a tool-call by Claygent when LinkedIn data is requested.
Sandro T.
·
·
Thank you Jeremy R., really helpful
Elric L.
·
·
yes exactly! ah got you! sorry I didn't understand. do you use MixRank Jeremy R. directly?
swaroop m.
·
·
Elric L. I've tried using claude code with browser harness to scrape linkedin it has worked for me but it's slow because it literally opens linkedin in your browser and scans through the profile
Elric L.
·
·
i wouldn't use that; you can get your account blocked/banned. i got blocked already doing that.
Jeremy R.
·
·
I don't use MixRank directly. I use Clay’s MixRank (aka “Enrich Person”) plus a custom “contact washing machine” workflow that flags the bad contacts
swaroop m.
·
·
Elric L. ohh i see, anyways I use it on my secondary account so I can experiment with it