Extract Job Descriptions from LinkedIn Job Vacancy URLs Quickly and Accurately

·

i've got a list of linkedin job vacancy urls in a column. What's the quickest way to extract the job description from as it is. Claygent is too unreliable and scrape website doesn't get the actual job description

✅1

13 comments

Matthew Q.
·
·
Hey Mo, typically scrape website (using zenrows) is best
Matthew Q.
·
·
When you say it’s not getting the actual job description -> is it getting blocked or its just not pulling everything?
Mohan
·
·
let me try again
Mohan
·
·
should I use autoparsing?
Mohan
·
·
zenrows came back with an error (with and without autoparsing). and clay's scrape came back with 'Please visit the below link to enable LinkedIn crawling.'
Mohan
·
·
Matthew Q.
Matthew Q.
·
·
Ah did you put on premium proxy and anti-bot for zenrows? Sometimes that will fix it. Overall Linkedin does work pretty hard to block this though
Mohan
·
·
yep tried that too didn't work, don't worry moving on for now thanks though man
Matthew Q.
·
·
gotcha, sorry about that. We’ll continue looking into ways to find this.
Clay Team
APP
·
·
I actually ran into an example yesterday and just these settings helped:
a01adde6-3402-4e0c-b29a-68db570e71d7.png(151 kB)
:sparkles-clay:1
Clay Team
APP
·
·
Disregard the alert symbol because that's just saying the cell size limit was reached, just wanted to show that it's pulling it. Otherwise, it would say you need to "Enable x function to scrape" or something similar
Lucas H.
·
·
This worked for me
:sparkles-clay:1
Mohan
·
·
interesting thanks Arturo O. will try this next time
:sparkles-clay:1