Clay Icon

Extract Job Descriptions from LinkedIn Job Vacancy URLs Quickly and Accurately

Β·
Β·

i've got a list of linkedin job vacancy urls in a column. What's the quickest way to extract the job description from as it is. Claygent is too unreliable and scrape website doesn't get the actual job description

  • Avatar of Matthew Q.
    Matthew Q.
    Β·
    Β·

    Hey Mo, typically scrape website (using zenrows) is best

  • Avatar of Matthew Q.
    Matthew Q.
    Β·
    Β·

    When you say it’s not getting the actual job description -> is it getting blocked or its just not pulling everything?

  • Avatar of Mohan
    Mohan
    Β·
    Β·

    let me try again

  • Avatar of Mohan
    Mohan
    Β·
    Β·

    should I use autoparsing?

  • Avatar of Mohan
    Mohan
    Β·
    Β·

    zenrows came back with an error (with and without autoparsing). and clay's scrape came back with 'Please visit the below link to enable LinkedIn crawling.'

  • Avatar of Mohan
    Mohan
    Β·
    Β·
  • Avatar of Matthew Q.
    Matthew Q.
    Β·
    Β·

    Ah did you put on premium proxy and anti-bot for zenrows? Sometimes that will fix it. Overall Linkedin does work pretty hard to block this though

  • Avatar of Mohan
    Mohan
    Β·
    Β·

    yep tried that too didn't work, don't worry moving on for now thanks though man

  • Avatar of Matthew Q.
    Matthew Q.
    Β·
    Β·

    gotcha, sorry about that. We’ll continue looking into ways to find this.

  • Avatar of Clay T.
    Clay T.
    APP
    Β·
    Β·

    I actually ran into an example yesterday and just these settings helped:

    a01adde6-3402-4e0c-b29a-68db570e71d7.png(151 kB)
  • Avatar of Clay T.
    Clay T.
    APP
    Β·
    Β·

    Disregard the alert symbol because that's just saying the cell size limit was reached, just wanted to show that it's pulling it. Otherwise, it would say you need to "Enable x function to scrape" or something similar

  • Avatar of Lucas H.
    Lucas H.
    Β·
    Β·

    This worked for me

  • Avatar of Mohan
    Mohan
    Β·
    Β·

    interesting thanks Arturo O. will try this next time