Clay Icon

Extract Job Descriptions from LinkedIn Job Vacancy URLs Quickly and Accurately

·
·

i've got a list of linkedin job vacancy urls in a column. What's the quickest way to extract the job description from as it is. Claygent is too unreliable and scrape website doesn't get the actual job description

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    Hey Mo, typically scrape website (using zenrows) is best

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    When you say it’s not getting the actual job description -> is it getting blocked or its just not pulling everything?

  • Avatar of Mohan
    Mohan
    ·
    ·

    let me try again

  • Avatar of Mohan
    Mohan
    ·
    ·

    should I use autoparsing?

  • Avatar of Mohan
    Mohan
    ·
    ·

    zenrows came back with an error (with and without autoparsing). and clay's scrape came back with 'Please visit the below link to enable LinkedIn crawling.'

  • Avatar of Mohan
    Mohan
    ·
    ·
  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    Ah did you put on premium proxy and anti-bot for zenrows? Sometimes that will fix it. Overall Linkedin does work pretty hard to block this though

  • Avatar of Mohan
    Mohan
    ·
    ·

    yep tried that too didn't work, don't worry moving on for now thanks though man

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    gotcha, sorry about that. We’ll continue looking into ways to find this.

  • Avatar of Clay Team
    Clay Team
    APP
    ·
    ·

    I actually ran into an example yesterday and just these settings helped:

    a01adde6-3402-4e0c-b29a-68db570e71d7.png(151 kB)
  • Avatar of Clay Team
    Clay Team
    APP
    ·
    ·

    Disregard the alert symbol because that's just saying the cell size limit was reached, just wanted to show that it's pulling it. Otherwise, it would say you need to "Enable x function to scrape" or something similar

  • Avatar of Lucas H.
    Lucas H.
    ·
    ·

    This worked for me

  • Avatar of Mohan
    Mohan
    ·
    ·

    interesting thanks Arturo O. will try this next time