Clay Icon

Struggling to Extract Skills Data from LinkedIn Profiles?

·
·

Hey there! I'm struggling to get the Skills section data off of LI profiles, has anyone figured out how to do this? The Skills section is not included in the Enrich Person from Profile Enrichment. When people tag skills in their work experience, we also don't see it in the Experience data. I have tried using Claygent and it will grab the first two that are shown on the main profile page, but seems to fail when it's required to click on "Show all # Skills" and navigate to the expanded list (on a new URL). I noticed that it takes you to a new URL that is standardized when you click to show all skills, so I used a formula to add "/details/skills/" on to the LI URL in clay and tried having Claygent navigate there specifically and it didn't work either. Claygent will give an answer like this in the reasoning "A complete list of skills would require accessing the '/details/skills/' URL, which is not directly provided in the readily available data. However, the provided data gives a partial picture of his skills." I've tried a zenrows scrape of the Skills URL but it doesn't work, maybe because it's a Formula URL column? Using the regular URL still doesn't get me the expanded list of Skills. Hoping I might be overlooking a simple fix, any ideas or feedback welcome!! This is the example profile I have been using as he doesn't have much text in his profile but does have skills tagged in his work experience and a list of about 10 in his skills section. The best output I've gotten for technical skills is AWS, Node https://www.linkedin.com/in/simon-marty/ https://www.linkedin.com/in/simon-marty/details/skills/

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    👋 Hey there! Our support team has got your message - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in this thread so that we can help you as quickly as possible!

  • Avatar of Bo (.
    Bo (.
    ·
    ·

    Hey! Thanks for reaching out 😊. Sometimes, this data is only visible when logged in, and some profiles may not have it easily accessible so our data providers might miss it same for the models. Could you share the table URL you’re working on? I’ll take a closer look to see what’s going on. Feel free to send over the link, and I’ll help troubleshoot further!

  • Avatar of LuisArturo
    LuisArturo
    ·
    ·

    Hey there Jenna thanks for reaching out, jumping in for Bo here, in this situation it would be better to use Apify or Phantombuster to scrape these details, as Claygent is not reliable when it comes to scrapping LinkedIn accounts. For an easier setup with the integration would recommend using Phantombuster top do this. https://downloads.intercomcdn.com/i/o/w28k1kwz/1228235117/2b47b1d0c609fd85eac82f4065b3/image.png?expires=1729812600&signature=a5ea101c0f842225bdd9c94ad0599163f418e0bd3121b361b9a1f26ad3ea66d4&req=dSIlHst9mIBeXvMW1HO4zUe7KPBHkXVv2JQ29atIiNZzayd2OF1urw1gZahI%0A1VQh%0A

  • Avatar of Muhammad S.
    Muhammad S.
    ·
    ·

    Lead magic profile enrichment pulls the skill section. Aibees as well.

  • Avatar of Daniel K.
    Daniel K.
    ·
    ·

    Thanks for the great suggestion, Muhammad! 🙌 There are also a few Linkedin APIs available on RapidAPI that can retrieve the skills section for you. Feel free to check them out as an alternative option. Let me know if you need any more assistance or have any other questions! 😊

  • Avatar of Jenna M.
    Jenna M.
    ·
    ·

    Daniel K. I found an API on RapidAPI that I want to test out! I've not used the HttpAPI enrichment in clay before, can you give any guidance on how to set it up? Thank you in advance!!

  • Avatar of Muhammad S.
    Muhammad S.
    ·
    ·

    This is how you can integrate it.

  • Avatar of Muhammad S.
    Muhammad S.
    ·
    ·

    + delete the image as your API key is exposed OR rotate/del and create a new api key in rapid api dashboard.

  • Avatar of LuisArturo
    LuisArturo
    ·
    ·

    Hey there Jenna jumping in for Daniel and appreciate you jumping in with the video Muhammad! LEt us know if you still need any further instructions on connecting to Rapid API Jenna.

  • Avatar of Jenna M.
    Jenna M.
    ·
    ·

    This is perfect and got me exactly what I was looking for! THANK YOU SO MUCH!! Muhammad S. LuisArturo

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Hi Jenna M.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Thank you so much for sharing your feedback Jenna M.!