Clay Icon
Join the Community
03 Tutorials & Inspiration

Scraping Job Postings for HR and Accounting Software Solutions with AI

Avatar of Kieran W.Kieran W.
·
·

Has anyone found a clever solution to scrape job postings on the website for specific technologies used by the company, possibly with the help of AI agents? I know there is a module for BuiltWith, but I’m more interested in HR and Accounting software solutions.

7 comments

  • Avatar of Ericson D.
    Ericson D.
    ·
    ·

    + 1 here

  • Avatar of Daniela D.
    Daniela D.
    ·
    ·

    Hey Kieran! Thanks for reaching out. Happy to help✨ Just to confirm, are you looking to extract technology keywords (for HR and account tech) from job postsfrom the website or detect technology usage on the job/careers sub-page?

  • Avatar of Sara M.
    Sara M.
    ·
    ·

    hey Daniela D. thanks for the quick reply! Yes, it's the first option. We're looking to extract tech keywords related to HR and accounting (e.g. Personio, SAP Concur) from the job descriptions on the company's careers page

    :thumbsup_all:1
  • Avatar of Daniela D.
    Daniela D.
    ·
    ·

    Hey Sara! Thanks for the reply. You can prompt Claygent to check for this information on a Company's job/career page. Here's an example prompt you can test/tweak: "Visit this website and check the careers or jobs page for open roles. Once you find this page, visit each open job post/link and check the job description you find for this technology keywords for HR & accounting software: {{add a comma separated list of technology keywords to check). If you find any of the keywords listed return "Yes", If you don't, return "No" (you can also it to extract a comma separated list of the keywords it finds). This is the website: {{press the / icon on your keyboard to map this field}}." One important note with this approach is if that data is not made publicly accessible on the website, Claygent will not be able to check for or extract those keywords. Here's a quick resource for using Claygent: - https://www.clay.com/university/lesson/claygent-ai-web-scraper-clay-101 I recommend running a test with sample data to review the results returned and iterate as needed. Let me know if this helps!

    :thumbsup_all:1
  • Avatar of Sara M.
    Sara M.
    ·
    ·

    thanks Daniela D., we'll give it a try! 🙂

    ✨1
  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Hi Kieran W.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Thank you so much for sharing your feedback Kieran W.!