Thanks Bo. I tried using Apify for now making changes into Page Function for each directory and will hopefully schedule the runs and dedupe it. I will also try your method out to extract more data. Will update the thread if I face issues. Thanks for helping.
how do I make that into an RSS feed? also the structure is only title on the first page. Each click opens up the JD. How do I capture that too for all links
