Home
Events
Groups
Members

00 Clay Announcements
01 Community General
01 Props and Wins
01 Watercooler
01 Welcome and Intros
02 Bugs
02 Starting with Clay
02 Support
03 Feedback & Requests
03 Tutorials & Inspiration
04 FT Job Opps
Gtm Career Advice
Member Spotlight

Community Guidelines

Powered by Tightknit

Automating Job Posting Data Extraction from Apify Actor

·

·

I'm importing data from an Apify actor that queries Indeed for job postings. I want to fully automate the process that it extracts the latest data after the Apify actor runs and I want to make sure I don't run HTTP api calls for the same job posting. What would be the best way to go about doing this.

Automating Job Posting Data Extraction from Apify Actor | Clay

3 comments

· Sorted by Oldest

Channeled
APP
·
·
Here's how you can automate the Apify data import while avoiding duplicates: 1. Set up the Apify integration as a source by selecting "Import data from Apify actor" when creating your table. 2. When configuring the source: • Don't specify a particular run as input - this will allow your table to automatically update with all data from subsequent future runs. • Enable the auto-update feature, which will automatically process new rows when they're added to the table. 3. Clay's built-in auto-dedupe functionality will help prevent duplicate entries in your table, ensuring you don't process the same job posting multiple times. This setup will create an automated workflow where new job postings are imported and processed automatically while avoiding duplicates.
Sources: Apify integration overview | Documentation | Clay University New at Clay | Clay.com HTTP API integration overview | Documentation | Clay University
Channeled
APP
·
·
Did that answer your question?
Channeled
APP
·
·
Hi Rashi Agarwal! This thread was recently closed by our Support team. If you have a moment, please share your feedback: