Clay Icon

Setting Up a Daily Job to Enrich Data Rows Efficiently

·
·

I have about a thousand rows. I want to enrich 30 each day. (so that I can tweak prompts etc.. instead of enriching them all right now with v1 of prompts) Is it possible to set a recurring job like that?

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Yes, we can set up a recurring job to enrich rows on a schedule, but there are some limitations to consider. We offer a feature called Scheduled columns that lets you automatically re-run specific columns or entire tables on a recurring basis. You can set this to run daily, which would help with your goal of regular enrichment. However, there's currently no built-in way to limit the number of rows processed to exactly 30 per day. The scheduling feature runs on the entire table or selected columns. As an alternative, you could consider manually running enrichments on small batches. You can re-enrich up to 50,000 records in a single table with a button click. If you need more specific control over the number of rows enriched daily, you might need to explore custom solutions or wait for potential future updates to our scheduling features.

  • Avatar of Rutger B.
    Rutger B.
    ·
    ·

    um okay but is what I am doing not a basic need that everyone probably has?

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    While we understand your need to enrich a specific number of rows daily, our current scheduling feature doesn't allow for that level of granularity. We offer Scheduled columns that can automatically re-run specific columns or entire tables on a recurring basis (daily, weekly, or monthly), but it applies to all rows in the table. For now, the closest option is to manually enrich small batches. You can re-enrich up to 50,000 records in a single table with a button click. We're actively working on improving our scheduling capabilities. If you need a more tailored solution, you might want to request human assistance by clicking on "Talk to a person" for further guidance.

  • Avatar of Bo (.
    Bo (.
    ·
    ·

    Hey, Right now, it’s not possible to automatically select and enrich a set number of rows each day — you’d have to trigger it manually. Could you share a bit more about what you’re trying to achieve? Maybe there’s a good workaround we can set up for you!

  • Avatar of Rutger B.
    Rutger B.
    ·
    ·

    Hey Bo, thanks for following up - I imported about 1200 rows via linkedin sales nav url. I want to mail let’s say 100 people, see responses, optimise the Clay setup, mail another 100, etc.

  • Avatar of Smit V.
    Smit V.
    ·
    ·

    Hi Rutger, jumping in for Bo here!

    To achieve what you want, here’s a simple approach: 1. Start with Your Master Table: - This is your main table with all 1,200 rows from Sales Navigator. 2. Create Your First Batch: - Use the ‘Write to Table’ action on the first 100 rows. - Send this data into a new table (let’s call it “v1 Table”). - Add all your enrichments (e.g., finding emails, company data, etc.) in this v1 Table. 3. Test and Optimize: - Run your outreach or test your process with this first batch. 4. Set Up for the Next Batch: - Duplicate the v1 Table to create a “v2 Table.” - When you duplicate, only the columns (structure) are copied-no data comes over. - Go back to your master table and use ‘Write to Table’ again, this time with the next 100 rows, and write them to your v2 Table. - Update the enrichment columns and run them in the v2 Table. 5. Repeat as Needed: - Keep duplicating your latest version table for each new batch of 100. - Each time, use ‘Write to Table’ from your master table to add the next 100 rows to the new version table. - This keeps your workflow clean and lets you easily test and optimize each batch. Helpful Guides: ** Clay University: Write to Table (Clay 101) ** Write to Table Integration Overview Let me know if you need help setting this up, and feel free to share your table link so I can take a look!

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·