Clay Icon

Hello! What is the best way of importing the data from our DB to Clay?

·
·

Hello! What is the best way of importing the data from our DB to Clay?

  • Avatar of Stefano
    Stefano
    ·
    ·

    Hi Anton, thank you for reaching out! Could you please give us more context about what your database is and what properties you are trying to push into Clay? It is also worth mentioning that, in the past, people have been able to achieve this through the use of webhooks. A webhook allows you to stream data into Clay without having to manually import/refresh new records every time they are created. This enables you to bypass the process of pulling in records every 24 hours for certain sources. Here are a few greater resources for webhook imports: * https://docs.clay.com/en/articles/9730014-import-data-to-clay-using-webhooks * Video showing a few automations you can set up in Clay (webhook example in the first few minutes of this video): https://youtu.be/yw5paDolwTQ?feature=shared Feel free to take a shot at building your first webhook table and let me know how it goes! 😊

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    Stefano thank you for your response! It is a db table containing leads that we want to sync with Clay periodically. The easier this integration would be for us the better

  • Avatar of Stefano
    Stefano
    ·
    ·

    The easiest way to sync your leads database with Clay periodically is by using webhooks. You can set up a webhook in Clay to automatically import new records as they are created, bypassing the need to manually pull in records every 24 hours. Here's how you can do it: * In your Clay workspace, click on "Import Data from Webhook" to add a new source. * Clay will generate a unique webhook URL for you. * Copy this URL and go to your lead capture software. * Find the option to set up a webhook in the "Integrations", "Exports", or "Connections" tab of your lead capture tool. * Paste the Clay webhook URL there to create a direct line for your lead data to flow into Clay. For more detailed guidance and resources on setting up webhook imports in Clay, you can refer to the following links: * Import data to Clay using webhooks * Video tutorial on setting up automations in Clay, including webhooks. Remember, this method allows for new records to be streamed into Clay as they are created, which is ideal for keeping your leads database up-to-date without manual intervention. Let me know if there is anything else I can help you with!

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    i cannot find "import data from webhook"

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    Another question is about batch importing. It looks like webhooks can import records one by one, but is there a batch import support?

  • Avatar of Mark L.
    Mark L.
    ·
    ·

    If you're already in a table (like if you've just created a blank workbook), you can navigate to Actions > Import... > Monitor webhook. That will generate an endpoint where you can send data. You can send up to 10 records per second, as long as each payload is < 100kb. (https://docs.clay.com/en/articles/9730014-import-data-to-clay-using-webhooks) No options for batching today, but I can share feedback internally. Could you tell me more about the use case, to help advocate for it?

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    Mark L. Stefano thank you! I'm trying to understand how to import more fields with clay (not just email), I have other fields added to my table and send them in my webhook, but they are not appearing in the table:

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    Here's my webhook, for some reason it only populated email column in Clay:

    curl 'https://api.clay.com/v3/sources/webhook/pull-in-data-from-a-webhook-a2b1ac2f-4e1d-490f-b3c8-3b55ae0b4476' \
      -X POST \
      -H 'Content-Type: application/json' \
      -d '{
        "occured_at": "2024-11-04 19:30:11 UTC",
        "user_id": 310881,
        "email": "anuj@bravado.co",
        "phone_number": null,
        "linkedin_slug": null,
        "event_type": "opened",
        "email_log_id": 298812530,
        "campaign": "[wr-retention] [advice-column] 2022-07-06"
      }'
    OK%
  • Avatar of Mark L.
    Mark L.
    ·
    ·

    Thanks for that – could you share the specific table you're working in? I'd like to have a look there to compare.

  • Avatar of Anton P.
    Anton P.
    ·
    ·

    can you give me some timeline? I'm currently blocked by this issue

  • Avatar of Mark L.
    Mark L.
    ·
    ·

    Anton, it looks like the data is being received without issue. You'll just need to map the columns. Select any cell → Add as column → add or Map to existing column as needed. https://downloads.intercomcdn.com/i/o/w28k1kwz/1243741261/d40c9a12a284c416b9baf57eecc4/20241107-63918-map-columns.png?expires=1731013200&signature=65d105b900303e9f32a73a3ce4a55fa7492b29e07ae60131ec619133edc57ea8&req=dSIjFc56nINZWPMW1HO4zWCsdDoRGp0UG4UQt6D8PzbE4mxWIvEzSomawqwU%0AsvD7%0A I've done that for the user_id column, for example, and you can see in the screenshot above how it displays after mapping. Could you try that, and let me know if you have trouble with the other fields you're interested in?

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Hey there - just wanted to check in here to see if you needed anything else! Feel free to reply back here if you do.

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    We haven't heard back from you in a bit, so we're going to go ahead and close things out here - feel free to let us know if you still need something!

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Hi Anton P.! This thread was recently closed by our Support team. If you have a moment, please share your feedback: