Looking Up Large Rows in Another Table: Best Methods Explained

Mathew I. · 2024-11-25T17:12:58.200Z

What's the best way to look up a large number of rows in another table? Telling me I hit the max after attempting was ~2000 rows

Looking Up Large Rows in Another Table: Best Methods Explained | Clay

Channeled
APP
·
·
For looking up multiple rows in another table, you can use our "Lookup Multiple Rows in Other Table" action. This is specifically designed for scenarios where you need to retrieve multiple matching records.If you're working with very large volumes of data (around 2000 rows), you may want to consider using our passthrough tables feature, which is available to enterprise customers. This feature helps process and enrich large volumes of data efficiently by automatically processing incoming data, enriching it, and forwarding it to a designated destination before deleting the original entries. Sources: Lookup Multiple Rows in Other Table with Clay Passthrough Features Guide - Clay University
Mathew I.
·
·
How many rows can you look up with lookup multiple rows?
Channeled
APP
·
·
You can look up to 50,000 rows in a Clay table using the Lookup Multiple Rows feature. This is the maximum number of rows allowed per table. The Lookup Multiple Rows action is specifically designed for scenarios where you need to retrieve multiple matching records from another table based on specified criteria. Source: Lookup Multiple Rows in Other Table with Clay
Mathew I.
·
·
So why is it telling me I exceeded max amount of data with 2000 rows?
Channeled
APP
·
·
There are built-in limits on the number of records you can retrieve in Clay. For standard searches and lookups, you can retrieve up to 50,000 records per search.If you're encountering an error message while trying to look up 2,000 rows, this is likely not due to hitting the maximum limit, as it's well within the 50,000 record threshold. To resolve this, you could try: 1. Breaking down your lookup into smaller batches 2. Verifying that your lookup criteria are correctly specified 3. Checking if there are any other active filters or conditions affecting your searchIf you need to exceed the 50,000 record limit, you'll need to upgrade your plan. Sources: Lookup Multiple Rows in Other Table with Clay Find Company Overview - Clay University Find People Overview - Clay University
Mathew I.
·
·
Person
Channeled
APP
·
·
Looks like you're still looking for help. We're escalating this over to our support team and someone should be in touch soon. In the meantime, feel free to include any other information that may be helpful in solving your issue!
Mark L.
·
·
Hey Mathew. The "Cell data size exceeds limit" in your screenshot refers to the overall size of the response. It's related to the number of results, but more specifically, the limit is that an individual cell will only hold ~8kb of text. I'd recomend setting a Limit value in your lookup column, to reduce the number of rows (and volume of data) that you're returning. That will help ensure it completes. It looks like the table you linked originally is no longer available. But if you still see this issue after applying a limit, I'd be interested to know which table has this issue and the use case/workflow you're trying to put in place.
Mathew I.
·
·
Here is the table: https://app.clay.com/workspaces/423342/workbooks/wb_2yzrNp8cphiU/tables/t_UsSTMDBiqrAf/views/gv_rsPbSY6MwpoK I'm trying to effectively run a "SUM IF" against another table. I want to calculate in my email finder 2 table, how many rows (where project name = Sams Restaurants) equal success, failure, not run
Mathew I.
·
·
Is there a better way to do that?
Bo (.
·
·
Hey, thanks for reaching out Yes absolutely. TheLookup: If you want to add more information that you already found from a previous table to the current data you have (e.g., matching domains), then “lookup” is the best option. This allows you to call matching data into one table. Let me know if that answers your questions. Happy prospecting! 💪✨
Mathew I.
·
·
Sorry -- this is what I tried and it didn't work. I have an "email finder" table of 2000 rows, all with a different "Waterfall status" I want to create a new "metrics table" that looks up all rows in the "email finder" table so I can create formula columns to calc various metrics on the first table
Mathew I.
·
·
I tried this, but it gave me an error (bc looking up 2000 rows exceeded the max data limit of a multi-row lookup)
Mathew I.
·
·
Is there a way around this?
Bo (.
·
·
Ah, gotcha. Thanks for the info. That's not currently possible. I would recommend going into Google Sheets / exporting this as a CSV and doing those calculations. Right now, each row doesn't have knowledge of each other!

17 comments