Simplifying Dedupe Process for 10k Prospect List by Job Title

Question to the clay pros Say I have a list of 10k prospects, from 3k unique companies Some companies have 5 employees, other 10, some just 1 How do you dedupe in order to keep up to x number of people per company, based on job title priorities? (my process involves breaking this down to multiple worksheets and lookup associations every time, but it's too time consuming. Wondering if anyone cracked this with something simpler)

8 comments

Bo (.
·
·
Hey — you can track how many employees you have per company using this method: https://www.loom.com/share/a39a4569d95244b7886026f3c70812c7 It’ll help you set limits based on job title priorities without needing to split across multiple worksheets. Let me know if you need help setting it up.
Panos S.
·
·
hey Bo (. - thanks for taking the time here! though this is focused on duplicates on a prospect level i have unique prospects but from the same company
Panos S.
·
·
so if i have the founder / cto / cpo from the company, but i also have 10 more people that are head of engineering or whatever, i might want to keep specifically the first 3
Bo (.
·
·
Hey, Just to clarify—are you trying to keep only specific roles like Founder, CTO, and CPO, and remove the rest from the same company? If so, sounds like you might want to apply a role-based filter or scoring system and from there use a lookup, run the lookup then use a formula to check if the score is one of the top 3 of that company. Let me know if you have more questions
Panos S.
·
·
pretty much, but i want to dedupe in a waterfall style. Already doing scoring and then lookups in waterfall everytime so I delete prospects But this takes too much time cause the lookup is in another table Wondering if there's any way to do a lookup on the same table, or perhaps a formula where i can say "if company linkedin URL is the same, do XYZ"
Bo (.
·
·
Hey, Got it—you’re looking to dedupe within the same table by company, and keep only the top roles in a priority order, without relying on external lookups. Right now, since Clay tables don’t have row-to-row awareness, there’s no way to directly reference “other rows with the same company” in a formula. That’s why you’re using lookups as a workaround. One way to streamline this: ** Score roles by priority directly in the main table (e.g. Founder = 1, CTO = 2…) ** Then write to another table with a grouped write: use /company linkedin url as the key and set “Keep highest score per group” * From there, you’ll have just the top N people per company without lookups or extra cleanup It’s not true in-table logic, but it avoids cross-table lookups every time. Let me know if you want help setting that up.
Panos S.
·
·
this looks feasible Bo (. but unable to replicate Could def use your help setting it up Can we block some time? Also, tried to schedule a call with your team for your enterprise plan We're a 2-man agency but the €800/month plan doesn't suit us and will need to upgrade to €1.5k in August Curious to here about the enterprise plans cause I'd rather pay more and do more checks if the difference is 500-1k
Clay
APP
·
·
Hi Panos, Would love to walk you through our enterprise plan option. Typically our enterprise plans start at 50k or more per year, if your finding that 800 per month isn't enough I would recommend checking out our 1.5K monthly plan option. Also wanted to let you know that we offer a demo and Q+A, called Open Studio. It's held on Tuesdays @3pm EST, Wednesdays @11am EST, and Thursdays @8am EST (register here: https://lu.ma/claylive). This is a great option to get some help setting up your flow as we don't currently offer 1-on-1 calls. If that time doesn't work or you're looking to dive in sooner, you can check out our 101 resources at clay.com/university. If you attend the Open Studio and are still experiencing trouble please let us know and we can figure something out. Please let me know if you have any additional questions, or if there is anything else I can help you with. -Nicole

Simplifying Dedupe Process for 10k Prospect List by Job Title | Clay