How can I avoid creating duplicate entries across multiple lists? I see there's a function to prevent duplicates, but it only works within a single list. For example, I’m generating lists of clothing companies categorized by type. If I can only use one existing list to filter for duplicates, how can I ensure there are no duplicates across all the lists I’m creating?
To prevent duplicate entries across your clothing company lists, you can use our auto-dedupe feature in two ways:1. Enable automatic deduplication: • Click the Auto-dedupe icon at the bottom right of your table • Select "Enable automatic deduplication" • Choose the column you want to dedupe (like company name) • Click "Save Changes" 2. Manual column deduplication: • Right-click the column containing company names • Select "Dedupe > Delete Duplicate Row"For best results, route all your company data through Clay first before creating separate categorized lists. This acts as a central data warehouse that helps prevent duplicate entries from various sources. Sources: Auto-update and Auto-dedupe Table Intro to CRM Data Enrichment [CRM Enrichment] - Clay University
Thanks! We've reopened this thread. You can continue to add more detail directly in this thread.
But am I able to do this with many lists?
Yes, there are several ways to prevent duplicate entries across your lists:1. Use Auto-dedupe feature: • Enable automatic deduplication by clicking the Auto-dedupe icon at the bottom right of your table • Select the column you want to dedupe • Click "Save Changes" 2. Manual Column Deduplication: • Right-click the column you want to dedupe • Select "Dedupe" followed by "Delete Duplicate Row" 3. Use Clay as a Data Cleanroom: We route all data through Clay first before it enters other systems, which helps prevent duplicates by checking if the information already exists before creating new entries.You can also use our Normalize and Deduplicate integration to standardize data formats and remove duplicate entries, which helps maintain data quality and consistency across your lists. Sources: Intro to CRM Data Enrichment [CRM Enrichment] - Clay University Normalize and Deduplicate a List with Clay Auto-update and Auto-dedupe Table
Hi! To avoid duplicates across multiple lists, deduplicating everything would remove any duplicates between lists. However, our system only supports deduplication within individual lists, so it won't check across multiple lists.
Stefano can I add multiple lists into a list master-sheet to do this since there is only one list able to be listed in the duplicate filter? For exmaple I have 5 lists of fashion brand companies when I create lists for other fashion brand companies I want to make sure that im not creating any duplciates
Hey Stefano! Absolutely - you can definitely handle multiple lists using our Write to Table feature! Here's how you can set this up: 1. Create a master table where all your fashion brands will live 2. Use Write to Table to send each of your 5 lists into this master table 3. Add a dedupe filter in your master table to catch any duplicates automatically I've got some helpful docs that explain all the details: - Write to Table overview: clay.com/university/lesson/write-to-table-integration-overview - Clay 101 guide: clay.com/university/lesson/write-to-table-clay-101
Im having trouble finding where to use " write to table" to add all of my company lists into one mastersheet in order to make sure we have no duplciates
Should I move all lists into a workbook and can i use a workbook as the fliter instead?
Hey Robert! Thanks for the reply. The "write to other table" integration will need to be added to each table (5/5 tables) and configured to write to one single table. I made a quick recording below walking through the set up process for the integration: https://www.loom.com/share/9c69dac17b214112a0e8c983f15fef02 If you'd prefer, you can move each table into a workbook, but you will still need to add the "write to table" integration to each table. Having all tables in a single workbook will just make it easier to visualize your workflow and switch between lists as needed. Here's an additional resource for the "write to other table integration": https://www.clay.com/university/lesson/write-to-table-clay-101 Let me know if this helps!
Hey Daniela D. ! thanks for your reply and video! I understand having all tables in a workbook is very helpful this is what I am doing. What I am struggling with is creating an effective and quick way of making sure I dont get duplicates on my searchs and I cannot apply my entire workbook full of sheets to a new search when using the avoid duplicates function. For some reason Clay only allows me to paste one of the many sheets I have in that workbook to avoid creating a duplicate hence why I am trying to figure out how to put all sheets in that workbook into a master table so I can use that table in the filter when searching for new leads. Does this make sense? At the moment I am just exporting them into CSVS then Importing them into google sheets, and adding them one by one into a new table. Is there a more efficient way of doing this?
Hey Robert! Thanks for the reply. Got it. Happy to help. This is where the "Write to Table" integration comes in handy. Within your workbook, you can create a Master table and use the integration to merge row data from each table into that Master table. The reason you can't exclude the entire workbook is that the workbook acts as a central place for managing multiple tables and streamlining workflows. However, exclusions are applied at the table level, not the workbook level. Also, it's currently not possible to exclude other table types from the "find company"/"find people" sources. The exclusion only applies to other find people tables (if it's a find people search) or find company tables. After adding each table data to a single Master table, you'll need to use the Lookup function to avoid enriching duplicates. Here's an additional video I made for this: https://www.loom.com/share/bed7c03cedf547bca358bd84c690deb1 Let me know if you have any questions!
Hey there - just wanted to check in here to see if you needed anything else! Feel free to reply back here if you do.
We haven't heard back from you in a bit, so we're going to go ahead and close things out here - feel free to let us know if you still need something!
Hey Daniela D. Im trying to re watch these loom videos to see how to add the leads into a master sheet do you mind sharing them once more they are not popping up! thank you!
actually it looks like ive figured it out!
Oh - Well done. For future references: 1. Go here to copy your API key [App: Article Inserter] 2. Go back to the enrichment, edit the account and add your API Key (make sure to remove the other one if it has one) [App: Article Inserter]
I just pressed add account and it added mine with the email and username to auth
when i tried write to table to my mastersheet, it did not allow me
can you see this here ?
this is what I am doing
Im trying to only copy the name of the company into the master sheet not the people
so when I compare this table with a search it does not show me that company as a duplicate
this is what happens when I try this
It does not let me run this
Robert - Do you mind sending the link to the table so we can take a look? https://downloads.intercomcdn.com/i/o/1171717996/ac7729f84b426e1d0358af02/image.png?expires=1736298000&signature=3e153bd0ff19b26fe1ea616b13f479a8504b1c44eb24a1449de7c5047906dc6d&req=dSEgF85%2FmohWX%2FMW1HO4zYTywS3%2BD58W2BKsam%2FhVPvF4g%3D%3D%0A
Yes
here is the workbook, Im trying to add all companies into a mastersheet so i can go ahead and start building new lists without duplicates
Hey Robert - Here's how to do this: https://cln.sh/cgFDjK96 Let me know if this helps :)
did you manuelly change the API to the correct one?
Do I need to go ahead and add that api from the video you shared or did you already do so? thanks!
Do I need any key words in my master sheet table to make sure when I do apply this table to the no duplicates option when doing a new search I just listed "Company Name" for the mastersheet and I am writing all of them from into just one column which is the Company Name column, or will I need to make it more clear / add more coloumns for the companies?
Also when running this action, should I do them one by one, I noticed it stopped adding them and the rest are on queue and the mastersheet is no longer updating, even though more companies need to be added. Should I continue to wait or cancel it and run it again but this time one table by one table waiting until they are all complete
to add to this above ^ As you can see here I just made a search attempting to exclude the companies listed in the master sheet table - in my new search I can see it says 5600+ companies (from the column) will be excluded but in this case it was not as you can see a company is listed in the preview that is supposed to be exlcuded. What should I do here Clay S.
and I noticed this is the same with many others, I must be doing something wrong with my mastersheet table, because its not rendering the duplicates.
Im going to make a new table and attempt to only use the company domains instead of the names of the companies
I was able to get better results using the find domains option
Hey Robert! Thanks for the reply. Happy to help✨. Could you confirm which table the action to send data to the Master table stopped running for? Happy to check this. It looks like the exclusion was not applied for that record it does not have a unique identifier. For context, the exclusion action requires either a company LinkedIn url or domain to exclude a record. To ensure, the search is applied to all records in the Master Sheet, there must be a corresponding identifier. You can use Claygent to find domains for records that do not have one, and add a merge column combining both urls, to use for your search. Here's a quick guide for using Claygent: - https://www.clay.com/university/lesson/claygent-ai-web-scraper-clay-101 - https://www.clay.com/university/guide/ai-metaprompter-guide Let me know if this helps. https://downloads.intercomcdn.com/i/o/w28k1kwz/1325978615/58c1c3a717468e1cf3d4c5806250/CleanShot+2025-01-08+at+13_35_20%402x.png?expires=1736341200&signature=627e9e16efcd59dfe94e49b2e6078162a11e53c8ce8e6332392b637a805f51c5&req=dSMlE8B5lYdeXPMW1HO4zcjeEHfhKDcFxqSps4ZfYUjHgv1%2Bu3iCTkOV0Sho%0AC903%0A
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in 02 Support.
.png&w=3840&q=75){kind=logo}
