Issues with Auto Dedupe for LinkedinURLs Not Working as Expected

Casper Sulisz · 2025-03-11 15:06:08.333155+00

I'm having issues with auto-dedupe. I have auto dedupe set for a column that contains LinkedinURLs and it's not removing the duplicates. If I manually Dedupe on the same column the duplicates get removed. Is this a known issue?

Issues with Auto Dedupe for LinkedinURLs Not Working as Expected | Clay

10 comments

· Sorted by Oldest

Channeled
APP
·
·
Auto-dedupe is a new feature in Clay designed to automatically remove duplicate records. However, there are some rules to keep in mind for column deduplication: 1. Duplicates are identified based on exact string matches. 2. The process is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated differently. 3. Extra whitespace is considered, so "LinkedIn.com/in/profile " (with a space at the end) and "LinkedIn.com/in/profile" are not the same. These factors might explain why auto-dedupe isn't removing duplicates while manual dedupe works. To troubleshoot, check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. If the issue persists, you may want to request human assistance for further investigation.
Sources: New at Clay | Clay.com Table columns | Documentation | Clay University
Casper Sulisz
·
·
https://app.clay.com/workspaces/48942/workbooks/wb_SQNRauRaNxWw/tables/t_cCoEjsytR9cs/views/gv_U9fvJjtsW4RD Table: OUTPUT: Contacts @ Our LemList Campaigns Column: defaultProfileUrl
Channeled
APP
·
·
Auto-dedupe might not be removing duplicates in your "defaultProfileUrl" column due to a few reasons: 1. Case sensitivity: Auto-dedupe is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated as different entries. 2. Extra whitespace: Any additional spaces at the beginning or end of URLs are considered, so "LinkedIn.com/in/profile " and "LinkedIn.com/in/profile" are not the same. To resolve this: 1. Check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. 2. Ensure auto-dedupe is properly set up: Click the Auto-dedupe icon at the bottom right of your table, enable automatic deduplication, select the "defaultProfileUrl" column, and save changes. If the issue persists after these checks, you may need to request human assistance for further investigation.
Sources: Auto-update and Auto-dedupe Table Table columns | Documentation | Clay University
Bo (Clay)
·
·
Hey Casper - Sorry for this, it looks like we've got a bug on our hands. I've escalated this to our engineering team to help look into it. We'll follow up here as soon as we know more! Thank you for leaving the columns present, it's super helpful. Could you also let us know how you activated the auto-dedupe and when that data was added?
Channeled
APP
·
·
Channeled
APP
·
·
Thanks! We've reopened this thread. You can continue to add more detail directly in this thread.
Casper Sulisz
·
·
this is still an issue, can be replicated easily by adding a new table with e.g. domains
Casper Sulisz
·
·
I don't have that table anymore but if you're having issues replicating LMK and I'll throw something together
Bo (Clay)
·
·
Hey, If you can record a quick video showing the issue, that’d be super helpful for us to dig in again. Let me know once you’ve got it!
Channeled
APP
·
·
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in 02 Support.

Channeled
APP
·
·
Auto-dedupe is a new feature in Clay designed to automatically remove duplicate records. However, there are some rules to keep in mind for column deduplication: 1. Duplicates are identified based on exact string matches. 2. The process is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated differently. 3. Extra whitespace is considered, so "LinkedIn.com/in/profile " (with a space at the end) and "LinkedIn.com/in/profile" are not the same. These factors might explain why auto-dedupe isn't removing duplicates while manual dedupe works. To troubleshoot, check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. If the issue persists, you may want to request human assistance for further investigation.
Sources: New at Clay | Clay.com Table columns | Documentation | Clay University
Casper Sulisz
·
·
https://app.clay.com/workspaces/48942/workbooks/wb_SQNRauRaNxWw/tables/t_cCoEjsytR9cs/views/gv_U9fvJjtsW4RD Table: OUTPUT: Contacts @ Our LemList Campaigns Column: defaultProfileUrl
Channeled
APP
·
·
Auto-dedupe might not be removing duplicates in your "defaultProfileUrl" column due to a few reasons: 1. Case sensitivity: Auto-dedupe is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated as different entries. 2. Extra whitespace: Any additional spaces at the beginning or end of URLs are considered, so "LinkedIn.com/in/profile " and "LinkedIn.com/in/profile" are not the same. To resolve this: 1. Check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. 2. Ensure auto-dedupe is properly set up: Click the Auto-dedupe icon at the bottom right of your table, enable automatic deduplication, select the "defaultProfileUrl" column, and save changes. If the issue persists after these checks, you may need to request human assistance for further investigation.
Sources: Auto-update and Auto-dedupe Table Table columns | Documentation | Clay University
Bo (Clay)
·
·
Hey Casper - Sorry for this, it looks like we've got a bug on our hands. I've escalated this to our engineering team to help look into it. We'll follow up here as soon as we know more! Thank you for leaving the columns present, it's super helpful. Could you also let us know how you activated the auto-dedupe and when that data was added?
Channeled
APP
·
·
Channeled
APP
·
·
Thanks! We've reopened this thread. You can continue to add more detail directly in this thread.
Casper Sulisz
·
·
this is still an issue, can be replicated easily by adding a new table with e.g. domains
Casper Sulisz
·
·
I don't have that table anymore but if you're having issues replicating LMK and I'll throw something together
Bo (Clay)
·
·
Hey, If you can record a quick video showing the issue, that’d be super helpful for us to dig in again. Let me know once you’ve got it!
Channeled
APP
·
·
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in 02 Support.