Clay Icon
Join the Community
02 Bugs

Issues with Auto Dedupe for LinkedinURLs Not Working as Expected

Avatar of Casper S.Casper S.
·
·

I'm having issues with auto-dedupe. I have auto dedupe set for a column that contains LinkedinURLs and it's not removing the duplicates. If I manually Dedupe on the same column the duplicates get removed. Is this a known issue?

4 comments

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Auto-dedupe is a new feature in Clay designed to automatically remove duplicate records. However, there are some rules to keep in mind for column deduplication: 1. Duplicates are identified based on exact string matches. 2. The process is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated differently. 3. Extra whitespace is considered, so "LinkedIn.com/in/profile " (with a space at the end) and "LinkedIn.com/in/profile" are not the same. These factors might explain why auto-dedupe isn't removing duplicates while manual dedupe works. To troubleshoot, check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. If the issue persists, you may want to request human assistance for further investigation.

  • Avatar of Casper S.
    Casper S.
    ·
    ·

    https://app.clay.com/workspaces/48942/workbooks/wb_SQNRauRaNxWw/tables/t_cCoEjsytR9cs/views/gv_U9fvJjtsW4RD Table: OUTPUT: Contacts @ Our LemList Campaigns Column: defaultProfileUrl

  • Avatar of Channeled
    Channeled
    APP
    ·
    ·

    Auto-dedupe might not be removing duplicates in your "defaultProfileUrl" column due to a few reasons: 1. Case sensitivity: Auto-dedupe is case-sensitive, so "LinkedIn.com/in/profile" and "linkedin.com/in/profile" are treated as different entries. 2. Extra whitespace: Any additional spaces at the beginning or end of URLs are considered, so "LinkedIn.com/in/profile " and "LinkedIn.com/in/profile" are not the same. To resolve this: 1. Check for inconsistencies in capitalization or extra spaces in your LinkedIn URLs. 2. Ensure auto-dedupe is properly set up: Click the Auto-dedupe icon at the bottom right of your table, enable automatic deduplication, select the "defaultProfileUrl" column, and save changes. If the issue persists after these checks, you may need to request human assistance for further investigation.

  • Avatar of Bo (.
    Bo (.
    ·
    ·

    Hey Casper - Sorry for this, it looks like we've got a bug on our hands. I've escalated this to our engineering team to help look into it. We'll follow up here as soon as we know more! Thank you for leaving the columns present, it's super helpful. Could you also let us know how you activated the auto-dedupe and when that data was added?