Hey Mark L. Thanks for that context. So the URLs that need to be deduped are unique LinkedIn post URLs. So they only come once when the data is sent to the other table. I want to run the post extraction column on a schedule, where it sends the newly extracted posts to the other table, and there it should get auto-deduped to only retain the new ones, and delete the old ones (because I want updated reactions as well).
Since it's sending the data on a schedule, there isn't the problem of deduping records at the same time.
So even when I send the data after sometime, the dedupe doesn't work.
Please let me know if I can help clarify further.