hi, we set up daily reddit keyword monitoring that gets pushed to slack. I turned on auto-dedupe and still for the past 3 days we are getting the same results as before. How do I set it up so that only the new posts/results get added and pushed to slack?
Auto-dedupe removes duplicate records but doesn't prevent the same posts from being found again in subsequent runs. For Reddit keyword monitoring, try using the Time period filter in your Reddit source settings to limit results to recent posts (e.g., "last 24 hours" for daily monitoring). You can also use the Only run if conditional setting to add logic that prevents running the enrichment if certain conditions aren't met. This should help ensure only new posts get captured and pushed to Slack each day.
Have you tried finding a unique ID for each output (might be URL, reddit post ID etc) and setup a rule, do not return if output contains {{ID }}?
Yes, that's a great approach! You can use the "Only run if" conditional setting in your Reddit enrichment to create deduplication logic. Set up a conditional formula that checks if the Reddit post URL or post ID already exists in your table, and only run the enrichment if it doesn't. This prevents duplicate posts from being processed and pushed to Slack. Combined with the time period filter limiting results to recent posts, this should give you the exact deduplication behavior you're looking for.