Hey - I’m running into an issue with one Apify actor. It stopped working once the "Source" hit 50k rows (not a table). I already dedup the list in a custom table so I don’t hit the 50k limit (see screenshot), but the source still counts every row without deduping. The full dataset gets pushed to the source every time.
What’s the best fix here? Should I run the dedup step in Apify and only push the new rows scraped? Right now I have to create a new source every 4 days before hitting the 50k limit. What would you recommend?