Hi folks - I started running a scrape of 24.5k rows at 10:00 am pst. So far, the "Scrape Website" column says "Queued..." but hasn't populated the adjacent "@ Emails" column. I'm wondering if you know how long it will take to populate the email addresses. Thanks!
The scraping process timing can vary based on several factors. For website scraping, you can add a delay of up to 10 seconds per URL to allow JavaScript content to load properly. Since your table is set to refresh every 24 hours, you may need to manually trigger an update if you want to check the progress. You can do this by clicking the Apify column header and selecting sources. Given the large number of rows (24.5k), please note that the process may take several hours to complete. If you find that results are missing, you might want to try adding a scraping delay to ensure proper data collection.
Source: Scrape Website with Clay
Is that what you were looking for?
I will likely have to sign out of this slack channel and check intermittently. If it's easier, feel free to email me at colin@tenortherapy.com.
I understand you may need to sign out and check back later. No problem, I'll be here if you need any further assistance. Feel free to return to this chat whenever you're ready to check on your scraping progress or if you have any other questions. If you need immediate help while you're away, you can always request human assistance by clicking on "Talk to a person" in this chat interface.