What’s a decent sample size for testing outbound emails? Somebody recommended multiple thousand for each style/format. I feel it’s a bit too much. Currently I am doing 100 for each style. Maybe this is too low.
While there's no one-size-fits-all answer, 100 emails per style might be on the lower side for robust testing. A larger sample size can provide more reliable results, but it doesn't necessarily need to be in the thousands. Consider increasing your sample size to a few hundred per style for more statistically significant results. This can help you better understand open rates, click-through rates, and overall engagement. Remember, the key is to balance statistical reliability with practical constraints like time and resources. If you're using our "write to table" feature, you can easily manage and analyze larger datasets for your email testing.
Did that answer your question?
It depends on many factors - Mainly the average customer value and the TAM. if the TAM is more than 20K and ACV is $3-4K I would say 500-800 is a good sample size.
Thanks for sharing your perspective! Let me know if there's anything else you'd like to discuss.