When analyzing your Thumbnail Test results, you can now better understand your data by enabling the Statistical Significance feature.
Statistical Significance tells you if your test results are likely real or just a fluke. It's a way to be more confident that the differences you see between thumbnails are meaningful and not just random chance.
Steps to Enable Statistical Significance:
Open the test page.
Click on Edit Display Data.
Find the "Statistical Significance" option.
Enable or toggle on this feature.
Why Use Statistical Significance?
More Comprehensive Analysis: Takes into account multiple performance factors.
Reduced False Positives: Helps minimize the chance of interpreting random fluctuations as significant results.
Informed Decision Making: Provides a better way to decide if a test option is clearly better than the others
Note:
Statistical Significance might show different results than you're used to seeing with simpler metrics like AVD*CTR. This is normal. It's just looking at your test results in a more careful way.
Using this feature helps you understand how well your test options are really doing. This can help you make better choices about your content.