AB Test Calculator
Calculate and analyze the results of your A/B tests.
A/B Test Calculator
Calculate statistical significance for your A/B tests.
Test Data
Control (A)
Conversion Rate: 5.00%
Variant (B)
Conversion Rate: 6.50%
Results
Statistical Significance:
Not Significant
+30.0%
Lift
0.1496
P-value
Z-score:1.441
Confidence Level:95%
Statistical Power:30.2%
Statistical power is 30.2%. Consider increasing sample size for more reliable results (80%+ recommended).
Sample Size Recommendation
3,782
per variant for future tests
Minimum Detectable Effect
2.9%
with 80% power
Total Sample Size
2,000
visitors in test
A/B Testing Guidelines
Statistical Significance
- • P-value < 0.05 = statistically significant
- • 95% confidence level is industry standard
- • Don't stop tests early based on significance alone
- • Consider practical significance vs statistical significance
Best Practices
- • Run tests for full business cycles
- • Ensure adequate sample size (80%+ power)
- • Test one variable at a time
- • Document test hypothesis before starting