I am running an A/B test for our site. And get below stats:
Group A: Visitors: 155,590; Conversion: 18,529
Group B: Visitors: 155,592; Conversion: 18,118
And I am using the tool on this website to determine if the test result is significant or not. https://abtestguide.com/calc/
The P-value is 0.9889 which is way higher than 0.05, but the tool still says it's significant. I am very confused. I thought only if the p-value is smaller than 0.05, I can say it's significant (assuming 95% confidence).