Im trying to understand how to accurately report results on AB tests
If my type 1 error is 5% and type 2 is 20% , can we have instances where the p-value is < 0.05 and power is < 0.8?
If so, how ? What does it mean ?
Is something statistical significant when p-value is under 0.05 or power over 80% (assuming alpha and beta are defined to be 5% and 20%)?
EDIT: Im performing my power analysis during an experiment. Im trying to give updates on how a change in a button colour is performing. And in that update I want to specify the power it has.