I am evaluating a Bayes AB Test on 2 variants, A and B.
I then plotted a graph which shows the Probability of B is better than A on a daily basis. My worry comes in on the topic of 'peeking'. Let's say I wanted to find 90% Probability of B is better than A to end the AB Test, I would have ended the test on day 11 as per graph. As you can see, the trend still fluctuates though and also trickles into the opposite direction (lower than 90%) until about day 25 where it seems to start converging.
My question: What are the best practices to ensure that the distribution is indeed converging so I do not end too quickly in the lens of Bayes Inference?