4
$\begingroup$

What are best and / or standard practices for MCMC early stopping?

I have an algorithm which I want to compare with existing non-MCMC algorithms for accuracy and speed. When assessing the speed it's a bit tricky, since the speed is a function of the number of iterations I use in the Markov chain, and currently highly subjective.

I'd like some kind of more objective way of deciding when to cut the chain; ideally some sort of 'best practice' that's applicable for reasonably well behaved Markov chains.

Note that this is not some crazy algorithm that's going to jump between different apparently stable distributions every 2 weeks. It just goes up and down a bit, and then is stationary.

|cite|improve this question
$\endgroup$
  • $\begingroup$ What about comparing accuracy for the same computing time? $\endgroup$ – ThePawn Feb 1 '13 at 6:30
  • $\begingroup$ Well, the good point of the algorithm I'm testing is that it looks like it trains faster, for the same accuracy. However, the opposite, giving higher accuracy, for the same training time, is not the case. $\endgroup$ – Hugh Perkins Feb 1 '13 at 8:51
  • 2
    $\begingroup$ Have you heard of effective sample size? This is and indicator that tells you how many iid simulations are equivalent to your n simulations from an MCMC algorithm. $\endgroup$ – Xi'an Feb 2 '13 at 13:47
  • $\begingroup$ Expanding on Xi'an's comment, look at terminating according to effective sample size here $\endgroup$ – Greenparker Sep 6 '16 at 19:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.