Can anyone point me in the direction of a formal proof of convergence for a (on/off policy) Monte Carlo control algorithm with (non-)linear function approximation?

Also papers I have been able to find either consider the prediction case or TD-learning. Am I missing something or is it somehow a trivial extension of the prediction case? Are the sources I mentioned contradicting and if so, why?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.