Skip to main content
Cross Validated

Return to Question

Tweeted twitter.com/StackStats/status/1553485603865600001
updated dead link
Source Link
Taylor
Taylor
  • 21.6k
  • 2
  • 50
  • 89

I see the following equation in "In Reinforcement Learning. An IntroductionIn Reinforcement Learning. An Introduction", but don't quite follow the step I have highlighted in blue below. How exactly is this step derived?

enter image description here

I see the following equation in "In Reinforcement Learning. An Introduction", but don't quite follow the step I have highlighted in blue below. How exactly is this step derived?

enter image description here

I see the following equation in "In Reinforcement Learning. An Introduction", but don't quite follow the step I have highlighted in blue below. How exactly is this step derived?

enter image description here

Source Link
Amelio Vazquez-Reina
Amelio Vazquez-Reina
  • 19.7k
  • 27
  • 81
  • 120

Deriving Bellman's Equation in Reinforcement Learning

I see the following equation in "In Reinforcement Learning. An Introduction", but don't quite follow the step I have highlighted in blue below. How exactly is this step derived?

enter image description here