Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 279480

A conditional expectation is the expectation of a random variable, given information on another variable or variables (mostly, by specifying their value).

1 vote

Derivation of expected value in REINFORCE policy gradient

I came across this very interesting website with lots of properties for conditional expected values: https://randomservices.org/random/expect/Conditional.html One of the formulas is this: $$r(X)\mathb …
João Pedro's user avatar
1 vote
1 answer
238 views

Derivation of expected value in REINFORCE policy gradient

This is a derivation in the book "Reinforcement Learning, an Introduction, 2ed" for the REINFORCE algorithm. By definition $q_\pi(s,a)=\mathbb{E}[G_t|S_t=s,A_t=a]$. I don't understand how the inner e …
João Pedro's user avatar