In the q learning assignment, I am asked to get the total collected rewards in one episode,
For example, $Q(s,t) = Q(s,t) + a(R + rQ(s',t') - Q(s,t))$.
Which one is it in the following choice?
the sum of all the $Q(s,a)$ values
or all the updated part - sum ( $a(R + rQ(s',t') - Q(s,t))$ )?
or all the updated part in the policy - all the walking steps from the beginning to the end ?