2
$\begingroup$

The aim of reinforcement learning (RL) is to make an agent learn the policy: when it is in a particular state, it must know what action to choose. At the same time, an alternative statement would be to say that in RL, the aim of the agent is to maximize cumulative rewards.

I know that policy and cumulative reward are two distinct things. But how are they related in this context?

Also, in a discrete RL, we usually construct a Q table of actions and states for an agent. As the number of iterations increase, the values of the table update themselves. For example, if the in a certain state $s_1$, there are three possible actions $a_1, a_2, a_3$. Let's say that somehow the Q value under $(s_1,a_2)$ is the largest among the three values, then it means that the agent will likely take action $a_2$.

How are policy, Q values, cumulative rewards related to each other?

$\endgroup$

1 Answer 1

1
$\begingroup$

The aim of reinforcement learning (RL) is to make an agent learn the policy: when it is in a particle state, it must know what action to choose. At the same time, an alternative statement would be to say that in RL, the aim of the agent is to maximize cumulative rewards.

These are two parts of one statement: an RL agent learns the policy that maximizes (discounted) cumulative reward. A Q value table is a representation of a policy that lends itself to TD learning.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.