Questions tagged [stochastic-policy]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
33 views

Experiment Design with Known, Targeted Probability of Receiving Treatment

Is there a name in the literature for the following experimental design? Suppose we have $i=1,...,n$ individuals in our sample. Denote their baseline covariates, binary treatment assignment indicator, ...
gbrlrz017's user avatar
  • 185
0 votes
1 answer
228 views

Are the two $\epsilon$-greedy policies different?

I found 2 diffefent versions of $\epsilon$Greedy policy for monte carlo and q learning: For monte carlo: $\pi (a|s)=\epsilon /m +1-\epsilon$ to choose the best action and $\pi =\epsilon /m$ for other ...
abcd's user avatar
  • 1
2 votes
1 answer
838 views

Policy improvement in SARSA and Q learning

I have a rather trivial doubt in SARSA and Q learning. Looking at the pseudocode of the two algorithms in Sutton&Barto book, I see the policy improvement step is missing. How will I get the ...
Jor_El's user avatar
  • 393
1 vote
1 answer
202 views

How do measure how different two policies are?

I have two agents that both follow a baseline behavioral policy pi(a|s). If I then modify the state-action distribution for the two agents (resulting in two new policies), is there a standard measure ...
Dirk's user avatar
  • 111
1 vote
0 answers
59 views

ε-Greedy with Q learning / SARSA can have stochastic policy?

Hello I'm now studying Q learning and SARSA with ε-Greedy , Softmax startegies. And have a question about my readings. In my readings, when SARSA with ε-Greedy, SARSA causes value-function ...
BE LEO's user avatar
  • 11
1 vote
1 answer
414 views

Discrete and continuous actions in the same environment

I am working on a RL environment that requires both discrete and continuous actions as input from the agent. I currently have a fine implementation of DDPG which I would like to use for the continuous ...
franyx's user avatar
  • 11
1 vote
0 answers
201 views

Why the Monte Carlo Control algorithm is written this way?

I am having trouble to understand this algorithm, since this is not how I would have written it. To me, we should first start to fix a policy. Then, we evaluate the Q values associated with this ...
Hugo Laurençon's user avatar
4 votes
1 answer
1k views

Proof that any $\epsilon$-greedy policy is an improvement over any $\epsilon$-soft policy

In the book by Richard Sutton and Andrew Barto, "Reinforcement Learning - An Introduction", 2ed edition, at page 101 there is a proof, and I don't understand 1 passage of it. We want to ...
robertspierre's user avatar
9 votes
2 answers
10k views

Is a policy always deterministic in reinforcement learning?

In reinforcement learning, is a policy always deterministic, or is it a probability distribution over actions (from which we sample)? If the policy is deterministic, why is not the value function, ...
figs_and_nuts's user avatar