Thanks for the answer. In fact 1, your proof is for a conditional expected value giving a particular value $Y=y$, but in PG formula the it's conditioned on RV $Y$. I am too struggling with this derivation on the book. RL course on YT based on the book usually skip this derivation which is kind of sad...