Skip to main content
2 of 2
added 208 characters in body; edited title
Alexis
  • 30.7k
  • 8
  • 101
  • 176

Purpose of scaling mean by $\sqrt{1 - \beta_t}$ in forward diffusion process

In the forward diffusion process described by Ho, et al. the probability distribution for the next step is:

$$q(\mathbf{x}_t|\mathbf{x}_{t-1}) = N(\mathbf{x}_t;\sqrt{1-\beta_t}\mathbf{x}_{t-1},\beta_t\mathbf{I})$$

What is the purpose of scaling the mean of the distribution by $\sqrt{1 - \beta_t}$? I think this has something to do with maintaining the same variance across steps, but don't understand why keeping variance fixed would be helpful.

Ho, J., Jain, A., Abbeel, P. (2020). Denoising Diffusion Probabilistic Models. Proceedings of the 34th Conference on Neural Information Processing Systems. NeurIPS 2020, Vancouver, CA.