Skip to main content
added 170 characters in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

"True distribution" is the distribution of your data, it doesn't have analytical form. Moreover, you write it as some kind of distribution that considers function of $X$, while this doesn't have to be the case. For example, you could use ice-cream sales to predict sunny weather, this doesn't mean that there's a causal relationship that makes the weather sunny when we sell more ice cream. The trud distribution in here, is the actual distribution of those two events, their dependence structure and interdependences with all the other, possibly unobserved, factors that take part in this process. Another example, the "true distribution" of the weather is an extremely complicated, chaotic, process that cannot be observed directly. We don't know and can't define the "true" function that produces weather. There's no analytic form for that. The true distribution is an abstract concept.

As about your notation, you seem to be stating the tautology “$y$ is $y$ when it’s $y$”. For those to describe the distribution, you’d need to know the “true” $p(y|x)$.

"True distribution" is the distribution of your data, it doesn't have analytical form. Moreover, you write it as some kind of distribution that considers function of $X$, while this doesn't have to be the case. For example, you could use ice-cream sales to predict sunny weather, this doesn't mean that there's a causal relationship that makes the weather sunny when we sell more ice cream. The trud distribution in here, is the actual distribution of those two events, their dependence structure and interdependences with all the other, possibly unobserved, factors that take part in this process. Another example, the "true distribution" of the weather is an extremely complicated, chaotic, process that cannot be observed directly. We don't know and can't define the "true" function that produces weather. There's no analytic form for that. The true distribution is an abstract concept.

"True distribution" is the distribution of your data, it doesn't have analytical form. Moreover, you write it as some kind of distribution that considers function of $X$, while this doesn't have to be the case. For example, you could use ice-cream sales to predict sunny weather, this doesn't mean that there's a causal relationship that makes the weather sunny when we sell more ice cream. The trud distribution in here, is the actual distribution of those two events, their dependence structure and interdependences with all the other, possibly unobserved, factors that take part in this process. Another example, the "true distribution" of the weather is an extremely complicated, chaotic, process that cannot be observed directly. We don't know and can't define the "true" function that produces weather. There's no analytic form for that. The true distribution is an abstract concept.

As about your notation, you seem to be stating the tautology “$y$ is $y$ when it’s $y$”. For those to describe the distribution, you’d need to know the “true” $p(y|x)$.

Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

"True distribution" is the distribution of your data, it doesn't have analytical form. Moreover, you write it as some kind of distribution that considers function of $X$, while this doesn't have to be the case. For example, you could use ice-cream sales to predict sunny weather, this doesn't mean that there's a causal relationship that makes the weather sunny when we sell more ice cream. The trud distribution in here, is the actual distribution of those two events, their dependence structure and interdependences with all the other, possibly unobserved, factors that take part in this process. Another example, the "true distribution" of the weather is an extremely complicated, chaotic, process that cannot be observed directly. We don't know and can't define the "true" function that produces weather. There's no analytic form for that. The true distribution is an abstract concept.