1
$\begingroup$

If I have a continuous distribution, $N$.

I say $f$ is a sample from $N$, $f \sim N$.

Now I want to determine the probability of $f$ having a value of $x$:

$$ P(x)=\lim_{t\rightarrow0} {\frac{\text{Percent Chance of: } x \le f \le x+t}{t}} $$

Is my understanding of probability correct? If so, is there a syntactically correct way to write the statement above?

$\endgroup$
7
  • 2
    $\begingroup$ Are you familiar with probability densities ? $\endgroup$
    – Tim
    Aug 17, 2017 at 12:07
  • $\begingroup$ @tim that was the page I was reading that made me ask this. In there bacteria example they look at the probability of it dying within a very small time interval. It seemed like it could be written as a limit as to goes to zero. But I'm not sure if my logic and syntax is valid. $\endgroup$
    – Nathan
    Aug 17, 2017 at 12:26
  • $\begingroup$ @tim are probability densities different to continuous probability distributions? $\endgroup$
    – Nathan
    Aug 17, 2017 at 12:29
  • $\begingroup$ Discrete probability is easy: the probability to roll four with a six-sided die is simply 1/6 because there are only six possible outcomes. A continuous pdf has an infinite number of possible of outcomes so the probability of any single outcome (not an interval) is 1/infinity = 0. That is the difference. You have to integrate to get the probability of a certain interval. $\endgroup$
    – Louic
    Aug 17, 2017 at 12:47
  • $\begingroup$ @louic Although many of your statements are correct, they do not logically follow one another as you seem to suggest. For instance, the discrete Poisson distribution has an infinite number of possible outcomes, yet all of them have nonzero probability. Therein lies the danger of relying on intuitive (but meaningless) expressions like "1/infinity". $\endgroup$
    – whuber
    Aug 17, 2017 at 14:16

1 Answer 1

6
$\begingroup$

Yes, you are correct, but your notation isn't very clear. You are talking about probability densities. With continuous* random variables there is no point in talking about probabilities, since $\Pr(X=x)=0$ for any $x$. Because of this we use probability densities, i.e. probabilities per foot,

$$ f_X(x) = \lim_{\Delta x \to 0} \frac{ \Pr( x < X \le x + \Delta x ) }{ \Delta x } $$

so when $dx$ is an infinitely small number,

$$ \Pr( x < X \le x + dx ) = f_X(x)\, dx $$

You can also check the Intuition for how the cumulative probability distribution can be derived from probability density function? thread.

* - as noticed by @whuber in the comment, the definition using limits is valid only for absolutely continuous variables.

$\endgroup$
6
  • 1
    $\begingroup$ Because this issue was recently raised, here's a bit of a nit-pick: you are assuming absolute continuity. That assumption is tantamount to supposing the limit exists and is finite almost everywhere. For continuous but not absolutely continuous distributions, the limit does not exist (or diverges). $\endgroup$
    – whuber
    Aug 17, 2017 at 13:37
  • $\begingroup$ Thank you for the edit. Continuous but not absolutely continuous distributions do not have density functions, however. Therein lies the distinction. $\endgroup$
    – whuber
    Aug 17, 2017 at 14:10
  • $\begingroup$ @whuber it seems that the thread you linked begs for an answer :) $\endgroup$
    – Tim
    Aug 17, 2017 at 14:15
  • $\begingroup$ OK, I posted one. It's hard to do the subject justice in just a screen or two, so constructive comments are (as always) welcome. $\endgroup$
    – whuber
    Aug 17, 2017 at 15:10
  • $\begingroup$ @Tim Thanks Tim. This is the second question of mine you have answered. You have been a great help in my ongoing journey to try learn stats. $\endgroup$
    – Nathan
    Aug 17, 2017 at 19:32

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.