The idea behind PMFs is simple - how likely is a given discrete event to happen? For example, it is intuitive to see why the PMF of a binomial distribution is $ Pr(X=k)= \left( { \begin{array}{} n \\ k \\ \end{array}} \right ) p^k(1-p)^{n-k}$. This way of writing it arises very naturally when you do $n$ independent Bernoulli trials and want to know the probability of $k$ successes.
- But how are the standard PDFs developed?
- $\sqrt{2\pi}$ in the normal distribution formula comes as part of normalizing the integral of the exponential function. But, how can we choose these functions?
- Can every function with bounded integrals from $-\inf$ to $+\inf$ be used as a PDF after being scaled appropriately?