4
$\begingroup$

As far as I understand (strict) Frequentists treat hypothesis (model parameters) as fixed and don't allow to assign probabilities to a range of model parameters. That is the reason why they compute confidence intervals through variation in data, not variation in model parameters.

Maximum-likelihood estimation is considered to be frequentist approach. But if you search for best fit parameter value that maximizes likelihood function then you are automatically assigning probabilities to other parameter values (they are not improbable anymore, just less likely than best fit).

In other words, you cannot take a derivative of likelihood function $\dfrac{dP(E|H)}{dH} = 0$ because H is fixed in P(E|H) if you are frequentist. So MLE is really just MAP $\dfrac{dP(H|E)}{dH} = 0$ with implicit flat priors.

To sum up, in MLE one has to treat model parameters as a variable with different likelihoods given experimental data. Then doesn't it become Bayesian (with implicit flat prior) and stops being frequentist?

$\endgroup$
2
  • 3
    $\begingroup$ " But if you search for best fit parameter value that maximizes likelihood function then you are automatically assigning probabilities to other parameter values" is not true. I am trying to find numerical values for the parameters that maximize the likelihood function. There are no probabilities for the parameters involved. The MLE is the parameter values(s) that maximize the probability of seeing the data we actually saw; the statement is about the probability of observing the data given the parameter values, not the other way around. $\endgroup$
    – jbowman
    May 21, 2018 at 4:13
  • $\begingroup$ @jbowman why not write that as an answer? $\endgroup$ May 22, 2018 at 6:02

1 Answer 1

4
$\begingroup$

Copied and extended from comments -

"But if you search for best fit parameter value that maximizes likelihood function then you are automatically assigning probabilities to other parameter values" is not true. We are trying to find numerical values for the parameters that maximize the likelihood function. There are no probabilities for the parameters involved. The MLE is the parameter values(s) that maximize the probability of seeing the data we actually saw; the statement is about the probability of observing the data given the parameter values, not the other way around.

Since the function we are trying to optimize has the data as fixed values and varies the parameters, it's no longer a probability function, for which the parameters are fixed and the (unobserved) data varies. Hence the name "likelihood".

$\endgroup$
2
  • $\begingroup$ Why is MLE treated a frequentists' technique? I don't know if my question generates another question other than the original question. I just wonder why MLE is treated as a frequentist technique. $\endgroup$
    – oceanus
    Nov 2, 2020 at 22:45
  • $\begingroup$ @ChangheeKang - that definitely is another question! But, fortunately, we have stats.stackexchange.com/questions/180420/… as at least a partial answer. $\endgroup$
    – jbowman
    Nov 3, 2020 at 3:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.