25
$\begingroup$

When I Google for

"fisher" "fiducial"

...I sure get a lot of hits, but all the ones I've followed are utterly beyond my comprehension.

All these hits do seem to have one thing in common: they are all written for dyed-in-the-wool statisticians, people thoroughly steeped in the theory, practice, history, and lore of statistics. (Hence, none of these accounts bothers to explain or even illustrate what Fisher meant by "fiducial" without resorting to oceans of jargon and/or passing the buck to some classic or other of the mathematical statistics literature.)

Well, I don't belong to the select intended audience that could benefit for what I've found on the subject, and maybe this explains why every one of my attempts to understand what Fisher meant by "fiducial" has crashed against a wall of incomprehensible gibberish.

Does anyone know of an attempt to explain to someone who is not a professional statistician what Fisher meant by "fiducial"?

P.S. I realize that Fisher was a bit of a moving target when it came to pinning down what he meant by "fiducial", but I figure the term must have some "constant core" of meaning, otherwise it could not function (as it clearly does) as terminology that is generally understood within the field.

$\endgroup$
3
  • 10
    $\begingroup$ This isn't what you want, but my best one-sentence summary is that few deep thinkers on statistical inference have been sure that they knew what Fisher meant by "fiducial", and not a few have suspected that he was obscure largely to hide the extent to which he agreed on fundamentals with others who he had decided to dislike on principle. (By the way, I am a fan of Fisher, on the whole.) More importantly, I don't sense that it does function as generally understood terminology: it's a term widely avoided, except in historical discussions. (I am not a professional statistician, FWIW.) $\endgroup$
    – Nick Cox
    Jun 8, 2013 at 17:00
  • 2
    $\begingroup$ There was a question about the fiducial argument some ime ago stats.stackexchange.com/questions/27005/… $\endgroup$
    – gui11aume
    Jun 8, 2013 at 18:10
  • 2
    $\begingroup$ @gui11aume: thanks, I saw that thread before I posted, but I found the answers to it as incomprehensible as everything else I've found on the subject. $\endgroup$
    – kjo
    Jun 9, 2013 at 12:37

3 Answers 3

26
$\begingroup$

The fiducial argument is to interpret likelihood as a probability.
Edit: not exactly, see the answer of @Sextus for more details.

Even if likelihood measures the plausibility of an event, it does not satisfy the axioms of probability measures (in particular there is no guarantee that it sums to 1), which is one of the reasons this concept was never so successful.

Let's give an example. Imagine that you want to estimate a parameter, say the half-life $\lambda$ of a radioactive element. You take a couple of measurements, say $(x_1, \ldots, x_n)$ from which you try to infer the value of $\lambda$. In the view of the traditional or frequentist approach, $\lambda$ is not a random quantity. It is an unknown constant with likelihood function $\lambda^n \prod_{i=1}^n e^{-\lambda x_i} = \lambda^n e^{-\lambda(x_1+\ldots+x_n)}$.

In the view of the Bayesian approach, $\lambda$ is a random variable with a prior distribution; the measurements $(x_1, \ldots, x_n)$ are needed to deduce the posterior distribution. For instance, if my prior belief about the value of lambda is well represented by the density distribution $2.3 \cdot e^{-2.3\lambda}$, the joint distribution is the product of the two, i.e. $2.3 \cdot \lambda^n e^{-\lambda(2.3+x_1+\ldots+x_n) }$. The posterior is the distribution of $\lambda$ given the measurements, which is computed with Bayes formula. In this case, $\lambda$ has a Gamma distribution with parameters $n$ and $2.3+x_1+\ldots+x_n$.

In the view of fiducial inference, $\lambda$ is also a random variable but it does not have a prior distribution, just a fiducial distribution that depends only on $(x_1, \ldots, x_n)$. To follow up on the example above, the fiducial distribution is $\lambda^n e^{-\lambda(x_1+\ldots+x_n)}$. This is the same as the likelihood, except that it is now interpreted as a probability. With proper scaling, it is a Gamma distribution with parameters $n$ and $x_1+\ldots+x_n$.

Those differences have most noticeable effects in the context of confidence interval estimation. A 95% confidence interval in the classical sense is a construction that has 95% chance of containing the target value before any data is collected. However, for a fiducial statistician, a 95% confidence interval is a set that has 95% chance of containing the target value (which is a typical misinterpretation of the students of the frequentist approach).

$\endgroup$
5
  • 5
    $\begingroup$ +1 As far as I understand it, Fisher was trying to plant the Bayesian credible interval in his frequentist garden. (He famously despised the Bayesian approach and I believe even coined the term "Bayesian" as an expression of his contempt.) $\endgroup$
    – Wayne
    Apr 17, 2014 at 19:50
  • 1
    $\begingroup$ @Wayne yes indeed! See this article for instance projecteuclid.org/euclid.ba/1340370565. $\endgroup$
    – gui11aume
    May 23, 2017 at 10:58
  • 1
    $\begingroup$ "to interpret likelihood as a probability" this is, I believe, not entirely correct. The likelihood is based on the probability density function (PDF), but the fiducial argument is based on the cumulative distribution function (CDF). When you invert the role of parameters and statistics in the CDF then you might get a different end result compared to when you do this with the PDF (which would equal the likelihood function). However, in the case of scale and/or location parameters the result will be the same; so in most practical cases the fiducial distribution equals the likelihood. $\endgroup$ Oct 15, 2022 at 12:21
  • $\begingroup$ @SextusEmpiricus What an insightful comment! I followed the trail you left through your answers... what an absolutely amazing piece of work! It will still take me some time to go through it all. I linked your answer with an edit to give it more visibility. Let me know if you'd prefer a heavier edit on my side. $\endgroup$
    – gui11aume
    Oct 17, 2022 at 3:18
  • $\begingroup$ @gui11aume for me it is ok like this. A heavier edit might break down the storyline that you had before. In my opinion the difference is also only subtle. $\endgroup$ Oct 17, 2022 at 7:24
10
$\begingroup$

Several well-known statisticians try to rekindle an interest in Fisher's fiducial argument. Bradley Efron: (I cannot copy even small quotes from google books), the topic is also treated in Bradley Efron 2. He says something to the effect of (not a direct quote): Fiducial inference, sometimes considered Fisher's largest error, can be Fisher largest hit for the future. So there are people thinking that Fiducial ideas will come back.

A complete book devoted to the topic (by some of my former professors) is Schweder, T. & Hjort, N. L. (2016). Confidence, Likelihood, Probability: Statistical Inference with Confidence Distributions. Cambridge University Press.

They propose to change terminology from "fiducial distribution" to "confidence distribution". I even at some point tried to make a new tag here confidence-distribution. But somebody mistakenly made that a tag synonym for confidence-interval. Grrrr (If made a synonym, it should be to fiducial.)

$\endgroup$
2
  • 1
    $\begingroup$ +1. The Hastie & Efron book is here: web.stanford.edu/~hastie/CASI, here is PDF: web.stanford.edu/~hastie/CASI_files/PDF/casi.pdf. They write: "His [Fisher's] most ambitious attempt to “enjoy the Bayesian omelette without breaking the Bayesian eggs” was fiducial inference." Etc. I searched for "fiducial" in the whole book but did not find anything as positive as "can be his largest hit for the future". $\endgroup$
    – amoeba
    May 9, 2017 at 12:58
  • 2
    $\begingroup$ I just ran across your post, Kjetil, and have removed the synonym. If you're aware of a few threads that discuss confidence distributions, please consider applying your confidence-distribution tag to them and creating a Wiki for it--that might protect it from being clobbered again. $\endgroup$
    – whuber
    Nov 2, 2017 at 22:07
4
$\begingroup$

In the answer from gui11aume it is stated that

The fiducial argument is to interpret likelihood as a probability.

However, there is a subtle difference between the fiducial distribution and the likelihood function. If $F(\hat\theta; \theta)$ is the cumulative distribution function of some parameter estimate $\hat\theta$ given the true parameter $\theta$ then the fiducial/confidence distribution is $\frac{d}{d\theta}F(\hat\theta,\theta)$ whereas the likelihood function is $\frac{d}{d\hat\theta}F(\hat\theta,\theta)$.*

The fiducial argument is to inverse the interpretation of the probability statement described by the cumulative distribution function. An example is described in this question The basic logic of constructing a confidence interval

The way of constructing the confidence interval in that question, by using the cumulative distribution function, is equivalent to constructing a fiducial distribution.

So this specific** type of confidence interval and related confidence distribution is what is meant by the fiducial distribution and fiducial probability. And, it is much more around then we think; it is only not named fiducial interval and overtaken by the more general confidence interval. Another reason why 'fiducial' is less popular is because of the difference in the philosophical interpretation and attempts to have a more Bayesian interpretation than frequentist interpretation. The fiducial intervals were supposed to contain the parameter 95% of the time but they only do so from a specific point of view: Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


* For some types of cases like a rate parameter or a location parameter, the fiducial distribution coincides with the likelihood distribution because in those cases $\frac{d}{d\theta}F(\hat\theta,\theta) \propto \frac{d}{d\hat\theta}F(\hat\theta,\theta)$. But the fiducial distribution does not transform in the same way when we re-express the parameters (it scales more like a probability distribution function). For instance, the fiducial distribution for estimating $\sigma$ in a normal distribution is not the same as the likelihood function.

** Note 'specific'. The fiducial distribution is a confidence distribution, but not every confidence distribution is a fiducial distribution.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.