I have been spending the last two days trying to construct a solid answer to the question:

What is the distribution that best describes my sample?

I did the following:

  1. Plot the histogram (nomalized as pdf) to have a first idea of the shape of the distribution
  2. Fit a theoretical distribution with paramenters estimated from the sample
  3. Fit an empirical density (say Kernel
  4. QQplot of the theorethical quantiles vs empirical quantiles

Ok this is good, but no real answer to my question. I want to test if the sample came from the theoretical distribution. My journey continues and I have some well known tests that I can choose:

  1. Kolmogorov-Smirnov
  2. Lilliefors
  3. Anderson-Darling

To put it simply I read that if I don't know the true value of the paramenters and I want to estimate them from the sample, the p-values are just wrong.

I am a MATLAB user and I see that there is a function namely

adt = adftest(mysample, 'Distribution', 'whatever')

that allows my to perform Anderson-Darling test even without specifying the value of the paramenters, as they are estimated from the sample and the pvalues are estimated using Montecarlo Simulation.

That's perfect BUT in MATLAB this can be done only with some probability distributions, not all of them.

If you know the parameters though, MATLAB allows you to perform the adtest for any distribution.

My questions are (in order of importance):

  1. Can I extent the current Anderson-Darling test to any distribution and unknown paramenters?
  2. Could anyone explain a general procedure that can be used in this case or even point me out to some academic papers or books where I can read more about this?
  3. How would you answer to the question: What is the distribution that best describes my sample?

Thank you very much for your help. Regards

  • $\begingroup$ This is sort of a cop-out answer, but why do you need to know the distribution? If it's to test a hypothesis, then it might not be necessary. In most cases wherein I don't know the distribution, I use bootstrapping. $\endgroup$ – Gabriel J. Odom Dec 21 '17 at 19:46
  • $\begingroup$ From what I understand, AD has only been used for certain distributions, such as Normal and Exponential. TMK it hasn't been extended to test ANY/ALL distributions. Sorry. $\endgroup$ – Macromika Sep 18 '18 at 18:58

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.