4
$\begingroup$

The Short question: Where can I find a book for the theory of probability and statistics that teaches from scratch in a rigorous (very important condition) way? The book must not be elementary, but it has to start from scratch. (For example, I think the Lang/Hungerford algebra texts begin by defining what a group is: in that sense they start from scratch.)

The long question: I only took an engineering course in probability and statistics. In my opinion, it is very lousy/non-rigorous. You may assume I have no knowledge of probability and statistics. I have to take an independent study statistics course this year. I am allowed to choose a book for the course. It has to be a statistics course. My instructor assumes I know probability because I took the course mentioned above. (I admit I have a poor understanding of probability and this irritates me a lot.) I'd like to have a book that:

1) Is mathematically oriented and rigorous

2) Has a significant statistics part

3) Teaches the amount of probability needed to do statistics.

|cite|improve this question
$\endgroup$
  • $\begingroup$ you have to explain what you know? are you a math major? some example book you like [ any book on mathmatical statistics??] $\endgroup$ – seanv507 Aug 28 '13 at 21:48
  • $\begingroup$ @sean507 I will self-study it as a mth major. Thus you may assume I am a math major. I already made this clear this in the question, by saying that I want a rigorous book and by making examples of Lang's and Hungerford's abstract algebra books. $\endgroup$ – Amr Aug 28 '13 at 21:59
  • $\begingroup$ @whuber I also think that my question should be closed as a duplicate. The other question is not the same as mine, hence the answers are not useful. $\endgroup$ – Amr Aug 28 '13 at 22:00
  • 2
    $\begingroup$ How, precisely, do the answers to the apparent duplicate not respond to your inquiry? $\endgroup$ – whuber♦ Aug 29 '13 at 2:31
  • 2
    $\begingroup$ A book that goes "axioms-->theorems-->proofs,axioms-->theorems-->proofs,axioms-->theorems-->proofs‌​,axioms-->theorems-->proofs" might potentially lead to some understanding of probability (though, frankly, I've seen such approaches fail at imparting understanding), but will not really prepare you to understand statistics. In fact in my experience such a background on its own seems to prompt many mathematically able people to think they understand statistics, without necessarily doing so. $\endgroup$ – Glen_b Aug 30 '13 at 1:23
7
$\begingroup$

As discussed on Meta, I think it's a rather unusual person who could follow a mathematically rigorous treatment of Probability & Statistics without having previously studied them in a shallower, more heuristic fashion. If you're that person ...

For rigour the pair

  • Lehmann & Romano, Testing Statistical Hypotheses
  • Lehmann & Casella, Theory of Point Estimation

would be hard to beat, but would still leave you needing a book on Probability—so three books, not one.

  • Cox & Hinkley, Theoretical Statistics

is one I'd like to recommend, for clarity of exposition & for their take on foundational issues, but it tends to assume a fair amount of familiarity with the basics, has nothing on Probability; & though it's thorough, I couldn't put my hand on my heart & say "rigorous".

On the whole I'd probably go with

  • Casella and Berger, Statistical Inference

; its opening chapters cover enough Probability & the later ones on inference are still pretty rigorous. Rather scanty on Bayesian analysis though.

|cite|improve this answer
$\endgroup$
  • $\begingroup$ Thanks. It looks it is a great amount of material to include in ony one course. Since my university will not allow me (in some sense) to learn probability theory. I will self-study probability theory and then take a course based on one of the stat books you suggested. $\endgroup$ – Amr Aug 31 '13 at 13:24
2
$\begingroup$

The problem is that "rigorous" for probability nowadays means "rigorous measure theory" - and measure theory is a rather tough shell. For the econometrics field at least, I still found the books by Aris Spanos, the most useful in terms of containing the essence of the rigorous axiomatic approach to probability, together with the fundamental asymptotics and then from them deriving formally various statistical procedures of estimation and inference. He continuously stresses the probabilistic nature of the statistical models, and that they have to be consistent with their probabilistic foundations (and he does trace the connections). But again, his books have econometrics in mind - for the "statistics" part of your answer it is important to consider what statistical tools are used in your discipline - and then search for a book that contains these and a good treatment of probability itself... I am not sure you will find it in one book though.

|cite|improve this answer
$\endgroup$
2
$\begingroup$

The book we used in my Statistical Theory classes was Probability and Statistical Inference, by Nitis Mukhopadhyay. It definitely starts at the beginning with "Notions of Probability" and the classic coin toss, but then quickly moves into statistics and statistical distributions and moments and such. It definitely seems mathematically-oriented to me, I pretty much never crack it when working on applied statistics projects.

|cite|improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.