I have seen some classes in my University labeled as an "Inference class" and others as "Machine learning" classes, but I was not sure if appreciated the core difference between these two labelings?

I normally think of machine learning as the study of systems/algorithms that are able tp extract information from data. It uses techiniques from a broad list subjects, like statistics, computer science, optimization, etc. However, I was not sure how statistical inference differed from Machine Learning.

Thanks for the help in advance! :)

  • 3
    $\begingroup$ I think the second answer to this question stats.stackexchange.com/questions/6/… also answers your question. $\endgroup$ – david25272 Feb 3 '14 at 4:25
  • $\begingroup$ Thats interesting, the difference seems a little subtle, because machine learning seems a bit more focused on having a good prediction function, while inference focuses more on how to learn the process of data generation. But if you can generate, you should be able to predict well!! Or at least that claim seems to make sense at a first glance. i.e. one cares on getting good predictions while the other cares more on getting good understanding of how predictions (i.e. the process) are made. That's my understanding so far. $\endgroup$ – Charlie Parker Feb 3 '14 at 4:46
  • 2
    $\begingroup$ @Pinocchio That's probably not a bad assessment of the difference (stats doesn't avoid black boxes, but much of it tends to look for non-black-box approaches; ML jumps right into the black box -- neither is doing it right or wrong, they're emphasizing different problems). Of course, this is oversimplifying hugely - statistical inference isn't only concerned with prediction for example, but with a variety of other tasks (point and interval estimation, hypothesis testing, ...) $\endgroup$ – Glen_b Feb 3 '14 at 5:41
  • $\begingroup$ My question has to do specifically with inference, not with statistics in the more general sense. I am not sure if it just reduces to the question that was posted at the top, but I feel that the question does not address explicitly what I was looking for because I read that before posting this question. Maybe it's just my own ignorance on the topic, but I still want to know the difference of what the word inference means and how exactly its different from machine learning. $\endgroup$ – Charlie Parker Feb 3 '14 at 17:11
  • $\begingroup$ I think this question is actually more related than the post marked as "duplicate": stats.stackexchange.com/questions/130867/… $\endgroup$ – Charlie Parker May 27 '17 at 4:12