I was just wondering why regression problems are called "regression" problems. What is the story behind the name?
One definition for regression: "Relapse to a less perfect or developed state."
The term "regression" was used by Francis Galton in his 1886 paper "Regression towards mediocrity in hereditary stature". To my knowledge he only used the term in the context of regression toward the mean. The term was then adopted by others to get more or less the meaning it has today as a general statistical method.