14
$\begingroup$

Why are they called "machines"? Is there an origin to the word "machine" used in this context? (Like the name "linear programming" can be confusing but we know why it is called "programming.")

$\endgroup$
  • $\begingroup$ I once was told that "machine" means "algorithm", but I didn't ask about the origin. $\endgroup$ – dontloo Feb 10 '17 at 9:25
  • $\begingroup$ @dontloo Could be, as in "Turing machine." Hopefully someone can provide information on the historical contexts. $\endgroup$ – Lei Huang Feb 10 '17 at 16:44
7
$\begingroup$

Possibly because some of the earliest machine learning algorithms were implemented as actual physical machines. From Wikipedia:

The perceptron was intended to be a machine, rather than a program, and while its first implementation was in software for the IBM 704, it was subsequently implemented in custom-built hardware as the "Mark 1 perceptron".

enter image description here

(Picture from Cornell Library via Wikipedia)

ADALINE (Adaptive Lineardi Neuron or later Adaptive Linear Element) is an early single-layer artificial neural network and the name of the physical device that implemented this network.

A source for more information about these machines is the book Talking Nets.

$\endgroup$
  • $\begingroup$ While the hypothesis raised in this answer is sound, it could benefit from sources. Indeed, as my answer points out, Arthur Samuel coined the term, and he worked at IBM at the time, and his paper was published at an IBM journal. $\endgroup$ – Firebug Oct 21 '17 at 20:32
10
$\begingroup$

I think this article sums it up.

Basically, machine comes from machine learning, a term that was coined in 1959 by Arthur Samuel, way before the final developments that led to the soft marging kernel SVM in the 90's and the Boltzmann Machines in the 80's. Vapnik and Lerner called their algorithm the Generalized Portrait algorithm back in 1963, see more here.

A machine in this context would be the output function, or as the article puts for historical reasons, the hypothesis, built from the learned parameters.

$\endgroup$
1
$\begingroup$

Meriam-Webster defines the word as "a literary device or contrivance introduced for dramatic effect." It certainly does the job of increasing the dramatic effect. "Support vector algorithm/approach/equation/function/..." just doesn't sound as good as "support vector MACHINE!"

I would also suggest "kernel density machine" and "maximum likelihood machine." Actually, I'm going to call all my algorithms "machines" from now on.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.