Rules:
- one classifier per answer
- vote up if you agree
- downvote/remove duplicates.
- put your application in the comment
Regularized discriminant for supervised problems with noisy data
Link to original 1989 paper by Friedman et al here. Also, there very good explanation by Kuncheva in her book "Combining pattern classifiers".
Gradient Boosted Trees.
Gaussian Process classifier - it gives probabilistic predictions (which is useful when your operational relative class frequencies differ from those in your training set, or equivalenty your false-positive/false-negative costs are unknown or variable). It also provides an inidcation of the uncertainty in model predictions due to the uncertainty in "estimating the model" from a finite dataset. The co-variance function is equivalent to the kernel function in an SVM, so it can also operate directly on non-vectorial data (e.g. strings or graphs etc). The mathematical framework is also neat (but don't use the Laplace approximation). Automated model selection via maximising marginal likelihood.
Essentially combines good features of logistic regression and SVM.
L1-regularized logistic regression.