Methods of modifying objective functions to control the solutions of optimization problems.

Penalization is a way of modifying a criterion function, like a likelihood or a sum of squares, so as to take into account other criteria than pure fit criteria in estimation. Examples can be penalized least squares or smoothing splines. Regularization methods like lasso or ridge regression also uses penalization.

Wikipedia has an article with further references. Some books dedicated to the topic are and

history | excerpt history