# Questions tagged [hinge-loss]

The tag has no usage guidance.

11 questions
Filter by
Sorted by
Tagged with
34 views

### About the hinge loss and slack variables

I'll be denoting the $ith$ training example, target label and slack variable as $\mathbf{\vec x}^{(i)}$, $y^{(i)}$ and $\xi_i$ respectively. Hinge Loss : The hinge loss function in the context of ...
42 views

• 265
1 vote
43 views

### What is Classification Calibration Theorem?

I have heard from one of my friends "In binary classification, consider the 0-1 loss (I[y!=f(x)]). Its expectation is the accuracy of the model. Then consider a surrogate risk, like exponential ...
• 111
268 views

### Why is hinge loss suitable for small training data sets?

In this blog post it says "Hinge loss is one such example which makes training with small dataset possible." Why does that hold true? So far, I could not come up with a convincing ...
• 101
8k views

### How to create Hinge loss function in python from scratch?

I am learning the math behind popular loss functions by trying to hard code all loss functions from scratch. I tried to code hinge loss My code ...
265 views

### Hinge loss is the tightest convex upper bound on the 0-1 loss

I have read many times that the hinge loss is the tightest convex upper bound on the 0-1 loss (e.g. here, here and here). However, I have never seen a formal proof of this statement. How can we ...
• 180
1 vote