Questions tagged [huber]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
2answers
217 views

How to choose delta parameter in Huber Loss function?

In Huber loss function, there is a hyperparameter (delta) to switch two error function. Currently, I am setting that value manually. But, I cannot decide which values are the best. So, how to choose ...
1
vote
0answers
42 views

Existence of Huber M-estimators

I am working on a paper about optimization using the Huber's Loss function, which is defined as: \begin{equation} \psi(x)=\begin{cases} \frac{x^2}{2\gamma},& \text{if } \lvert x\rvert\leq\gamma\\ ...
4
votes
1answer
204 views

Tradeoffs of robust mean measures (trimmed, Huber, cosh, etc)

After recently having delved into the world of robust measures (for location, mean being the classical case), I have had difficulty understanding robust measures' core dynamic. Basically, what are ...
0
votes
0answers
116 views

How is the parameter „huber_alpha“ defined in H2O Deep Learning?

In the documentation of the H2O software (http://docs.h2o.ai/h2o/latest-stable/h2o-docs/data-science/deep-learning.html) it says for the parameter “huber_alpha: Specify the desired quantile for Huber/...
1
vote
1answer
472 views

Huber Loss on top of Cross Entropy

I know that the Huber loss is usually applied on top of the L2 loss in order to prevent exploding gradients. Does it make sense to use the Huber loss on top of the cross entropy loss, though? I have a ...
1
vote
1answer
1k views

Scikit-learn: How to normalize Huber regressors?

In scikit-learn the Ridge regression estimator has a normalize parameter that normalizes the regressors. I found that it was necessary to set this to ...
0
votes
1answer
301 views

functional differences between using huber loss and winsorizing/trimming

Curious what the functional differences are between using a Huber loss function/ regression and Winsorizing data and then running a classic least squares regression. Will the resulting outputs be ...