New answers tagged cross-entropy
0
votes
What is the difference Cross-entropy and KL divergence?
Some answers are already provided, while I would like to point out regarding the question itself
measure the distance between two probability distributions
that neither of cross-entropy and KL ...
0
votes
Normalized Cross Entropy
the closer p is to 0 or 1, the easier it is to achieve a better log loss (i.e. cross entropy, i.e. numerator).
If almost all of the cases are of one category, then we can always predict a high ...
0
votes
cross entropy logistic test set
The issue you're encountering is that, in a regression problem, most people optimize the loss function of interest, often MSE (or something equivalent like SSE, RMSE, or $−R^2$, all of which are ...
1
vote
Accepted
XGBoost Objective Derivation Problem
Since you mention probabilities, I assume you are thinking about a binary classification, in which case the trees all operate in the log-odds space, the $x$s in your notation. So the $\hat{y}$ and $...
Top 50 recent answers are included
Related Tags
cross-entropy × 230neural-networks × 79
loss-functions × 74
machine-learning × 59
classification × 34
entropy × 28
kullback-leibler × 26
softmax × 21
tensorflow × 18
information-theory × 15
logistic × 13
conv-neural-network × 13
keras × 13
maximum-likelihood × 12
autoencoders × 12
backpropagation × 12
log-loss × 10
regression × 9
optimization × 9
likelihood × 9
mse × 7
python × 6
accuracy × 6
derivative × 6
multilabel × 5