Linked Questions
11 questions linked to/from Objective function, cost function, loss function: are they the same thing?
1
vote
0
answers
24
views
Are there some needs to prove that object function can be reduced to cost function? [duplicate]
I'm a student studying ML.
After I searched the differences between the loss function, cost function, and object function, I had some questions.
Objective function, cost function, loss function: are ...
- 63
51
votes
1
answer
21k
views
What is the difference between a loss function and an error function?
Is the term "loss" synonymous with "error"? Is there a difference in definition?
Also, what is the origin of the term "loss"?
NB: The error function mentioned here is not to be confused with normal ...
- 620
6
votes
1
answer
2k
views
Meaning of vertical bar | in loss function?
Does anyone know what the vertical bars in these equations here mean?
Specifically, these?
- 79
10
votes
1
answer
3k
views
What is a loss function in decision theory?
My notes define a loss function as the 'cost' incurred when the true value of $\theta$ is estimated by $\hat\theta$. What kind of cost is it talking about? monetary cost? or is it something related to ...
- 969
10
votes
1
answer
8k
views
Connection between loss and likelihood function
Simple question: Can we generally think of the loss function as the negative of the likelihood function?
For instance with regards to logistic regression, the likelihood function in a binary setting ...
- 1,521
1
vote
1
answer
1k
views
SVM loss function
I am going through Bishop's book and especially SVM. I am trying to understand the logic behind minimizing the specific loss $argmax_{\mathbf{w}} \frac{1}{2}||\mathbf{w}||^{2}$. On page 327, in 7.3 we ...
- 85
3
votes
1
answer
2k
views
What is the "value of fitting criterion" on the nnet package in R?
When you run the function nnet of the nnet package a sequence of values is shown on the console like this (made up numbers):
initial value 100
iter 10 value 88
iter 20 value 80
final value 60
And ...
- 211
1
vote
1
answer
327
views
An arbitrary error function
I have read this paper Piece-wise quadratic approximations of arbitrary error functions for fast and robust machine learning
My question is
What does the arbitrary error functions mean?
- 2,119
3
votes
1
answer
157
views
Word for loss function except weight regularization?
A typical loss function in machine learning is:
$$L(\theta,x) = \mathcal L(\theta,x) +\sum_{\theta} |\theta|$$
I typically use the word “loss function” both for $L(\theta,x)$ and for $\mathcal L(\...
- 2,987
0
votes
1
answer
188
views
Functional form of f
I am reading An Introduction to Statistical Learning with Applications in R by G. James, D. Witten, T. Hastie and R. Tibshiran 2013 after taking a basic statistics course a little while ago.
On page ...
- 105
0
votes
0
answers
143
views
in Financial Machine Learning, what would be the difference of objective function, cost function and loss function definitions?
I'm interested in learning more about differences or special considerations when thinking about loss function, cost function, and objective function in a Financial Machine Learning scenario (e.g. ...
