Skip to main content
Notice removed Draw attention by user76943
Bounty Ended with Dikran Marsupial's answer chosen by CommunityBot
edited title
Link
utobi
  • 12.1k
  • 11
  • 45
  • 71

Training error loss vs "classification loss"?

deleted 9 characters in body
Source Link
user76943
user76943

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two types of classifiers? If an interpolated classifier only depends on the training data, then an overfitted algo in this context could mean an algo that has zero or near zero test error (i.e. generalization error)...which seems different than more traditional definitions of "overfit".

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two types of classifiers? If an interpolated classifier only depends on the training data, then an overfitted algo in this context could mean an algo that has zero or near zero test error (i.e. generalization error)...which seems different than more traditional definitions of "overfit".

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two classifiers? If an interpolated classifier only depends on the training data, then an overfitted algo in this context could mean an algo that has zero or near zero test error (i.e. generalization error)...which seems different than more traditional definitions of "overfit".

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

fixed grammar
Source Link
user76943
user76943

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two types of classifiers? Was thinking thatIf an overfittinginterpolated classifier only depends on the training data, then an overfitted algo herein this context could mean an algo that has zero or near zero test error (i.e. generalization error)...which seems different than more traditional definitions of "overfit".

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two types of classifiers? Was thinking that an overfitting algo here could mean an algo that has zero or near zero test error (i.e. generalization error).

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

From the paper To understand deep learning we need to understand kernel learning, three questions:

In section 2 "Setup" there appears a definition of interpolated classifier as an algo that has zero or close to zero training error and overfitted as an algo "if the same holds for classification loss".

Question 1: what is the mathematical definition of these two types of classifiers? If an interpolated classifier only depends on the training data, then an overfitted algo in this context could mean an algo that has zero or near zero test error (i.e. generalization error)...which seems different than more traditional definitions of "overfit".

Question 2. The authors then go on to state that in their definitions an interpolated classifier is necessarily an overfit classifier -- why?

Question 3. In section 4, does the t-overfits the data definition depend on a fixed training set? I.e. do they mean t-overfit a fixed but arbitrary training dataset?

Notice added Draw attention by user76943
Bounty Started worth 50 reputation by CommunityBot
fixed grammar
Source Link
user76943
user76943
Loading
improve title formatting
Link
user76943
user76943
Loading
improved syntax
Source Link
user76943
user76943
Loading
Source Link
user76943
user76943
Loading