Timeline for Which test to perform for significance testing when comparing accuracies from two models
Current License: CC BY-SA 4.0
5 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Dec 26, 2020 at 7:20 | answer | added | Demetri Pananos | timeline score: 0 | |
| Dec 26, 2020 at 7:14 | comment | added | Boris | @Dave so if I would use Chi-Sq or Fisher's exact test, then my expected loss would be 0 for the two observations since it is an optimisation task with the objective to minimize the loss? | |
| Dec 26, 2020 at 6:56 | comment | added | Dave | You’re comparing two proportions, right? You know ways to do that ($\chi^2$ test, Fisher’s exact test, proportion z-test...). $\text{//}$ Why do you need to perform a hypothesis test to compare the two accuracy scores? $\text{//}$ Why use accuracy? Statisticians tend to prefer proper scoring rules like log loss. | |
| Dec 26, 2020 at 6:56 | review | First posts | |||
| Dec 26, 2020 at 10:14 | |||||
| Dec 26, 2020 at 6:48 | history | asked | Boris | CC BY-SA 4.0 |