Tagged Questions
0
votes
0answers
33 views
Repeated 100x 10-fold cross validation, what is the sample size when doing an significance test?
I iterated my 10-fold cross validation 100 times for several methods. Now I want to use a t-test to test if the results are significant. However, I'm not sure what the sample size is.
Is the sample ...
0
votes
0answers
81 views
Null distribution on synthetic data
I need a sort of review of all (or most of) available methods to create null distributions (as reference) to use to compare a result. For ex: if I want to validate a network I can create a set of 1000 ...
11
votes
1answer
298 views
When/where to use functional data analysis?
I am very new to functional data analysis (FDA). I am reading:
Ramsay, James O., and Silverman, Bernard W. (2006), Functional Data
Analysis, 2nd ed., Springer, New York.
However, I am still ...
4
votes
1answer
262 views
How to compare the results of a leave-one-out strategy?
I tried to reproduce the experiments described in this paper and wanted to compare the output of my system with the one described in the article. I am looking for a statistical comparison of the ...
2
votes
1answer
433 views
Statistically comparing classifiers using only confusion matrix (or average accuracies)
Is it possible to perform a statistical test to determine if one classifier is better than the other using only the confusion matrices of these classifiers?
What about the average accuracies from ...
