Timeline for What are general practises used to divide the data into training / dev and test set?
Current License: CC BY-SA 4.0
5 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| May 20, 2019 at 12:01 | comment | added | Frank Harrell | Your sample size may not be large enough for holding back data. The question of prediction for countries not in the data is always a good one. I think that understanding country differences rather than declaring poor prediction for a currently represented country is valuable. You can also use country as a predictor and predict new countries using the mean over all current countries. If you use country as a random effect in regression you can predict a between-country range. | |
| May 20, 2019 at 10:54 | comment | added | Ayush Pandey | Total Sample size is around 450, 30 images per country, if I want the model to work on other countries as well, using country as a categorical feature would be counter intuitive right?? | |
| May 19, 2019 at 12:59 | answer | added | Lugi | timeline score: 0 | |
| May 19, 2019 at 11:36 | comment | added | Frank Harrell | Specify the total sample size. Whether it's a good idea to split will depend on this being very large (as opposed to resampling validation). And think about not splitting on country but using country as a categorical feature. | |
| May 19, 2019 at 11:22 | history | asked | Ayush Pandey | CC BY-SA 4.0 |