Let's say I have 20 different datasets, some of which are as small as 200 data items and some have around 2000 samples. The goal of analysis is to do some sort of performance comparison between the models working on each dataset.
Now say for the smaller datasets I've gone with the LOOCV for performance estimation but it's computationally impossible to do LOOCV for the larger ones. Then would the choice of 100 be reasonable over the generic value of k in k-fold CV, just to make the analysis more consistent across the datasets?
In general, I've seen debates on 10-fold vs LOO CV on considerations such as variance-bias trade-off, but I'm wondering if there's any case that a k value like 50 or 100 would be preferable to those generic values we commonly see in discussions.