It is true that the sample size depends on the nature of the problem and the architecture implemented. But, on average, what is the typical sample size utilized for training a deep learning framework?

For instance, in a convolutional neural network (CNN) used for a frame-by-frame video processing, is there a rough estimate for the minimum no. of samples required to train the model?

  • $\begingroup$ What kind of data are you trying to recognize? Did you have a certain architecture in mind? You generally see accuracy push up high very quickly with only a few hundred training examples, but the amount needed rises exponentially as you push for higher accuracy. In my experience with CNN's, once you are in the 90% range you may need a number of examples in the thousands. But I imagine it differs a LOT between models and data. $\endgroup$
    – Frobot
    Feb 8, 2016 at 22:07
  • $\begingroup$ @Frobot: To simply put it, given an image, I would like to locate 14 specific $(x,y)$ points in the image at the same time. $\endgroup$
    – Ébe Isaac
    Feb 9, 2016 at 1:07
  • $\begingroup$ This highly depends on your concrete problem and your architecture and can not be generalized. However, as a rule of thumb, I would say e.g. for localizing something in images you will need more than just 2 or 3 images per region where you want to localize something. This is really hard to say but most times you see neurons really start to learn invariants and converge if they have like 10 or more similar training samples for every different input situation. So if you have like 9 regions (left, center, top, ...) I would say with roughly 90-100 images you should see some learning effect kick in $\endgroup$
    – daniel451
    Feb 10, 2016 at 11:42
  • 1
    $\begingroup$ Possible duplicate of How few training examples is too few when training a neural network? $\endgroup$
    – Sycorax
    Aug 17, 2018 at 3:26


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.