I work on quite a lot of statistical modelling, such as Hidden Markov Models and Gaussian Mixture Models. I see that training good models in each of these cases requires a large (> 20000 sentences for HMMs) amount of data that is taken from similar environments as the final use. My question is:
- Is there a concept of "enough" training data in the literature? How much training data is "good enough"?
- How can I compute how many sentences are needed for "good" (that give a good recognition accuracy (> 80%)) models to be trained?
- How do I know if a model has been trained properly? Will the coefficients in the model start to exhibit random fluctuations? If so, how do I distinguish random fluctuations and real changes due to model update?
Please feel free to retag this question in case it needs more tags.