Skip to main content
replaced http://datascience.stackexchange.com/ with https://datascience.stackexchange.com/
Source Link

As whuber explained in his comment, it depends on many factors, the most important one I believe being the information that the train set contains. E.g. if the train set is small, you're likely to have unseen trigrams, which will cause issues when tagging the test set. The choice of the size of n-gram can be seen as a bias–variancebias–variance compromise .

As whuber explained in his comment, it depends on many factors, the most important one I believe being the information that the train set contains. E.g. if the train set is small, you're likely to have unseen trigrams, which will cause issues when tagging the test set. The choice of the size of n-gram can be seen as a bias–variance compromise .

As whuber explained in his comment, it depends on many factors, the most important one I believe being the information that the train set contains. E.g. if the train set is small, you're likely to have unseen trigrams, which will cause issues when tagging the test set. The choice of the size of n-gram can be seen as a bias–variance compromise .

Source Link
Franck Dernoncourt
  • 47.6k
  • 33
  • 179
  • 293

As whuber explained in his comment, it depends on many factors, the most important one I believe being the information that the train set contains. E.g. if the train set is small, you're likely to have unseen trigrams, which will cause issues when tagging the test set. The choice of the size of n-gram can be seen as a bias–variance compromise .