All Questions
Tagged with language-models laplace-smoothing
4 questions
2
votes
2
answers
1k
views
Calculating perplexity with smoothing techniques (NLP)
This question is about smoothed n-gram language models. When we use additive smoothing on the train set to determine the conditional probabilities, and calculate the perplexity of train data, where ...
- 23
1
vote
1
answer
4k
views
A simple numerical example for Kneser-Ney Smoothing
I'm working in a project trying to implement the Kneser-Key algorithm. I think I got up to the step of implementing this formula for bigrams:
$P_{(KN)}(w_i|w_{i-1}) = \frac{max(c(w_{-1}, w_{1}) -
\...
5
votes
2
answers
12k
views
Understanding Add-1/Laplace smoothing with bigrams
I am working through an example of Add-1 smoothing in the context of NLP
Say that there is the following corpus (start and end tokens included)
...
- 173
1
vote
2
answers
2k
views
Kneser-Ney for unigrams?
I was wondering if it is at all possible to use Kneser-Ney to smooth word unigram probabilites?
The basic idea behind back-off is to use (n-1)-gram frequencies when an n-gram has 0 count. This is ...
- 202