All Questions
3 questions
6
votes
1
answer
525
views
n-gram language model
At the end of the introduction of A Neural Probabilistic Language Model (Bengio et al. 2003), the following example is given:
Having seen the sentence ...
- 6,217
1
vote
1
answer
511
views
Curse of dimensionality with language models
In the seminal paper A Neural Probabilistic Language Model, Yoshua Bengio and his colleagues make the following point:
If one wants to model the joint probability distribution of 10
consecutive ...
- 6,217
8
votes
1
answer
268
views
Language modeling: why is adding up to 1 so important?
In many natural language processing applications such as spelling correction, machine translation and speech recognition, we use language models. Language models are created usually by counting how ...
- 183