1

What you are describing is the most basic Markov Chain approach, which is kinda naive (in the technical sense). You can only decompose the terms like that if each token is strictly dependent only on the previous token. The whole advancement had been brought about models that are higher-order. For example, you could then decompose the probability of '...


Only top voted, non community-wiki answers of a minimum length are eligible