Timeline for Kneser Ney smoothing, why the maths allows division by 0?
Current License: CC BY-SA 4.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Oct 8, 2023 at 16:17 | comment | added | Arya McCarthy | Hi, just seeing this. Recall that this is a bigram LM. The conditional counts can be 0 all they want; we don't care if we divide 0 by something. We just care that we mustn't divide by 0. And again in bigram LMs, the count of word given contexts is exactly the unigram count (under the common and mild assumption of a special BOS symbol and special EOS symbol). Summing over all word–context pairs gets you the total count of that word. | |
| Jan 12, 2023 at 18:31 | review | Late answers | |||
| Jan 12, 2023 at 18:42 | |||||
| Jan 12, 2023 at 18:13 | history | edited | Chris Coffee | CC BY-SA 4.0 |
edited body
|
| Jan 12, 2023 at 18:12 | history | edited | Chris Coffee | CC BY-SA 4.0 |
deleted 12 characters in body
|
| Jan 12, 2023 at 18:12 | history | edited | Chris Coffee | CC BY-SA 4.0 |
deleted 6 characters in body
|
| S Jan 12, 2023 at 18:12 | review | First answers | |||
| Jan 12, 2023 at 18:16 | |||||
| S Jan 12, 2023 at 18:12 | history | answered | Chris Coffee | CC BY-SA 4.0 |