Timeline for Kneser Ney smoothing, why the maths allows division by 0?
Current License: CC BY-SA 3.0
16 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Oct 8, 2023 at 10:46 | vote | accept | Giuseppe Romagnuolo | ||
| Jan 12, 2023 at 18:12 | answer | added | Chris Coffee | timeline score: 0 | |
| Apr 29, 2021 at 13:05 | history | bumped | CommunityBot | This question has answers that may be good or bad; the system has marked it active so that they can be reviewed. | |
| Apr 18, 2021 at 12:01 | history | tweeted | twitter.com/StackStats/status/1383752419134173198 | ||
| Mar 29, 2021 at 2:36 | answer | added | Arya McCarthy | timeline score: 3 | |
| Apr 17, 2016 at 21:14 | history | edited | Giuseppe Romagnuolo | CC BY-SA 3.0 |
deleted 14 characters in body
|
| Apr 17, 2016 at 20:49 | history | edited | Giuseppe Romagnuolo | CC BY-SA 3.0 |
deleted 6 characters in body
|
| Apr 17, 2016 at 20:42 | history | edited | Giuseppe Romagnuolo | CC BY-SA 3.0 |
deleted 6 characters in body
|
| Apr 17, 2016 at 20:36 | comment | added | Giuseppe Romagnuolo | @MarkL.Stone, thanks for your input and sorry if my question was too vague, there is lots to read in that paper (or in any paper for that matter that explains NLP and Kneser-Ney). I have reformatted my question, hopefully it is clearer. I have to implement this formula for an assignment due very soon so I will have to check if the denominator is zero and amend the code accordingly that is no problem. However my question remains (and probably it is as much as a Math question as it is a Statistical one), how can a formula let in a 0 denominator without accounting for that eventuality? | |
| Apr 17, 2016 at 20:32 | comment | added | Giuseppe Romagnuolo | @Silverfish thanks for your suggestion I have expanded the question, hopefully it is clearer what I'm trying to understand. | |
| Apr 17, 2016 at 20:30 | history | edited | Giuseppe Romagnuolo | CC BY-SA 3.0 |
Expanded the question so that it is self contained and can help also who does not know Kneser-Ney smoothing to help with an answer.
|
| Apr 17, 2016 at 8:59 | comment | added | Silverfish | Please try to make your question self-contained - could you at least include the formula and the relevant excerpt? | |
| Apr 17, 2016 at 7:05 | review | Close votes | |||
| Apr 17, 2016 at 11:17 | |||||
| Apr 17, 2016 at 1:12 | comment | added | Mark L. Stone | I have no idea what any of this stuff is, nor am I going to spend time to figure it out. Nevertheless, it appears that on the last equality of p. 39, terms which are zero divided by zero are evaluated as zero. i have no idea if that makes any sense. If that's the "correct" thing to do, you will have to implement a more complicated calculation to achieve that behavior (e.g., check if denominator is zero or "too close" to zero, and if so, set the whole term to zero if the numerator is zero). I have no idea whether you can ever get a non-zero divided by a zero, or what you should do in such case. | |
| Apr 17, 2016 at 1:00 | history | edited | Giuseppe Romagnuolo |
edited tags
|
|
| Apr 17, 2016 at 0:20 | history | asked | Giuseppe Romagnuolo | CC BY-SA 3.0 |