In the training set for naive bayes, there are some duplicate samples. Should we train the naive bayes with duplicate samples, or should we eliminate all the duplicates and then train the naive bayes.
I have points for both for and against eliminating the duplicates.
Since the duplicate sample does not add any new knowledge to the system, we should eliminate it. If there are large number of duplicate samples, the model we build will be biased towards the duplicated sample. Hence duplicates should be avoided.
If a sample is occurring multiple times, it is natural to have a bias to this sample. Hence duplicates should not be filtered.
Please suggest which way is the right way, if at all a right way exists.