2
$\begingroup$

So based from this link

http://www.simafore.com/blog/bid/107702/2-ways-of-using-Naive-Bayes-classification-for-numeric-attributes

I began to realize it might be a good idea to compute the pdf of each of my features vs. class to be properly compute my posterior probabilities..

My dataset consist of 4000 observations which each have 324 features. The 4000 observations are divided into ten classes.

I first tried to fit my dataset to a QQ-plot, which clearly showed that my dataset seems normally distributed.

enter image description here

Then I tried this cullen and frey graph, which kinda provided me with an different answer...

enter image description here

I am not sure whether i am interpreting the second graph incorrectly?, but is it indicating that feature1 of class 1 is distributed logisticly or am i reading it incorrectly?

Update

I tried creating the same plot as in first one for a larger sample size (80000) which as @Tim mentions shapiro.wilks test won't work. But interestingly is the QQ-plot also beginning to deviate from normality..

enter image description here

Why am I interested? I want extract the most accurate and highest score as possible, but if the model I think it comes from is not accurate, then I might have to change the model, and compute my probabilities another way, but how would it affect Naive bayes, that the distribution of the dataset is not normal?

$\endgroup$
  • $\begingroup$ Try a Wilks-Shapiro test for normality? $\endgroup$ – Jabernet Apr 18 '16 at 20:42
  • 1
    $\begingroup$ output : W = 0.97812, p-value = 9.657e-06 $\endgroup$ – Bob Burt Apr 18 '16 at 20:43
  • 1
    $\begingroup$ No real life data is exactly normally distributed. Why are you interested in normality? See stats.stackexchange.com/questions/2492/… $\endgroup$ – Tim Apr 18 '16 at 20:46
  • 1
    $\begingroup$ That's a small number, for sure. I suggest you make your own decision but a standard alpha to reject region is less that .05 (90% 2 sided test for normality) so I think it's clear that the data is not normal. $\endgroup$ – Jabernet Apr 18 '16 at 20:47
  • 2
    $\begingroup$ @Jabernet with sample size of 40000 normality test will reject the null for nearly any data (e.g. stats.stackexchange.com/questions/12225/…), in R shapiro.test even returns error sample size must be between 3 and 5000 for sample sizes over 5000... $\endgroup$ – Tim Apr 18 '16 at 21:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.