I'm really new to this.. I've tried to normalize the data with log, sqrt, Z, normalize function but doesn't work. It stays strongly right skewed. Data has many 0's in it. How to deal with this?

  • 2
    $\begingroup$ There are many posts related to this on site. Here are some that discuss essentially this issue: 1. stats.stackexchange.com/questions/120068/… and 2. stats.stackexchange.com/questions/124059/… and 3. stats.stackexchange.com/a/222188/805 and this comment - 4. stats.stackexchange.com/questions/113554/… $\endgroup$
    – Glen_b
    Nov 18 '17 at 8:17
  • 1
    $\begingroup$ Suitable advice might be possible if you explain what you're trying to do and why you need to transform. (It would likely also be useful to have more information about what this variable measures and how it's distributed) $\endgroup$
    – Glen_b
    Nov 18 '17 at 8:20
  • $\begingroup$ ok I found your link to be useful... I was thinking to transform EmployeeExpYears for prediction... What I can understand from the first link is that transformation is not needed for discrete? $\endgroup$
    – saeed_ar
    Nov 18 '17 at 8:28
  • 2
    $\begingroup$ The message is that attempting a transformation with many 0's is pointless ("You cannot make discrete data normal") not that it's not needed. It's unclear what you're doing that means it requires transformation. Please respond to my second comment above; in the absence of discussion of those issues, it's difficult to say much of value. Why are you trying to transform something with many 0's? $\endgroup$
    – Glen_b
    Nov 18 '17 at 8:34
  • 1
    $\begingroup$ No. That's not right. Or, at best, it's extremely incomplete. There are some occasions when you need to transform data. But they are a small subset of the situations in which people think they need to do so. $\endgroup$
    – Peter Flom
    Nov 18 '17 at 12:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.