2
$\begingroup$

stats newbie here.

I have a dataset that is collected weekly. In order to make sure the data set gathered this week conform to past observations, I'm using KL divergence to compute how similar the new data set is comparing to the previous one.

Imagine doing this process every week, I would eventually have a series of KL divergence data points. Is it possible to do anomaly detection through the distribution of these divergences?

My collection of KL divergences are skewed to the right, so usual normal/symmetric distribution methods doesn't quite work. I would like to be able to come up with a confidence level of how likely the new data set is an anomaly and how bad the anomaly is. I have looked around but haven't been able to find any specifics. Is it even possible to do what I want?

Improve this question
$\endgroup$
1
  • 1
    $\begingroup$ Why do you want to funnel your statistical comparison of 2+ samples, possibly drawn from the same distribution, through KLD instead of using a direct statistical test? What problem are you trying to solve, and how does KLD help you solve it? stats.stackexchange.com/questions/83163/… $\endgroup$
    – Sycorax ♦
    Commented Feb 17, 2021 at 8:11

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.