1
vote
6answers
554 views

How to detect outliers in skewed data set?

I am working on my school datamining project. Within preprocessing stage I need to remove outliers from my data set which is positively skewed (see description). I have an idea to remove all values ...
0
votes
1answer
212 views

How to find outliers in a data series?

I have a series of 100 points My dataset can be found here . Each row is a data series. The plot for 90th row is It's easy to detect outliers visually by plotting example. I tried using hampel ...
0
votes
3answers
78 views

How to use LOF for outlier detection as I have training and test dataset?

I want to use the Local Outlier Factor (LOF) algorithm for outlier detection but it simply finds outliers on unlabed data as whole and you do not need to have a training and test set. However in my ...
1
vote
2answers
162 views

Which does a datamining package support anomaly detection?

I aim to have some anomaly detection process on my data but Weka, Rapidminer or Knime do not support anomaly detection algorithms. How would I take care of the process?
6
votes
3answers
200 views

How to add outliers to an existing data?

I want to test few similarity measures for outlier detection. I've got some data from UCI repository, for example: Breast-Cancer. Is there a smart way to add artificial outliers to an existing data? ...
1
vote
3answers
313 views

Univariate clustering of time series

I just want to know if its possible to cluster an univariate time series, in order , say, to detect anomalies? and do you have any online version for denstream code, in Matlab? here is the time ...
3
votes
2answers
137 views

Detecting fishy data

Just a little thought I've been having. If we rolled a fair dice 60 times, and got 60 sixes in a row, we would (wrongly?) definitely assume that something fishy's going on. Is there any statistical ...
10
votes
3answers
291 views

Good books covering data preprocessing and outlier detection techniques

As the title goes, does anyone know of a good, up to date book that covers data preprocessing in general and especially outlier detection techniques? The book doesn't need to be focusing exclusively ...
5
votes
3answers
838 views

Outliers spotting in time series analysis, should I pre-process data or not?

My question builds on a previous post on outlier detection in generic time series, and specifically on the answer provided by the always great Rob H. I work for a small-sized manufacturing company ...
1
vote
3answers
251 views

Identifying outlier data in high-dimensional settings

I have a data set with high-dimensional feature space. Are there any pre-processing methodologies that can detect outliers from this data set? The outlier, I mean, are the ones that tend to be very ...