# Questions tagged [mad]

Median Absolute Deviation (MAD) is a measure of variability in a sample of data, and is often used as an alternative to measures like standard deviation since it is more resistant to outliers. Use the [mae] tag if you are asking about the point forecast accuracy measure called MAD or MAE.

58 questions
Filter by
Sorted by
Tagged with
17 views

### Comparing Star Ratings

Data Illustration NOTE: I do not have a stats background. I'm pretty sure I'll use some terminology incorrectly. I have come across several approaches via Python/SQL that I would like to confirm as ...
• 101
1 vote
57 views

### MAD & Median of weighted GMM

What is the median and median-absolute-deviation of a weighted GMM in terms of component mean and variance? For example, three normal distributions $A$, $B$, $C$ with means $\mu_a,\mu_b,\mu_c$, ...
23 views

### Constructing a User Profile for Music Taste

My goal is to construct User profiles based on positive (and maybe also negative) interactions with songs. A User has the option to like a song. This would give me a list of likes for each user. With ...
• 31
1 vote
58 views

### Method for outlier detection in noisy seasonal time series data?

I have around 1000 times series of around 1000 samples, where each sample is 5 minutes a part. An example of a time series after performing seasonal decomposition is As we can see the data is very ...
• 151
38 views

• 674
1 vote
195 views

### How does one calculate Fisher-consistency factor for Rousseeuw and Croux's $S_n$ for empirical distribution?

In "Alternatives to the Median Absolute Deviation" (Rousseeuw and Croux, J. Amer. Statistical Assoc, 88(424), 1993, pp.1273–1283), the authors described an estimator of SD better than median absolute ...
• 519
3k views

### How to normalize if MAD equals zero?

A known way to normalize our feature vectors is: $$\frac{x_i - \operatorname{median}( X^{(j)})}{\operatorname{MAD}^{(j)}},$$ where $\operatorname{MAD}^{(j)}$ is the median absolute deviation of ...
3k views

### Can Median Absolute Deviation (MAD)/SD be used to determine if a distribution is normal or not?

I have recently come across this post on Median Absolute Deviation (MAD). The Wikipedia article here, by the article as an estimator Standard deviation of the distribution is 'k' times MAD, where the ...
• 198
56 views

### Square of MAD as variance equivalent

I have to estimate the error of a 1D array. The usual way of doing this to take the SD of it and square it. The issue is the following: The values in the array represent the time series of the ...
1 vote
432 views

### Why don't dispersions like median deviation and mode deviation exists on the lines of mean deviation?

Or to say in the formula MD=$\frac{1}{N}\sum_{i=1}^{N}|x_i-\overline{x}|$ why can't we have median or mode instead of mean($\overline{x}$) and as a result speak about additional possible measures of ...
• 351
3k views

### Is there a version of the correlation coefficient that is less-sensitive to outliers?

The correlation coefficient is: $$r = \frac{\sum_k \frac{(x_k - \bar{x}) (y_k - \bar{y_k})}{s_x s_y}}{n-1}$$ The sample mean and the sample standard deviation are sensitive to outliers. As well, ...
1 vote
203 views

### What is the best way to determine which proteins are significantly bound on a testing chip?

I've got a question about the data from a biological experiment. Three times the same 1024 different proteins are spotted on one testing chip. Target of the experiment is to see whether certain ...
• 13
2k views

### What should I use to establish a threshold to detect threshold crossings?

I have data graphed in green here: I want to detect the peaks but I don't know how to define the threshold values. The blue lines are mean ± standard deviation. Using that, I would miss the three ...
• 101
596 views

### alternative to IQR [duplicate]

I am currently making a short literature study of robust and efficient estimators. Some very well known are the median absolute deviation (MAD) and the interquartile range (IQR). However they both ...
• 131
7k views

### When the Median Absolute Deviation (MAD) is zero

Suppose my data look like the following: (10, 10, 10, 10, 10, 0) Would it be possible to remove an outlier in this distribution using the median absolute deviation? Of course, you wouldn't need to ...
• 49
71 views

### Reducing density of outliers

I have a dataset with right skewed data. It represent frequency of candidates vs their TTB (which is essentially the number of days) Now the TTB values less than 14 or so are possible. But not with ...
33k views

### Determine outliers using IQR or standard deviation?

Similar to ... which doesn't have the answer I'm looking for. The data set has a normal distribution. For the project I'm working on, outliers have to be determined over residuals of breeding data....
• 223
1k views

### Median absolute deviation: impact/bias when forcing a median of zero

I want to estimate the median absolute deviation (MAD) of a signal. The MAD is defined as the median of the absolute difference between the signal and its median. Now I have a signal that I know for ...
• 147
6k views

### Median absolute deviation (MAD) and SD of different distributions

For normally distributed data, the standard deviation $\sigma$ and the median absolute deviation $\text{MAD}$ are related by: $\sigma=\Phi^{-1}(3/4)\cdot \text{MAD}\approx1.4826\cdot\text{MAD},$ ...
• 161
357 views

• 157
1k views

### Bar plot with median +/- median absolute deviation in scientific publication

I know bar plots usually represents mean +/- sem, but if the data is non-normal, is it ok to bar plot median +/- mad? I don't like box plots. Suggestison?
1 vote
208 views

### What's the proper way to do automatic iterative outlier rejection?

I know this is a touchy subject, so I'll proceed with caution... I am building regression models for some hundreds of thousands of data files containing only two columns. The sensor collecting these ...
• 2,352
1 vote
176 views

### Proving the consistancy of the MAD

I am trying to prove that the median absolute deviation from the median (MAD), with k=1.4862, is a consistent estimator of the standard deviation.
1 vote
226 views

### Alternatives to MAD to find a yardstick to assess data

In a paper by Rousseeuw and Croux from 1993 ("Alternatives to the Median Absolute deviation", page 1274, link to pdf), I came across an indicator I'm considering using. The formula is:  Sn = C\, {\...
• 19
1k views

### What distribution has the maximum entropy for a known mean absolute deviation?

I was reading the discussion on Hacker News about the use of the standard deviation as opposed to other metrics such as the mean absolute deviation. So, if we were to follow the principle of maximum ...
• 223
2k views

### Understanding MAD Results

I'm using R to calculate the median absolute deviation for a few distributions, but some of the values I'm calculating do not seem realistic at all. I have the following distribution: ...
• 244
5k views

### MAD in relation to 95% confidence

MAD (Median Absolute Deviation) is: $\text{MAD} = M_i(|x_i-M_j(x_j)|)$ where $M()$ is the median operator ($M_i(x_i) = \text{median}(x_1,...,x_n)$). I'd like to scale the MAD in such a way as to ...
• 244
1k views

### Does a median-unbiased estimator minimize mean absolute deviance?

This is a follow-up but also a different question of my previous one. I read on Wikipedia that "A median-unbiased estimator minimizes the risk with respect to the absolute-deviation loss function, as ...
• 393