# How to compare two or more mean AUC

I have different machine learning models and for each of them after a 10-fold cross validation I obtained a mean AUC (+-std). Now, How can I check if there is a statistically significant difference (p-value) among the mean AUC?

• I wouldn't do this. Anyway, can you post some sample data? Apr 3, 2020 at 10:52
• Example of AUC for three models: 0.66 (±0.04) 0.74 (±0.04) 0.77 (±0.04) Apr 3, 2020 at 11:11
• Do you only have these statistics or can you also obtain the raw 10 values for each fold? Apr 3, 2020 at 11:18
• Unfortunately I saved only the mean value. I could get the individual measurements on each test set but I have to re-calculate them for each model. Apr 3, 2020 at 11:29

Side note: As AUC approaches 1, estimates become non-normally distributed, making the sem less useful than the confidence interval. Also, sensitivity to differences decreases as AUC approaches 1, and I have seen people compare $$e^\text{AUC}$$ rather than AUC itself in this situation.