I want to know if average time people spending on their favourite social media are statistically different. I consider here five groups, and the total number of participant is 700 persons.

enter image description here

I have already performed the Shapiro-Wilk normality test, on each group (Facebook, Twitter ...) to see if the time people spend on social media follows a normal distribution, according to the test, the null hypothesis fails so the time isn't normally distributed. Though, I decided to consider the time as a normal distributed parameter, because the average time is approximately normally distributed as $n=700$ is large enough.

Next, I carry out the 'Test of homogeneity of Variances', according to the the results the equality of variances is ruled out.

Meanwhile, I looked at the 'Robust test of equality of means' or 'Welch and Brown-Forsythe', both tests results in p-value $0,000$.

Now, I want to know if I can trust the results of Post hoc? Or I frequently violated the rules? If so how I can eventually compare means?

I have a very few experience in data analyses, so I apologise here for carelessness of my argument.

  • $\begingroup$ Do you have 700 subjects altogether? Or 700 in each group (3500 altogether)? If the former, are the numbers in the various groups all about equal $(\approx 140$ each), or do group sizes vary greatly? OR is this a 'block design' in which all 700 spend time on all 5 media? $\endgroup$
    – BruceET
    May 1 '19 at 18:12
  • $\begingroup$ @BruceET I should have added those info, anyway edited my question, the assumption is every individual spends time only in one of the platforms. $\endgroup$ May 1 '19 at 19:11
  • $\begingroup$ So it seems my Answer is applicable. The smallest group still has 64 subjects, so Shapiro-Wilk should alert you to aggressive non-normality. Variances are somewhat, but not greatly, different. All should be OK. $\endgroup$
    – BruceET
    May 1 '19 at 19:17
  • $\begingroup$ So it seems my Answer is applicable. The smallest group still has 64 subjects, so Shapiro-Wilk should alert you to aggressive non-normality. (But I'd look at boxplots of all 5 groups to see if there are any far outliers.) // Variances are somewhat, but not greatly, different. All should be OK. $\endgroup$
    – BruceET
    May 1 '19 at 19:27
  • $\begingroup$ See stats.stackexchange.com/questions/468996/… $\endgroup$ Jul 5 at 19:14

As you can see from the question in my Comment, I'm just guessing that you have 700 people altogether, with approximately $n_i = 140$ in each (social media) group.

If that is true, Shapiro-Wilk normality tests on individual groups of over 100 each should pick up the degree of non-normality that would invalidate a Welch (separate-variances) ANOVA.

You say you have found significant differences among the five groups with overall a tiny overall P-value.

In that case it should be fruitful to look at ad hoc paired comparisons using two-sample Welch t tests. You could mitigate 'false discovery' by using Bonferroni criteria.

For example, if you do all ${5 \choose 2} = 10$ comparisons, you could look for comparisons significant at the $0.5\%$ level. (However, you may find that you don't need to do all possible comparisons in order to get a good idea what the pattern of significant differences might be.)

Note: If you are using R, perhaps see this link for the functions to use, and some ideas on methods (including, but not limited to, 'Bonferroni') avoiding false discovery in making ad hoc comparisons.

  • $\begingroup$ Thank you, i use SPSS, i'm trying to avoid the ten comparison test to save time and effort, but if i have to then i don't know which test should i carry out in case of not equal variances. $\endgroup$ May 1 '19 at 19:14
  • $\begingroup$ One strategy: Rank the sample means from largest to smallest. Start by looking for gaps where differences seem large enough to be of practical importance and check those pairs to see if statistically signif. // Don't know about SPSS, but some software will just do them all at once and give you the results in a tidy form. (Look at link.) $\endgroup$
    – BruceET
    May 1 '19 at 19:24
  • 1
    $\begingroup$ For future readers, the link inside the answer contains great stuff(SPSS , R ...), again thank you. $\endgroup$ May 1 '19 at 19:29

Look at

           mean st.dev        cv
Snapchat   93.6   94.6 1.0106838
Facebook   54.7   62.3 1.1389397
Instagram  78.1   78.0 0.9987196
Twitter   101.6   94.0 0.9251969
Andere     76.3   87.0 1.1402359

The coefficient of variation is close to a constant, so that might be a better assumption than constant variance. So a glm (generalized linear model) with constant coefficient of variation could be a possibility, that is, a gamma glm. For this data, maybe an identity link function.

But your data is quite strange. Average time on Twitter almost double that on Facebook? Wouldn't have guessed that!


There are several possibilities.

Since you measure total times for each respondent the values are at least zero and are likely heavily skewed to the right. This suggests that a transformation to reduce skewness followed by normal theory tests would be useful. You could consider taking the log of each time. If you have a lot of values at zero, you could consider taking the square root of each time. (These do not differ greatly.) The transformed values should be more normally distributed than the observed times, but there is no assurance that they will be as well-behaved as you desire. Even so, if you reduce the ratio of the standard deviation to the mean (in each group) by a substantial amount then normal theory tests will work better.

Another choice is to use a nonparametric procedure based on ranks. If you do an omnibus test, corresponding to ANOVA, you will want the Kruskal-Wallis test, possibly with multiple comparisons of the individual groups. If you compare two groups at a time , you will want to Wilcoxon or Mann-Whitney test - they are the same. You could adjust the p-values for multiple comparisons in either case.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.