2
$\begingroup$

Can someone explain to me what is the null hypothesis of the two tailed unequal variance t-test in the below:

My understanding is the following:

The statement states: "The duration times for the cycle based network and the preferential attachment networks passed a two-tailed unequal variance t test for different means at P = 0.03"

This is my what I know:

For every statistical test we assume two hypotheses:

Null Hypothesis: The means of duration times for both networks are the same.

Alternative Hypothesis: The means of duration times the networks are not the same.

The p-value represents the probability of accepting the null hypothesis, i.e. probability that our dataset is extreme such that the duration times of both networks is to be similar is 3%.

However why use two tailed unequal variance t-test? Why not one-tail? Why not another test? When is it used and what does it represent exactly and show?

Improve this question
$\endgroup$
  • $\begingroup$ Your p-value interpretation is wrong: P-value is the probabilty of observing this result or more extreme given the assumption of your test and that the null is true. $\endgroup$ – snoram May 11 '15 at 18:57
  • $\begingroup$ @snoram what's the difference between that and what I said. I don't understand. Thanks $\endgroup$ – BKS May 11 '15 at 19:41
  • $\begingroup$ It's a too long story I think. A subtle difference on the nature of hypothesis tests. For example: You never accept an hypothesis you only reject or 'not reject'. $\endgroup$ – snoram May 11 '15 at 19:46
  • $\begingroup$ you might get some benefit from several of the answers here $\endgroup$ – Glen_b May 12 '15 at 2:24
1
$\begingroup$

In every statistical test, we have two hypothesis as you state. But we only assume the Null Hypothesis and perform our statistical test under this assumption.

The p-value from the test doesn't tell us the probability of our data set or more extreme. It tell us the frequency of our data set (or more extreme) given many hypothetical replications of the test under our Null Hypothesis assumption.

Putting these two ideas together: We assume the means are equal (Null Hypothesis). Statistics tells how often our data set would appear (or more extreme) under this assumption if we ran many hypothetical experiments. If this data doesn't happen often, then we have evidence to reject the null hypothesis. Otherwise, we say that we don't have enough evidence to reject the null hypothesis.

A two-tailed test is used if we want to know one group is different (larger or smaller) than the other. A one-tailed test is used if we only want to know it is larger or if we only want to know it is smaller.

The t-test is a common and easy test. But it has some assumptions before the test can be applied. If the assumptions are not met, there are many alternatives like the Mann-Whitney U test that each come with their own assumptions.

When the t-test is done, we will get the t-statistics itself and corresponding p-value. We can also calculate a 95% confidence interval of the true difference of means. This interval does not say the true mean lies within this interval with 95% probability. The true mean is in the interval or it is not. There is no probability. Instead we say that we have a procedure that will contain the true difference 95% of the time if we hypothetically ran this experiment many times.

There are many links that describe this in many ways. Also, this explanation is the Frequentist approach instead of the Bayesian approach.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.