# Probability and null hypothesis testing with a large number of independent variables

I have a dataset with an outcome and a big number of independent variables. For each of the independent variables, i would like to measure the effect of the variable on the outcome and test the null hypothesis. The test is designed so that the probability of type-I error is .05. Each of the independent variables is statistically independent of the outcome and all other independent variables.

1. Suppose we tested the effect of each of 100 variables on the outcome. What is the expected number of times that we would reject the null hypothesis?

2. Suppose we ran 3 tests. What is the probability of rejecting the null hypothesis (i.e. getting a statistically significant effect) in at least one of the tests?

3. Suppose we ran 100 tests. What is the probability of rejecting the null hypothesis (i.e. getting a statistically significant effect) in at least one of the tests?

4. How many tests do we have to run before your chances of getting a statistically significant result are larger than .5?

• This looks like a typical textbook or homework assignment. If this is the case, please add the [self-study] tag and read its wiki as we treat those kinds of questions a little differently here. – Andy Mar 13 '16 at 16:57
• Thanks Andy, I'm new here so I don't know the set-up. I'll add the tag now – DodgyDavid Mar 13 '16 at 17:44