# Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

6,877 questions
Filter by
Sorted by
Tagged with
11 views

30 views

36 views

### Statistically significant means with small mean difference

I ran an ANOVA on 3 sample sets with means 7.8, 8, and 7.9. The sample with a mean of 8 was statistically different than the other two. The sample size for each mean=200 and 95 confidence level. Why ...
16 views

### Which way does an alpha significance level move when a test becomes more conservative?

From NIST 800-90b §5, there is a two sided IID test, with a threshold at $\alpha = 0.001$ as:- And the full test uses 10,000 samples. That seems to be worked out as $0.001 \times 10,000 = 10$ which ...
58 views

### Is this just a consequence of Publication bias or has a name of its own? [duplicate]

Scenario: In our world, only statistically significant ($p<0.05$) results are published, everything else is rejected or not even handed in. Let's now assume an experiment is $100$ times conducted ...
9 views

### Gender (Male&Female) and wage help in R [closed]

I'm having trouble doing a hypothesis test in R. I have a very large dataset with the column "gender" (1=male, 2= female). In another column I have "Wage". I simply wonder how do I calculate the ...
33 views

13 views

### Application of Yates's correction in chi-square tests

There are a couple of points related to 'Yates's correction' I cannot figure out. Should I always do this correction when calculating the 'chi-square' criterion for 2x2 'contingency tables' (to ...
53 views

### Notation and meaning of a general probability distribution

I had two questions regarding the meaning and notation of a probability distribution when it is not specifically specified. For example, some papers jump right into their approach with notation like (...
101 views

### Can the null hypothesis of a t-test of “no significant difference” be used as a result?

I am not so familiar with statistics, since I am a computer science student. I hope it is alright to ask this question here. I am currently working towards the end of a thesis. I compared the User ...
25 views

### Can I use t test for a large sample? [closed]

I used a Kolmogorov-Smirnov normality test and the sample isn't normally distributed. The number of observations is 397, can I use a variation test (to see if the two variations are equal or not) and ...
34 views

### Potential problems when doing hypothesis testing on large number of variables

I encounter this question in an interview. We were discussing AB testing on one categorical variable and this was the follow up question: what if now instead of one variable we want to test 100 ...
17 views

### why there different standard error form in Hypothesis testing

In Hypothesis testing,Comparison of a sample mean with an assigned population mean: $$Z=\frac{\overline x-\mu_0}{\frac{\sigma}{\sqrt n}}\text{ Or }Z=\frac{\overline x-\mu_0}{\frac{s}{\sqrt n}}$$ But ...
141 views

### How to test for statistical significance with multiple visits and technical replicates?

I have a data set with 100 columns that's divided between 40 normal columns and 60 MI columns. Samples from each patient were taken at two separate visits, and each sample has two technical ...
42 views

### Correction for multiple testing required for combined metrics

Let's say I compare two diagnostic procedures (A and B) and want to check if one outperforms the other one using the metric diagnostic accuracy where diagnostic accuracy is commonly described using ...
16 views

### Wald test for Overdispersion in Poisson Regression model

could you kindly help me with the test statistics for performing an overdispersion test in R for Poisson and negative binomial regression models?
34 views

### Hypothesis testing for apriori market basket analysis

I'm wondering if there is a possibility to perform hypothesis tests to show that the resulting rules from an apriori market basket analysis are statistically significant? Maybe I'm missing the forest ...
23 views

### Comparisons within the control and experimental groups. Pottentialy multiple comparisions problem

I have a question: Does something will be wrong, if me, in addition to comparing the control and experimental groups, I will make an analysis inside these groups? Someone pointed this out to me, ...
14 views

### Performing t-test in binary classification problem?

I have a binary data (0 and 1) and I created an XGboost model to predict it. The data are related to insurance contracts, it is a lapse model. The predicted lapse rates are grouped by contractors age ...
32 views

### Why the joint hypothesis (F-test) cannot be substituted by multiple individual hypothesis (T-test)

In the book Basic Econometrics (Page254), the author writes: In testing the significance of β2_hat under the null hypothesis, it was assumed tacitly that the testing was based on a different sample ...
128 views

### A bit confused on p values on ttest in Stata output

In Stata the output of a ttest shows p values as: Pr(T<t), Pr(|T|>|t|) and Pr(T>t) I understand the two sides to be the tails of the test and the middle ...
17 views

### A question about hypothesis testing on non normal distributions

I have a set of 20 distributions (4 sets of 5) none of them are normally distributed but all are qualitatively similar and all have ~700k data points. The images below are a typical example. First ...
I want to construct an NP-Test for simple Null- and Alternative-hypothesis. In particular the likelihood for the Nullhypothesis and Alternativehypothesis is given by h_0(x)=\chi_{(-2,2)}(x)\\h_1(x)=\...