# Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

8,383 questions
Filter by
Sorted by
Tagged with
4 views

### How do I correlate the results of two different questionnaires?

I have 2 questionnaires filled out by the same group, they measure the same thing and I'd like to measure the correlation. I am really dumb, when it comes to statistics, so I thought the 2-related ...
4 views

### p statistics for periodicity testing of signals

significance testing for periodicity using Matlab gives a documentation on how to apply Fisher's statistics to a time series signal for periodicity testing. Some concepts are unclear to me and I shall ...
18 views

### A statistical test to evaluate two non-normally distributed groups without same shape distribution with different sample sizes

I want to compare two populations that are: Not normally distributed, Do not follow the same distribution shape, Have different sample sizes. Is there any test which corresponds to these ...
6 views

### Comparing profitability ratios (Return on Ad Spend) of two different marketing campaigns

I'm trying to compare the profitability ratios between two marketing campaigns (an original campaign and an experimental campaign) and I want to determine which campaign is more profitable. We are ...
7 views

### Degree of freedom in Wilk's Theorem

The data: Y_i is poisson(lambda), and and let xi be corresponding values of an explanatory variable x. I have hypothesis: H0: lambda_i = lambda, H_full: lambda_i free to be different for i = 1,....,n, ...
1k views

### How to handle multiple measurements per participant, with categorical data?

I've done an experiment where I've collected measurements from a number of participants. Each relevant data point has two variables, both categorical: in fact, each variable has two possible values (...
259 views

### Hypergeometric testing

I have a large container with 21505 toys, **14,038 action figures (5,397 brands)** and 7,467 barbies (1 brand). Sample: ...
27 views

### How could I use bootstrapping to compare a subpopulation?

We did an A/B test where A is control and B is the same website with one feature variant that is available on all pages on the website. The feature variant is live chat. We wanted to see if live chat ...
17 views

### data normalization for hypothesis testing

I saw this line in an article. *We can use the t-test only if the variable is normally distributed in the population. * It made me wonder about the existence of the need to normalize data before doing ...
45 views

### Hypothesis testing: can we model the critical regions as pockets, rather than a designated “extreme region”?

Say using the sampling distribution of the same mean, we standardize and obtain the standard normal $N(0,1)$ value: $$Z=\frac{\bar{X}-\mu}{\sqrt{\frac{\sigma}{n}^{2}}}$$ We wish to test the ...
9 views

### rfPermute Normal Behavior?

I'm using the rfPermute to calculate the pval of the feature importance. Is it normal for a feature to be significant, but those with a higher %IncMSE to be not? Or have I done something wrong? ...
32 views

### Hypothesis testing of test statistic, $\mu$ against $\mu <, >, \neq \mu_0$

In my notes, I am looking at a hypothesis testing of a test statistic distributed under the t-distribution because the population SD isn't known. The t score was computed for the test statistic, $\mu$,...
24 views

### Detect regularity in arrival times

I am working with series of arrival times. My typical dataset is made of 20-100 samples. I would like to detect regularity in the arrival time. By regularity, I mean that the inter-arrival times may ...
24 views

### Which statistical test for multiple algorithms and multiple sensors?

I am looking for the correct statistical test to compare the performance of several algorithms: Let us assume, we have S subjects and one to ...
10 views

### Inference based on multiple hypothesis tests

This might be a rather basic question, but I really want to get it right. When doing multiple hypothesis testing, researchers typically account for the "multiple" part by controlling for the ...
8 views

### How to combine two independent likelihood ratio tests?

Let us know that a patient has one of disease A or B. Suppose that we run an experiment to find that the patient has disease A or disease B. The null hypothesis is that the patient has disease A and ...
4 views

### How to assess reliability and validity of questionnaire compared to existing questionnaires?

I have a sizeable data set (e.g., 200+) of responses on ordinal scales (e.g., 1-4) for several questionnaires. One of these is newly designed by me. I conducted several questionnaires with the ...
16 views

### From a statistical point of view, what is the validity of an online questionnaire?

Someone constantly asks me how to proceed with a study in which the researcher wants to check something, for example, satisfaction with the choice of a course. It has a population (students of the ...
9 views

### How to prove drawing the same conclusion of not rejecting H0 about Hypothesis Testing?

I'm taking a statistics course, and the problem goes like this: Assume that 𝑋 follows 𝑁(𝜇𝑋,𝜎𝑋2). Consider a two-sided test with H0: 𝜇𝑋=𝜇0. If we do not reject H0 at a significance level 𝛼, ...
8 views

### Hypothesis testing against the average of a group of random variables

Suppose we have data on $N$ machines, each performing repairs on $K$ samples. Further, each machine's performance is evaluated with some metrics, where we can compute the mean performance $\theta_i$ ...
19 views

### (Very) Small sample size, confused about which test to run

First of, I would like to express that I have very limited experience with quantitative data analysis, as I am mainly a qualitative researcher. So I hope my question isn't to far out and I apologize ...
38 views

### Binomial-CDF/binomial-test for classifier significance testing

General Problem Description and Goal I set up a matching algorithm that matches a user input (string) with a list of possible values (words) that is conclusive but very large (some 5 digit ...
54 views

### What will be the appropriate statistical test for this design please?

I have a data of: 30 medical students who have rated visibility of 40 brain anatomical structures (each structure has been rated on a Likert scale of 1-5, where 1 corresponds to "not visible"...
105k views

### Why does a confidence interval including 0 mean the difference is not significant?

Could someone please explain why zero being inside or outside the confidence interval tells you whether or not the difference is significant?
18 views

### McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
16 views

### testing if average revenues of past is greater than now & if to reject null hypothesis [closed]

I want to test whether my average revenues are greater than the revenues on the same month and whether the null hypothesis can be rejected
27 views

### How to display median when mann-whitney u test is applied in python?

I am using scipy.stats.mannwhitneyu to apply mann-whitney test to check my hypothesis on two categories. However, I am interested in finding the median values which are computed to apply mann-whitney. ...
94 views

### how to deal with a small sample?

This question is between statistics and the academic part, specifically in the field of education. The thing is that for a couple of years we have been using a methodology for teaching a course for ...
30 views

### What's the right way to do Bootstrapping Analysis on UserId Randomized A/A?

My motivation is to do A/A analysis using the "Bootstrap" method to calculate the confidence interval of the "sample mean" (of treatment and control) of all metrics. In my A/B ...
19 views

### Sample size and type of hypothesis test for QC of products (frozen cattle embryos)

I have a question regarding sample size and type of hypothesis test to be used. I am currently working on buying beef cattle embryos from overseas. The livestock department in my country is going to ...
263 views

### How to calculate expected value from observed value for continuous distributed data?

I am trying to calculate expected value from observed values for this type of data for chi-square: The question is : A makeup company wants to know if all the shades of their foundation are sold at ...
26 views

34 views

### A variable that affects the dependent variable and is affected by another independent variable

I was analyzing happiness records data. One of the variables was trust in government and I hypothesized that this variable does not have an actual impact on the happiness score. I believe that this ...
11 views

### Change Point Analysis, changes in mean or variance?

I am new to change point analysis, and have run a number of change point models using the below test statistics: Mann-Whitney Lepage Kolmgorov-Smirnov Cramer-von-Mises My understanding is that some ...
47 views

### Approach to maximum likelihood in logistic model

My question is very easy and probably banal, but I can't understand this concept and I found nothing on internet. Consider a logistic/logit model, for example with 3 covariates. We want to test the ...
16 views

### Comparing regression coefficients between models with dependent predictors and dependent criterions

I would like to compare regression coefficients between two models as part of a within-subject study setup. The problem is that both the predictors and criterions are likely to be correlated and that ...
20 views

### How can I determine statistically how well my estimator predicts actual results?

I have a business in which I contract with my clients to perform work for them for an indefinite amount of time. To forecast my profitability, I need to forecast when my existing contracts will end. ...
12 views

### Nyblom Harvey Test

I created in Matlab two independent random walk through the command: y = cumsum(randn(10000,2)) Although the series are clearly independent, when I try to run the ...
13 views

### Why ARIMA Ljung-Box p-values tend to decrease for large lag

I am a beginner at ARIMA model fitting. I have observed that after I fit my model, the Ljung-Box statistic tend to discard the null hypothesis for large lag. It could be that it is only random that it ...
20 views

### How to interpret the Score-Based CUSUM test results?

Context I'm doing an analysis of a price time series and checking for structural breaks (s.b. further on). One of these tests is the Score-Based CUSUM test. As far as I understand, this test is more ...
31 views

### Chi-squared vs. t-test for death rates (percentage data)

I have data regarding death rates (DR) for 5 different groups of people (A-E) as shown below. Groups A B C D E DR 1% 3% 2% 4% 3% samples 200 800 300 100 700 I'm trying to find out observed ...