Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

How do I correlate the results of two different questionnaires?

I have 2 questionnaires filled out by the same group, they measure the same thing and I'd like to measure the correlation. I am really dumb, when it comes to statistics, so I thought the 2-related ...
0
votes
0answers
4 views

p statistics for periodicity testing of signals

significance testing for periodicity using Matlab gives a documentation on how to apply Fisher's statistics to a time series signal for periodicity testing. Some concepts are unclear to me and I shall ...
2
votes
0answers
18 views

A statistical test to evaluate two non-normally distributed groups without same shape distribution with different sample sizes

I want to compare two populations that are: Not normally distributed, Do not follow the same distribution shape, Have different sample sizes. Is there any test which corresponds to these ...
0
votes
0answers
6 views

Comparing profitability ratios (Return on Ad Spend) of two different marketing campaigns

I'm trying to compare the profitability ratios between two marketing campaigns (an original campaign and an experimental campaign) and I want to determine which campaign is more profitable. We are ...
0
votes
0answers
7 views

Degree of freedom in Wilk's Theorem

The data: Y_i is poisson(lambda), and and let xi be corresponding values of an explanatory variable x. I have hypothesis: H0: lambda_i = lambda, H_full: lambda_i free to be different for i = 1,....,n, ...
8
votes
1answer
1k views

How to handle multiple measurements per participant, with categorical data?

I've done an experiment where I've collected measurements from a number of participants. Each relevant data point has two variables, both categorical: in fact, each variable has two possible values (...
0
votes
1answer
259 views

Hypergeometric testing

I have a large container with 21505 toys, **14,038 action figures (5,397 brands)** and 7,467 barbies (1 brand). Sample: ...
0
votes
1answer
27 views

How could I use bootstrapping to compare a subpopulation?

We did an A/B test where A is control and B is the same website with one feature variant that is available on all pages on the website. The feature variant is live chat. We wanted to see if live chat ...
0
votes
0answers
17 views

data normalization for hypothesis testing

I saw this line in an article. *We can use the t-test only if the variable is normally distributed in the population. * It made me wonder about the existence of the need to normalize data before doing ...
1
vote
1answer
45 views

Hypothesis testing: can we model the critical regions as pockets, rather than a designated “extreme region”?

Say using the sampling distribution of the same mean, we standardize and obtain the standard normal $N(0,1)$ value: $$ Z=\frac{\bar{X}-\mu}{\sqrt{\frac{\sigma}{n}^{2}}} $$ We wish to test the ...
0
votes
0answers
9 views

rfPermute Normal Behavior?

I'm using the rfPermute to calculate the pval of the feature importance. Is it normal for a feature to be significant, but those with a higher %IncMSE to be not? Or have I done something wrong? ...
0
votes
1answer
32 views

Hypothesis testing of test statistic, $\mu$ against $\mu <, >, \neq \mu_0$

In my notes, I am looking at a hypothesis testing of a test statistic distributed under the t-distribution because the population SD isn't known. The t score was computed for the test statistic, $\mu$,...
1
vote
0answers
24 views

Detect regularity in arrival times

I am working with series of arrival times. My typical dataset is made of 20-100 samples. I would like to detect regularity in the arrival time. By regularity, I mean that the inter-arrival times may ...
1
vote
0answers
24 views

Which statistical test for multiple algorithms and multiple sensors?

I am looking for the correct statistical test to compare the performance of several algorithms: Let us assume, we have S subjects and one to ...
0
votes
0answers
10 views

Inference based on multiple hypothesis tests

This might be a rather basic question, but I really want to get it right. When doing multiple hypothesis testing, researchers typically account for the "multiple" part by controlling for the ...
1
vote
0answers
8 views

How to combine two independent likelihood ratio tests?

Let us know that a patient has one of disease A or B. Suppose that we run an experiment to find that the patient has disease A or disease B. The null hypothesis is that the patient has disease A and ...
0
votes
0answers
4 views

How to assess reliability and validity of questionnaire compared to existing questionnaires?

I have a sizeable data set (e.g., 200+) of responses on ordinal scales (e.g., 1-4) for several questionnaires. One of these is newly designed by me. I conducted several questionnaires with the ...
0
votes
0answers
16 views

From a statistical point of view, what is the validity of an online questionnaire?

Someone constantly asks me how to proceed with a study in which the researcher wants to check something, for example, satisfaction with the choice of a course. It has a population (students of the ...
0
votes
0answers
9 views

How to prove drawing the same conclusion of not rejecting H0 about Hypothesis Testing?

I'm taking a statistics course, and the problem goes like this: Assume that 𝑋 follows 𝑁(πœ‡π‘‹,πœŽπ‘‹2). Consider a two-sided test with H0: πœ‡π‘‹=πœ‡0. If we do not reject H0 at a significance level 𝛼, ...
0
votes
0answers
8 views

Hypothesis testing against the average of a group of random variables

Suppose we have data on $N$ machines, each performing repairs on $K$ samples. Further, each machine's performance is evaluated with some metrics, where we can compute the mean performance $\theta_i$ ...
0
votes
0answers
19 views

(Very) Small sample size, confused about which test to run

First of, I would like to express that I have very limited experience with quantitative data analysis, as I am mainly a qualitative researcher. So I hope my question isn't to far out and I apologize ...
2
votes
0answers
38 views

Binomial-CDF/binomial-test for classifier significance testing

General Problem Description and Goal I set up a matching algorithm that matches a user input (string) with a list of possible values (words) that is conclusive but very large (some 5 digit ...
0
votes
0answers
54 views

What will be the appropriate statistical test for this design please?

I have a data of: 30 medical students who have rated visibility of 40 brain anatomical structures (each structure has been rated on a Likert scale of 1-5, where 1 corresponds to "not visible"...
10
votes
4answers
105k views

Why does a confidence interval including 0 mean the difference is not significant?

Could someone please explain why zero being inside or outside the confidence interval tells you whether or not the difference is significant?
1
vote
1answer
18 views

McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
0
votes
0answers
16 views

testing if average revenues of past is greater than now & if to reject null hypothesis [closed]

I want to test whether my average revenues are greater than the revenues on the same month and whether the null hypothesis can be rejected
0
votes
1answer
27 views

How to display median when mann-whitney u test is applied in python?

I am using scipy.stats.mannwhitneyu to apply mann-whitney test to check my hypothesis on two categories. However, I am interested in finding the median values which are computed to apply mann-whitney. ...
1
vote
1answer
94 views

how to deal with a small sample?

This question is between statistics and the academic part, specifically in the field of education. The thing is that for a couple of years we have been using a methodology for teaching a course for ...
0
votes
0answers
30 views

What's the right way to do Bootstrapping Analysis on UserId Randomized A/A?

My motivation is to do A/A analysis using the "Bootstrap" method to calculate the confidence interval of the "sample mean" (of treatment and control) of all metrics. In my A/B ...
0
votes
1answer
19 views

Sample size and type of hypothesis test for QC of products (frozen cattle embryos)

I have a question regarding sample size and type of hypothesis test to be used. I am currently working on buying beef cattle embryos from overseas. The livestock department in my country is going to ...
0
votes
0answers
263 views

How to calculate expected value from observed value for continuous distributed data?

I am trying to calculate expected value from observed values for this type of data for chi-square: The question is : A makeup company wants to know if all the shades of their foundation are sold at ...
0
votes
0answers
26 views

Testing on uniform distribution with large sample?

Let $$X_1,X_2,\dotsc,X_n$$ be a random sample from U(0, a) and $$ Y_1,\dotsc,Y_n$$ be a random sample from U(-a,a) a is natural number. Let $$H_0$$ a is even and $$H_1$$ a is odd. On the basis of $$...
-1
votes
0answers
28 views

Two separate hypotheses or one? [closed]

I have a research question that comprises one independent variable and two dependent variables: measurement for depression, and a measurement for anxiety. I'm using a measurement tool that is able to ...
1
vote
0answers
10 views

Is this a valid method for Multiple Testing correction?

A colleague described this multiple testing correction procedure to me some time ago. I can't find a source, searching just pulls up tons of literature and websites explaining the well known methods. ...
0
votes
0answers
20 views

Hypothesis Testing 3 variables from Survey, but survey data only shows frequencies

Here is an example of the data I'm working with. The data I have is larger and diverse but this is presented to illustrate my problem. n=100 $Income?$ 15,000: 15 15,0000-30,000 < : 45 30,000-45,000:...
2
votes
1answer
188 views

Test for proportions - which one to choose?

I have a general question regarding proportions. Let's say, for simplification of things, that I have 2 groups of subjects (treatment and control), and for each subject I measure success or failure (0 ...
1
vote
1answer
28 views

Which test to use to see if an item is signicantly more selected?

I'm trying to see if a given item is significantly more selected than the others. Let's imagine that I have 7 items A,B,C,D,E,F,G, and that think that most people (of a given group) will prefer to ...
0
votes
0answers
17 views

Hypothesis Testing and Z-test for happiness at work

I'm doing a school project and decided to look closer into this COVID-19 thing that is obviously going on at the moment. I have a hypothesis that people in teams (at work) are happier at work after ...
6
votes
2answers
3k views

LRT for one-sided Bernoulli parameter

Suppose $X_1,X_2,...,X_n$ are i.i.d. $\mathrm{Bernoulli}(\theta)$. We are interested in testing the hypotheses $$H_0:\theta\leq\theta_0$$vs. $$H_1:\theta>\theta_0$$ Show that if we use the ...
0
votes
1answer
34 views

A variable that affects the dependent variable and is affected by another independent variable

I was analyzing happiness records data. One of the variables was trust in government and I hypothesized that this variable does not have an actual impact on the happiness score. I believe that this ...
0
votes
0answers
11 views

Change Point Analysis, changes in mean or variance?

I am new to change point analysis, and have run a number of change point models using the below test statistics: Mann-Whitney Lepage Kolmgorov-Smirnov Cramer-von-Mises My understanding is that some ...
0
votes
2answers
47 views

Approach to maximum likelihood in logistic model

My question is very easy and probably banal, but I can't understand this concept and I found nothing on internet. Consider a logistic/logit model, for example with 3 covariates. We want to test the ...
0
votes
1answer
16 views

Comparing regression coefficients between models with dependent predictors and dependent criterions

I would like to compare regression coefficients between two models as part of a within-subject study setup. The problem is that both the predictors and criterions are likely to be correlated and that ...
0
votes
0answers
20 views

How can I determine statistically how well my estimator predicts actual results?

I have a business in which I contract with my clients to perform work for them for an indefinite amount of time. To forecast my profitability, I need to forecast when my existing contracts will end. ...
0
votes
0answers
12 views

Nyblom Harvey Test

I created in Matlab two independent random walk through the command: y = cumsum(randn(10000,2)) Although the series are clearly independent, when I try to run the ...
1
vote
0answers
13 views

Why ARIMA Ljung-Box p-values tend to decrease for large lag

I am a beginner at ARIMA model fitting. I have observed that after I fit my model, the Ljung-Box statistic tend to discard the null hypothesis for large lag. It could be that it is only random that it ...
1
vote
1answer
20 views

How to interpret the Score-Based CUSUM test results?

Context I'm doing an analysis of a price time series and checking for structural breaks (s.b. further on). One of these tests is the Score-Based CUSUM test. As far as I understand, this test is more ...
0
votes
1answer
31 views

Chi-squared vs. t-test for death rates (percentage data)

I have data regarding death rates (DR) for 5 different groups of people (A-E) as shown below. Groups A B C D E DR 1% 3% 2% 4% 3% samples 200 800 300 100 700 I'm trying to find out observed ...
0
votes
0answers
10 views

Multivariate Granger Test on Single Variables

Say I have some trivariate model with variables X, Y, Z. Now I want to know if X granger causes Y. To do this test I have used the causality() function in ...
0
votes
1answer
17 views

Comparing average success rates of varying sample sizes

I have the following data frame: ...

1
2 3 4 5
…
168