Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

Filter by
Sorted by
Tagged with
0
votes
0answers
2 views

multiple chi-squared tests where variables for the multiple tests come from the same distribution

There is a distribution which assigns probabilities to events of the type: {0,1} x L where L is a set of labels (happens to have 4 elements but I don't think that is important). call the first ...
0
votes
0answers
8 views

hypothesis testing for 2 unequal vectors of proportions

I need some statistical advice. I have 2 vectors of proportions ( all values between 0 and 1 ) of an item in a sample. For example : Vector1 has 20 observations and vector2 has 28 observations. I want ...
0
votes
1answer
7 views

How to intepret a test statistic in terms of the equation outcome = model + error

I am reading Andy Field's An Adventure in Statistics. In the book, he mentions that all statistical models are basically a variation of the equation: $outcome_i = model + error_i$. For the sake of ...
2
votes
3answers
122 views

How do you make sure the hypothesis test really works?

Let’s suppose the following: We are statistician, machine learner, data analyst, and so on, working for a company which produces tires for trucks. The company produces tires per hour with the ...
0
votes
1answer
11 views

Multivariate Testing

I have an ab test with two factors (color of image and size of image). Is the correct methodology to do these steps (assuming I want to do a full factorial): Calculate the f-stat for the control (...
0
votes
0answers
13 views

Hypothesis testing multiple proportions

Need help on my research! We are introducing a new process in 2021 which might affect customer returns behavior. My data is in proportions which is total number of returns of total number of units ...
0
votes
1answer
21 views

Intuitive Multiple Comparison Correction

Question: Basically, I have a list of p-values and need to find how many of them are statistically significant. 32% of p-values in my list are less than alpha (0.05). Intuitively, it would make sense ...
1
vote
0answers
10 views

Breusch Godfrey test, problem with matrix singularity

I am currently conducting Breusch-Godfrey tests to see if the residuals of a regression are uncorrelated. For this purpose I am backing out the residuals of the regression: $$ X_t=B_0+B_1X_{t-1}+u_t $$...
0
votes
0answers
26 views

T-test for *relative* difference in means — how?

I have different variables for health data reported by ~500,000 respondents who are sorted by gender (M and F) separately within two regions (I and II). When I calculate the means of the data grouped ...
3
votes
1answer
31 views

MOOC on Causal analysis - Recommendations for software engineer

Am a software guy with no background in causal inference. While I am now familiar with prediction techniques due to plethora of courses available online, I would like to seek recommendations from ...
0
votes
1answer
19 views

R function to find difference in mean greater than or equal to a specific number [closed]

I have just started my basic statistic course using R and we're studying using R for paired t-tests. I have come across questions where we're given two sets of data and we're asked to find whether the ...
0
votes
1answer
9 views

What is the significance of adding two significant trend?

Consider significant time-series (a) and (b) from a p-value < 0.05. If I add both time series together to obtain time-series (c). Will time-series (c) always be significant or can it be ...
1
vote
1answer
12 views

Ljung-Box Q-test result variation

I am conductin Ljung-Box tests to test the autocorrelation/serial correlation of a variable. My results confuse me a little bit and I don't really know what to conclude from them. For q = 1,2,3 (...
2
votes
1answer
19 views

How to calculate z-score of binomial values for an ab test

I ran an ab-test and now I'm trying to calculate the pvalue. The test and control are binomial and these are the values To get the variance, I used the variance formula from here https://stattrek....
0
votes
1answer
20 views

If market opt-out is happening due to contacts through campaigns

I am relatively new to statistical analysis. I have a scenario. There are various campaigns through which the customers are contacted. Only customers with their marketing preference as 'Yes' are being ...
0
votes
0answers
10 views

Joint hypothesis testing: How to set up restricted model for equality of more than 2 coefficients?

Say I am running the following regression: $Y=\beta_0 + \beta_1X + \beta_2Z +\beta_3W + othercontrols + error$ I want to test the null hypothesis that the first three coefficients are equal, or: $H_o =...
4
votes
2answers
119 views

Emperically testing a “p-test” (of multiple fair coin flips)

In a previous question, I asked how to test if a coin is fair. Now I want to empirically test if this test works. One answer is that programs like R and python have built-in "binomial p-tests&...
1
vote
0answers
16 views

Integrating over the rejection region to find average probability of Type II error for a range of values

In Wackerly Mathematical Statistics the author states that you can only compute the probability of a Type II error for a single given specific value in the rejection region. Wouldn't it be possible to ...
0
votes
1answer
49 views

Infer power from the distribution of a test statistic

Is it possible to infer the power from the distribution of a statistic? For instance, let's assume we are dealing with a Wald statistic, calculated from 2 survival $\beta$ coefficients. Under the ...
1
vote
1answer
44 views

Independant Two-Samples t-test with N > 30

I have two groups of data (N > 30 in each group). I want to know if the two groups differ from each other. So I thought about making an independent t-test. But then I remembered that the groups ...
2
votes
0answers
24 views

Random walks and martingales

In class, our professor explained that the martingale process is the in between case of random walk type I (innovations are i.i.d.) and random walk type II (innovations are serially uncorrelated). ...
0
votes
0answers
9 views

Different Random Walk Types and the Variance Ratio test

From my knowledge, we distinguish between two types of random walks. Type I, where the innovations are i.i.d. and Type II, where the innovations are serially uncorrelated. I want to conduct several ...
0
votes
0answers
9 views

Statistical comparison of two different treatments of unequal sample sizes to know which one is better performing?

I am performing two different treatments (say T1, T2) on same dataset. I want to know which treatment has better performance (on the basis of multiple error measures). Also these two treatments and ...
0
votes
0answers
5 views

Compare gene coverage across group o samples

Hello, I have a matrix data where rows are samples(40 in one group and 40 in the other), columns genes(20k) and the value is the coverage. Like this Sample Group Gene1 Gene2 Gene20000 S1 A 100 200 .....
1
vote
1answer
25 views

Calculate sample size for Fisher Exact Test

I'm researching the role of sender reputation in remediating Android vulnerabilities using large-scale notification campaign. There are 2 senders with different reputations and 1 as a control (no ...
1
vote
1answer
17 views

How to interprate random effects in an lme model in R [closed]

I am having trouble understanding the results of my lme model. Could someone tell me how to understand the random effects? Here is my model: ...
0
votes
0answers
18 views

AB Test Sample Size calculation in python [closed]

I'm trying to calculate the sample size of an ab test in python. I saw someone answered this at: Create an A/B Sample Size Calculator using Evan Miller's Post Their answer is below: ...
1
vote
1answer
18 views

Methods for comparing two different models on similar problem domains

Suppose I provide predictive models estimating the likelihood someone (for the sake of argument, say recent college graduates only) defaults on a mortgage loan. One of my customers, before having had ...
0
votes
0answers
8 views

hypothesis testing between two conditions with multiple, nested sub-conditions

I'm struggling to find the appropriate way to test the following data. I'm repeating measures of a response variable on a set of ~200 individuals, the independant variable being a qualitative variable ...
0
votes
1answer
22 views

Bias of standard errors as estimates

I'm reading on the standard errors used in various hypothesis tests. For example, in tests of one population proportion, we use $\sqrt{p(1-p)/n}$. For comparison of two population proportions, we use $...
0
votes
0answers
8 views

A12 effect size over leave one out validation

How can I find A12 effect size between two models while doing leave-one-out validation. The issue is that these two models don't have same number of samples. Basically model2 is using samples which ...
1
vote
1answer
25 views

Which test to use with this 2 x 2 contingency table?

Which text could be appropriate for this 2 x 2 table: the occurence of 2 species at an archaeological site ...
0
votes
0answers
9 views

Compare two treatments for effectiveness - Beginner

Let's say I have a target population of Type 2 Diabetes population and I would like to see which of the below 2 treatments works better for them. For ex: Treatment 1 = Drug A + Drug B Treatment 2 = ...
0
votes
0answers
25 views

Binomial AB Test - binomial test vs normal approximation

I want to run an ab test on two groups of people If I use the binomial test I get a p-value of 0.007355 ...
0
votes
1answer
30 views

Test for significant differences for data between 0 and 1

I have to test for significant differences between scenarios. Data consist of the length of a segment divided by the total length of the network. They are distributed between 0 (never equal to 0) and ...
1
vote
1answer
18 views

Statistics: Hypothesis testing to find p-value

I am currently writing a thesis in machine learning and I am trying to use t-test to show that my model is better than the current state of the art. The dataset I used has 16 different tasks and each ...
0
votes
0answers
45 views
+50

Which test to use when comparing multiple sets of proportions (with unknown sample size)?

I have two conditions, about 50 samples for each condition, and for each sample - a set of 9 proportions. The proportions are estimates of the proportion of 9 cell types of this patient. Clarification ...
0
votes
0answers
14 views

How to determine the statistics of a null hypothesis if if it's an inequality and not an equality?

in a statistical test, how do we determine the statistics to work with if the null hypothesis is an equality. Example : we are testing if a certain population $A$ of 10000 individual has a certain ...
1
vote
0answers
23 views

Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
1
vote
0answers
24 views

Struggling to understand what a “confidence interval” is (In problem involving multiple coinflips)

Following this question, I am trying to learn the math behind checking whether a coin is fair. While user @BruceET provides an outline of the overall math to get there, I am still stuck on the basic ...
0
votes
1answer
38 views

Hypothesis testing to check if a distribution is uniform

I am asked to check if a categorical distribution with $3$ variables is uniform, which means each variable has $\frac{1}{3}$ probability in the real population. (Required significance level: $0.01$) ...
5
votes
2answers
193 views

Testing the difference in distribution between two groups

within the framework of an exercise, I have 2 factors: a type of animal & a database ...
2
votes
1answer
55 views

How does Pinsker's inequality provide “a lower bound for the error of certain hypothesis testing problems”?

Whilst flicking through Concentration Inequalities: A Nonasymptotic Theory of Independence by Boucheron, Lugosi and Massart (2016), I came across the following incidental remark: The importance of ...
1
vote
0answers
13 views

Predicting events - seizures in epilepsy. A question about time series models matching with observations

I've been keep a diary of epilepsy seizures, and would like to attempt prediction modelling as an help for better management of anti consultant therapy. Could you help to suggest models that fit with ...
0
votes
0answers
20 views

How to test if data follows a half-normal distribution?

There are many ways to test if the data comes from normal distribution. like this post But the question is how to test if the data follows half-normal distribution? I know Ks-test, but as the post ...
0
votes
1answer
15 views

ANOVA for four groups where individuals appear in each group

I would like to calculate an ANOVA between four groups. Each group has 82 elements, i.e. for each group I have a vector of size 82. The groups describe the average typing speed on the left side of the ...
0
votes
1answer
35 views

Predicting class attendance given only attendance probability [closed]

In a class, the teacher observed that about 95 percent of the time there are about 31 to 49 students attending his class. If the students attend a class with a fixed probability and independent of ...
1
vote
2answers
26 views

What statistical test is appropriate for a pretest/posttest experimental/control group study?

I thought this would be a relatively straightforward question, but I'm having difficulty finding a decisive answer. Let's say I'm planning to run a study to test the effectiveness of a new type of ...
1
vote
0answers
14 views

A problem regarding hypothesis testing with Poisson population

I'm looking at the following problem and the solution is: I have a few questions regarding this answer: What's the motivation for calculating the probability that $X\leq 10$? From my understanding ...
1
vote
1answer
40 views

Hypothesis testing for two-samples

I have some questions regarding the process of choosing the appropriate statistical test. While I was working in my previous company, we were using T-test, Welch or Mann-Whitney for checking the ...

1
2 3 4 5
171