Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

Filter by
Sorted by
Tagged with
0
votes
0answers
2 views

Implementing permutation tests in randomized controlled trials with repeated measures

I am trying to implement a permutation test to use for testing treatment effects in a repeated measures RCT-design. Unfortunately I am having some trouble understanding how to design a correct ...
1
vote
0answers
10 views

What statistical test should I use with count data?

In my experiment, participants are shown 4 images (A, B, C, D) that they have to rate on a 5 point scale. So my data looks like this: particpant1: A 5, B 3, C 3, D 1 p2: A 4, B 3, C 2, D 4 p3: A 4, B ...
0
votes
0answers
10 views

Alternatives of permutation test to proof that a model performs better than chance level

I built a model based on a very high dimensional data, which requires 4-5 days to built using High Performance Computing (HPC). I want to do a statistical test to proof that the predictive power of my ...
0
votes
0answers
14 views

Runnning a pearson's correlation for two variables that change from a third factor [closed]

I have a covid-19 dataset that I'm trying to analyze. This dataset is a time-series dataset and has many columns such as Date, number of new cases, and number of new vaccinations. To find out whether ...
1
vote
0answers
22 views

Why is the probability of a type 1 error, $\alpha$, the significance level?

I've seen this stated Why are p-values uniformly distributed under the null hypothesis? and https://support.minitab.com/en-us/minitab-express/1/help-and-how-to/basic-statistics/inference/supporting-...
-2
votes
2answers
28 views

Categorical ordinal data: which test is better?

I have the following data: Group very bad bad quite good good very good A 12 20 11 29 14 B 20 10 6 11 34 Group A receives training, group B doesn't which test is appropriate for this kind of data?...
1
vote
1answer
19 views

Evaluate the increase of a variable (in Likert scale) for a subgroup of the population in a poll

Let's say we do a poll/survey for $n=250$ people, and we study a variable in a Likert scale with 7 possible values (-3 to +3): ...
1
vote
0answers
15 views

Designing an experiment to compare how multiple SMOTE variants affect multiple classification models on multiple datasets

For a university paper I want to test a hypothesis that one particular SMOTE variant outperforms two other SMOTE variants. By 'outperforms' I'm looking at using the F1 measure. I want to test this ...
0
votes
0answers
20 views

How accurately would the approval rating polls predict the election outcome? [closed]

How accurately would the approval rating polls predict the election outcome? When Trump consistently had a 10% margin of likely voters against him wouldn't this sufficiently prove that he lost fair ...
0
votes
0answers
5 views

Statistical test for comparing performance metrics of two regression models on a *single* validation dataset?

What is an appropriate way to apply a statistical hypothesis test for evaluating model performance metrics (e.g. MAE, MAPE, MSE) between two regression models based on a single holdout (validation) ...
0
votes
1answer
15 views

Durbin vs. Breusch-Godfrey test for autocorrelation: which is better?

I'm being asked to justify why I use either the Durbin's alternative test for Serial Correlation or the Breusch-Godfrey test. It seems that both are relatively competent tests however there is little ...
0
votes
0answers
13 views

Is this a valid method to test textual difference?

For some research I am trying to reject/ not-reject the null-hypothesis that the proportion of a word is higher in a certain sample of a text than in the rest of the text. The full text is a ...
0
votes
0answers
5 views

Appropriate ways of analyzing the influence of two independent variables on a reaction time?

I have the following experimental data. The dependent variable is a reaction time which has been measured on n = 30 test subjects. The reaction time was measured six times per test subject and the ...
0
votes
0answers
14 views

What's the z-test of the compare column proportion in spss tells us?

I have two categorical variable - 1.Status - what is the occupation of the customer. 2. loyal - if a customer is loyal or not And I am trying to do hypothesis testing. My null hypothesis is that there ...
1
vote
1answer
25 views

Hypothesis testing with time autocorrelated data

I have a dataset such as the following: ...
0
votes
0answers
9 views

How to manually calculate the p-value of a t-test arising from a hypothesis test on the coefficient of a linear regression model?

Suppose we have a linear regression model $$ Y = \beta_0+\beta_1X + \epsilon $$ and wished to test $H_0 : \beta_1 = 0$ vs $H_1 : \beta_1 > 0$. How can I explicitly write out the form of the p-value ...
0
votes
0answers
13 views

What are the minimum and maximum values for the Type-I and Type-II error probabilities of a hypothesis test?

My professor asked this question in a video lecture recently and said it should be something we could "derive" on our own. However, I'm having a hard time wrapping my head around the ...
1
vote
0answers
20 views

What-If Scenario Regression Modelling

I'm pondering a scenario involving some insurance data but this could be relevant in many fields. The idea is that I have a total count of some event. Let's imagine this count is the # of attorney ...
0
votes
0answers
12 views

Formulating the null hypothesis when the depended variable is a ratio involving the independent variable

I face the following simple regression model: $$ \widehat{rdexp}=\hat{\beta}_{0}+\hat{\beta}_{1}log(sales) $$ where $$ \widehat{rdexp}=\frac{RD}{sales} $$ and $RD$ is some positive number. I am having ...
0
votes
0answers
4 views

Statistical test to examine multiple attributes' effect on an outcome

I want to compare different attributes of a population and see if one is more indicative of an outcome measurement than the other. In a general case, suppose I want to examine $k$ attributes. Each ...
0
votes
0answers
9 views

Statistically compare accuracy of several CNNs | data independence & k-fold crossvalidation

I want to set up several CNNs, give them different input data (e.g. an nDSM or an orthophoto) and then test, if the runtime and the accuracy are significantly different from each other. How can I ...
0
votes
1answer
19 views

Intuitive understanding of hypothesis testing with Z-scores

I wanted to dig a bit deeper into hypothesis testing and fresh up my conceptual understanding from undergraduate courses. The typical way of how hypothesis testing is teached is to calculate the Z-...
0
votes
0answers
11 views

Find the decision boundary in bernoulli distribution

I encountered this question but I find some obstacles to convert this problem into a t-test format, can you guys give me some hint? Thanks! Your local casino acquires some new slot machines, which the ...
1
vote
0answers
17 views

How to test the null hypothesis that two linear regression lines have the same Y value for a particular X value?

I am using ancova to test if two linear regression models are the same and it works great. I am following this tutorial: http://www.biostathandbook.com/ancova.html and I apply it in R with this ...
0
votes
2answers
26 views

Best test to use for investigating if the difference between means is significant?

I'm studying the length of stay for patients in a hospital. I have a sample of n=4533 observations. Each of these observations are assigned to an admin group numbered between 1 and 8, based on the ...
0
votes
0answers
7 views

Is this log-log plot that is produced in SPSS sufficient to PH?

How do you graphically test proportional hazard assumption in Cox regression in SPSS? Should I put the variable in the "block" or "Strata" in SPSS? This log-log plot is produced in ...
0
votes
0answers
21 views

Is it statistically valid to perform two linear regressions to approximate a test for a U-shaped distribution?

Consider a sample dataset with a putative U-shaped distribution. I want to test whether the U-shaped relationship is statistically significant. Specifically, if y signficantly decreases as a function ...
0
votes
0answers
15 views

Testing the assumption of Mann-Whitney U Test: compare distribution shapes

If I want to use Mann-Whitney U Test to compare medians, how can I test distribution shapes for identity? The only way I am able to suggest is to centralize samples with respect to their medians (...
0
votes
0answers
7 views

What test statistic for the hypothesis that early events affect future events?

Consider you observe a series of events occurring over time where an event's time is denoted by $t_i$ ($i=1,2,...$). That is, you observe a vector $t = (t_1, t_2, ..., t_k)$ for $k$ events. Your ...
0
votes
0answers
6 views

How to measure the effect of a group without individual information over time

I would like to hear your thoughts on how to test the following effect. A group of n people is recorded performing a specific task. Each recording is rated between 0 - 30 (30 being best). After having ...
1
vote
1answer
27 views

Which assumptions should be checked for regression tree to validated model?

I am working with regression tree. I have four predictors. There is a exponential relationship between predictor and dependent variable. But after building predictive model I cannot understand whether ...
0
votes
1answer
46 views

Question related to statistics inference [closed]

I've a sample of 25 students with their expected % of marks in science exam. Out of 25 students 5 are expecting that they will get > 80% . I need to estimate no. of students who are who are highly ...
0
votes
1answer
16 views

What is the minimum number of samples that you need per group in a Western blot in order to perform a hypothesis test?

I am doing Western blot data analysis and I have 2 groups of values. I want to perform a statistical test to compare the means of the two groups to see if there is a significant difference. I am ...
1
vote
1answer
22 views

Comparison of 12 measurements in 2019 and 12 measurements in 2020 of the number of individuals in a facility. What is the best method?

I need to compare attendance measurements within the same facility, taken each last day of the month in the year 2019 and the year 2020. So I have 12 measurements in 2019 e 12 measurements in 2020. ...
0
votes
1answer
28 views

Appropriate Statistical Test for Likert Data?

I am having trouble deciding the appropriate statistical test to use for a given experiment. In the study, participants first recorded various feelings on a 4 point Likert scale. Ex: How much do you ...
0
votes
0answers
7 views

Comparing sub-groups for individual differences [closed]

I have a binary predictor. The positive category is comprised of multiple sub-groups, e.g., an example is positive if A, B, C or D is true. My question is, do any sub-groups perform better or worse ...
0
votes
0answers
17 views

implementation of $\chi^2$ test in python

I'm trying to check if a set of data has a Poisson distribution and for that I'm trying to implement a chi square test. My input data is an array that counts the amount of events registered in 1 ...
0
votes
1answer
25 views

Determine observed t from 2 means from set of values

"A study was conducted to compare the costs of supporting a family of four Canadians for a year in different foreign cities. The lifestyle of living in Canada on an annual income of 75,000 ...
0
votes
0answers
20 views

Paired Hypothesis Testing with Conversion Samples

Let's assume I have 100s of websites on which I am tracking conversion. At some point I change something to all websites. I want to measure if there is a statistical significant difference between my ...
0
votes
0answers
22 views

How to perform this test for the fairness of a coin?

Suppose the task is to test whether a coin is fair (i.e. has equal probabilities of producing a head or a tail). If the coin is flipped 100 times and the results are recorded, the raw data can be ...
0
votes
1answer
25 views

How to carry out the hypothesis test in this example from wikipedia?

This is an excerpt from the wikipedia article on test statistics: Suppose the task is to test whether a coin is fair (i.e. has equal probabilities of producing a head or a tail). If the coin is ...
0
votes
2answers
29 views

Chi Square Test on small sample size

I have the following dataset and I am trying to run a Chi-square test between the control and pilot. The only issue is that, for a Chi-Square test to return proper results, the sample size need to be ...
1
vote
0answers
17 views

How to test whether or not a category (month) affects a continuous distribution (latitude, longitude)?

I am trying to answer a question as to whether or not the month of the year affects the geographical distribution of hurricanes in the Atlantic ocean. I know for example about hurricane season, and ...
1
vote
0answers
21 views

Should a rejection rule be inclusive or exclusive? [closed]

I'm a bit confused on when we have >= vs > in a rejection rule. Are they equivalent? I'm learning stats right now and I'm not 100% sure why my teacher has it as a less than vs while many sites ...
0
votes
0answers
17 views

Probability of a Protein Sequence [closed]

I am trying to find a way to calculate how improbable for certain protein sequence to exist due to random chance. For example: Take this protein sequence: "ddvlsldeddddsdyncgednd" I want to ...
1
vote
1answer
29 views

Additional steps when fail to reject null hypothesis

My understanding of the hypothesis test below is: $H_0: \theta_0$ = 0 ; $H_A: \theta_0 \neq$ 0 given $\alpha$ = .05 if my p-value is < .05 I reject the null in favor of the alternative then: ...
1
vote
2answers
38 views

Finding a type 1 error

Suppose that $T_1,…,T_{10}$ are iid $Exp(λ)$ and the goal is to test if $H_0:λ≤1$ versus $H_a:λ≥2$. Suppose that the test statistic is $S=\sum_{i=1}^{10}T_i$, and rejection of the null occurs when $S≤...
2
votes
2answers
60 views

Which statistical test to compare same model with different parameters?

I have two datasets on people buying apples based on weight and price. One dataset in 2019 the other in 2020. I estimate a logit model with Utility = betaWeight * weight + betaPrice * price. Training ...
0
votes
1answer
27 views

Presenting the assumptions of Pearson's chi-squared test with Yates' Correction

One of the assumptions of Pearson's chi-squared test (for independence) is that expected frequencies are all >=5 in a 2x2 table OR 80% of the expected frequencies are >=5 in larger tables. If ...
0
votes
0answers
24 views

Is it correct to have null hypothesis as the hypothesis of interest?

Consider the question whether a variable x1 at time t is a predictor of variable x2 at time t+1. If the estimated mean difference between them is ~ 0, then we have evidence that the answer is yes. I ...

1
2 3 4 5
166