Questions tagged [hypothesis-testing]
Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.
10,286
questions
0
votes
0
answers
4
views
Is two-sample Kolmogorov test working correctly?
I have two one-dimensional samples that I'm trying to quantifiably distinguish (or deny such distinction). I.e. the null-hypothesis is that they come from the same population (distribution?). The ...
0
votes
0
answers
6
views
When to reject the null of no significant dependence between two variables?
For the first question I calculate the sample correlation coefficient, so r=0.3987866 then I calculate t=1.229972759 and as |t|<2.306 (which is the t-critical) we don't reject the null hypothesis (...
0
votes
0
answers
12
views
Is it a must for a Null Hypothesis Significance Test (NHST) to be fixed-horizon/fixed-sample?
Null Hypothesis Significance Test (NHST) is a class of statistical tests that comes from blending procedures from Fisher’s Significance Test and Neyman & Pearson’s Hypothesis Test (see, e.g., Lew (...
- 1,282
0
votes
0
answers
17
views
A correct understanding of z-score confidence intervals with improper, informative priors [duplicate]
Please check that my understanding of hypothesis testing, confidence intervals, and their relation to the prior on population mean $\mu$ is correct.
Let $X_i\sim N(\mu, \sigma^2)$ be IID samples for $...
- 184
1
vote
0
answers
6
views
Mixed factorial anova with one IV
I have data that I am trying to analyse, but am not entirely sure if I am doing the right steps. It is a mixed design where every participant experienced condition A, then they were randomly assigned ...
- 11
1
vote
0
answers
4
views
posthoc paired t test
Is there a website with a calculator to input 2 sets of data to perform the post paired t test adjusted with the Bonferroni correction? Or is anyone available to hire?
- 11
1
vote
0
answers
12
views
Finding UMP test for composite hypothesis
Let $(X_i)$ be iid from a distribution proportional to $x^{\theta}1_{(0,1)}(x)$.
a) Find the most powerful test of size $\alpha$ of $H_0: \theta=0$ against $H_1: \theta=1$.
b) Find the UMP test of ...
- 11
2
votes
1
answer
55
views
Compare and find p-value between two t-tests
I am running a statistical test to determine if females are more influenced by the framing effect. I designed a survey with three overall questions, each with a "positive frame" and a "...
- 21
4
votes
1
answer
156
views
equal *population* variances in paired t test
I I want to perform a paired t-test to check if there's some effect, I have the distribution of "before" and the distribution of "after" the manipulation. Do I need to assume the ...
- 41
2
votes
1
answer
47
views
Likelihood Ratio vs Modified Frequentist Approach (CLs)
I'm a physicist trying to finally get a hold on practical statistics for particle physics and am having problem with the following -- I apologize for the lack of formality below.
Suppose the number of ...
- 121
0
votes
0
answers
7
views
Testing homogeniety within a bin of scores given max number of bins
I have a score (ranging from 0 to 1000) which predicts a binary event. The score is based on a regression. Scores are binned. There should be a maximum of $x$ (e.g. $10$) bins. Predicitions within a ...
- 249
0
votes
0
answers
24
views
Significance test for treatment when baseline of control and test groups are different
I have two groups of different sizes (control and test) and I want to measure the impacte of a certain treatment on the test group. Unfortunately, the control group has a different baseline compared ...
1
vote
0
answers
17
views
How to check significance for non-mutually-exclusive classes (references welcome)
Setting
There is a dataset in which every datapoint is a list of labels. While I don't have direct access to the whole of the dataset nor to the whole list of labels (I could probably arrange it, but ...
- 11
3
votes
1
answer
125
views
How to transform t-statistic into a statistic using median and IQR?
I want to calculate similarity between various samples, but I'm limited to only knowing the IQR and medians. I came across a similar problem
here but the top answer states that the newly proposed ...
- 31
0
votes
0
answers
5
views
Assessing Variation in Proportions and Describing Proportion Variability for Categorical Data Analysis
I am working with a dataset that consists of three different factory groups, each producing laptops and receiving feedback reports on their products. Each observation includes the total number of ...
0
votes
1
answer
22
views
How to perform a proportion test comparing noise proportions in different groups?
I have a dataset containing observations of wave lengths in milliseconds and the corresponding durations of noise in milliseconds. Each observation is labeled with a group (A or B) and a subject.
I ...
1
vote
0
answers
7
views
Hypothesis Test on Three proportional data with different sample size
I have three proportional data H1, H2, and H3. And my null hypothesis H0 would be H2-H1=H3-H2.
What would be the test statistics here? I tried to use the proportional test for H_0:P2=P1. But the test ...
- 11
1
vote
1
answer
40
views
IID assumption in proportion hyp test
I am asked to test a hypothesis that a manufacturing line makes p% faulty parts in a month, it's assumed that the p% is independent of the month. My approach is as simple as it gets, take a random ...
0
votes
0
answers
30
views
Trouble understanding $p$-values [duplicate]
In my textbook $p$-values are defined as follows:
$$p\text{-value} = P(T \text{ is at least as extreme as } t \text{ given } H_0 \text{ is true}) $$
where $T$ is the test statistic. It goes on to say ...
- 101
0
votes
0
answers
30
views
Testing independence of events (mass shootings in the US) [closed]
A common explanation for mass shootings is the "copycat effect," or that mass shootings inspire more mass shootings. If the copycat effect is true, we would expect the incidence of mass ...
- 1
0
votes
0
answers
14
views
What statistical method that I can use to compare mean of cases that selected from different studies?
I have a data that contains demographic information and primary variables (A,B,X,Y,Z) that extracted from past 20 years literature review. All those literature reviews are about case study, so in the ...
- 41
2
votes
1
answer
22
views
Testing correlation coefficients from two bivarate poisson
I have datasets from two bivariate poisson distributions, $BVP_x(\lambda_1, \lambda_2, \lambda_{12})$, and $BVP_y(\lambda_3, \lambda_4, \lambda_{34})$ respectively.
Now we know the correlation ...
- 121
0
votes
0
answers
10
views
What test to compare Deprivation Index between two groups
I have two very large independent groups (n=30,000 and 12,000). Each data point is an individual’s UK Deprivation Index decile (the Deprivation Index itself is a ranking from 1 to 32,844 of an area’s ...
- 3
1
vote
0
answers
8
views
Explainability of groups mix affect on overall mean
I am stuck on understanding the best way to approach this problem from a purely statistical/mathematical way.
Say that I have this data in the table below. It shows the comparison of prices for one ...
- 11
2
votes
2
answers
67
views
Distribution and variable analysis
I am doing a statistical test (program used is SPSS). On the basis of distribution and sample size, I have to chose the correct variable analysis. I also have to justify every decision. I have two ...
- 21
3
votes
1
answer
45
views
Best statistical test for comparing two random forest models, where each has a different set of variables available for modeling?
What is the best statistical test for comparing two random forest models, where a different set of variables is made available for each model? I need a test where a power test can be used to justify ...
- 363
1
vote
1
answer
33
views
Synthetic control method based on several treated units
I am trying to causally evaluate an impact of a specific labor policy that was implemented in three U.S. states. I wonder if constructing a synthetic/artificial control method (SCM) for those states ...
- 71
0
votes
0
answers
16
views
What are some relevant statistic calculations?
I applied a test for attachment and 2 different tests for internet addiction to 114 highschool students. All tests have a Likert scale 1-5. My hypothesis is that the attachment and internet scales ...
- 1
2
votes
1
answer
30
views
Testing correlation coefficient of two bivariate gaussian
I have datasets from two bivariate normal distributions, $\mathcal{N}(\mu_x, \Sigma_x)$, and $\mathcal{N}(\mu_y, \Sigma_y)$ respectively. Now we know the correlation coefficient for these two ...
- 121
10
votes
2
answers
132
views
The probability of making a Type S error, and the average amount of magnification (type M error) as a function of power
When you filter on only viewing results with p<alpha, some of those "statistically significant" results go in the wrong direction. This is called a Type S error ("S" for sign). ...
- 18.4k
0
votes
0
answers
17
views
How to test the directionality trend and significance of a set of vectors?
I calculated a directionality map, where at each point (x,y) I have a jackknife sample (n=8) of 2d vector displacements $\vec{D}_k$ ($k=1,...,8$ are the black ...
- 171
0
votes
1
answer
43
views
How to test for a equality of the mean of two bounded random variables
Good morning all together,
as a statistics rookie, I'm facing the task how to test for a difference in the mean of two random variables that are bound between 0 and 1. Both their means are positive ...
- 101
0
votes
0
answers
8
views
MANOVA for a Moderator variable?
I just did a MANOVA to investigate the effect of the my IV on my three DV's.
However, now I want to see if my Moderator Variable has anything to do with it. Can I just put my MV as a covariates? It ...
2
votes
0
answers
48
views
Help with determining statistical significance of bees’ decisions
Firstly, my apologies for the basic nature of this question. I am numerate but stats has always befuddled me. I have had a look through earlier questions.
I have installed a red mason bee box. It has ...
- 21
1
vote
1
answer
39
views
A/B testing and Experiment Length
I have a conceptual question to ask that may come off dumb, but I'm just trying to see if I understand A/B testing properly as I've only studied it but not worked much in practice.
Let's say we are ...
- 71
3
votes
1
answer
137
views
How does the assumption that the distribution must be fully specified when using a Kolmogorov-Smirnov practically impact comparison of distributions?
As specified here on the NIST website, the 3rd assumption for the K-S test is "... the distribution must be fully specified. That is, if location, scale, and shape parameters are estimated from ...
- 85
1
vote
1
answer
27
views
Interpreting Mixed Model ANOVA
In a 3 (condition) X 2 (time) mixed model ANOVA. If I hypothesised that anxiety in group A will increase from time 1 to time 2 and my results found no significant interaction but a significant main ...
2
votes
1
answer
21
views
Which statistical test should I use to compare two groups where their opinions are collected by using Likert Scale?
I want to find out a solution to the following question: "Is there is any impact of social media on the creation of entrepreneurial opportunity for rural women?"
I have 2 groups: Online ...
0
votes
0
answers
12
views
How to test for size (Typ one error probability) on Breusch-Pagan Test in R?
The data i created contains heteroscedasticity. I already calculated the power so my idea was to basically do the same but switch the hypothesis so that H0: Heteroscedasticity and H1: Homoscedasticity ...
user388641
0
votes
0
answers
81
views
Construction of a statistical test for a test statistic that fluctuates between 0 and 1
I'm working on a project where we currently take a look at some sort of efficiency measure, where we numerically integrate the area under the efficient frontier up to the current portfolios' ...
- 101
0
votes
1
answer
29
views
Testing the significance of a multiple R value from a multiple regression
I'm an AP Statistics student (high school senior) doing a final project investigating the correlation between an "overall score" as the response variable and five different "subscores&...
- 3
0
votes
0
answers
10
views
Hypothesis testing to compare 2 bernoulli processes that generate purchase data
I have 2 large samples from a population of users that checkout from our product offering website and generate certain sales, say r1 and r2. Each sample is from using a different price, say r1=\$20 ...
- 101
0
votes
1
answer
43
views
Statistical test to see wheter there are differences within a single dataset [closed]
I have a list of mean precision values (and their standard deviation) that resulted from a pool of different tests. So I have 63 values of mean precision and 63 values of stdev.
I want to check ...
- 1
1
vote
0
answers
46
views
Sample population for AI Study
I have a study. I have 150 AI-generated images and 150 human-generated images. I have created a survey where respondents are given 10 images randomized from these 300 images. For each picture, they ...
0
votes
0
answers
28
views
Comparing frequency of events between two groups?
I have an analysis question that I need some help on. I received an analysis request to identify events that have statistically different frequencies between two groups.
For example, assume I have ...
- 165
0
votes
0
answers
18
views
Can an ADF-test distinguish between stationarity and trend stationarity?
I am learning Time series analysis and I am studying the augmented Dickey Fuller test. My understanding of the null hypotheses is clashing with all the explanations I find online and in books. I refer ...
- 1
2
votes
1
answer
42
views
Generalized Likelihood Ratio Test - Why is the denominator a union
For GLRT, the ratio is:
$$
\Lambda^* = \frac{\max_{\theta \in \omega_0} L(\theta)}{\max_{\theta \in \omega_1}L(\theta)}
$$
but we instead use:
$$
\Lambda = \frac{\max_{\theta \in \omega_0}L(\theta)}{\...
- 23
1
vote
0
answers
9
views
How to apply heteroscedasticity tests in model with ARIMA errors? [closed]
How to use heteroscedasticity tests in model with ARIMA errors?
- 47
2
votes
1
answer
38
views
Are normal errors required for OLS with a large sample size?
It's surprisingly difficult to find a clear answer to this online. Nearly every online source claims that error terms must follow a normal distribution for statistical inference but stops short of ...
- 21
0
votes
0
answers
23
views
Doing T-test across two data sets to validate null hypothesis
I have two features. I need to perform T-test for these two datasets but with the same model.
...
