Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

1
vote
0answers
17 views

Three binomial random variables: test null that no two have equal mean

I have a dummy variable for health (0 or 1), and for each observation a treatment (one of three possible treatments for each observation). I want to test the null hypothesis that the proportion (mean) ...
0
votes
0answers
21 views

May I treat two subject groups as if they were one when attempting to demonstrate the existence of an effect?

I have collected data from 88 human subjects. There is two subject groups, A (test) and B (control). Number of subjects in each group is 44. The subjects are paired between groups. There is two ...
-1
votes
0answers
24 views

How to test whether two gamma distributions have the same mean

What is the appropriate test of whether two gamma distributions have the same mean? I've tried t.test, but my sample size is small. ...
1
vote
2answers
29 views

Can I test hypothesis based on estimated parameters?

I estimated the mean and variance of two latent variables through two groups of data. I can't use the data to do hypothesis testing, because I am interested in the latent variable. Is there a way to ...
1
vote
1answer
24 views

Partially orthogonal planned comparisons

I am comparing 8 means and want to set up a planned comparisons, rather than having my Bonferroni adjustment become overly-conservative in a post-hoc. For my groups I need to make a total of 16 ...
0
votes
0answers
8 views

3x2 design - data analysis ANOVA/MANOVA? How to add interaction in the model?

Discription of experiment I am researching "The effect of review valence and brand commitment on consumer's purchase intention" for my university thesis. I conducted a 3x2(no review/positive ...
0
votes
0answers
8 views

which test to use here to test the significance of overlap with respect to a control?

i'm not sure what statistical test to use to compare a scenario like this: I have a list of candidate regions A (560k regions) and I want to know if my candidate regions enrich for a particular set ...
0
votes
0answers
9 views

Evaluating productivity metrics in an A/B test system

I'm beginning work on an A/B testing system for UX changes to a tool my team builds. Our users are doing simple, repeatable tasks assigned by another team's system. My team handles the UI/UX part. ...
4
votes
2answers
66 views

Help for planning a neuroscience experiment

I'm new here. I am planning a neuroscience experiment. I will be measuring brain signals from about twenty subjects. I will present the subjects four different kinds of stimuli. After all the data ...
0
votes
0answers
21 views

Bayesian mean square error

Given a i.i.d sample $X_{1},..,X_{n}$ of bernoulli random variables test 2 hypotheses $H_{0}:p=2/3$ and $H_{1}:p=1/3$. Bayesian prior is $\pi(2/3)=1/3$ and $\pi(1/3)=2/3$. Find the bayesian criterion ...
0
votes
0answers
18 views

Difference test between 2 groups where both groups contain depended and independent observations

Is there a statistical test to check the difference between groups (for example a paired sample proportion test), but where some of the observations of the two groups are dependent and some of the ...
2
votes
0answers
22 views

How would I find the P-Value of this data?

I have the following data (relating to consecutive months at current job): Mean: 45.4 Standard Deviation: 60.89 Sample Size: 48 I am asked to do a one-tailed test at a 1% significance level and ...
1
vote
1answer
23 views

Probability of Two Samples Containing Overlapping Data

Quick question about sampling a data population that contains non-overlapping data: if I take two samples of 50 from a population of 100,000 unique data points, how would I calculate the probability ...
1
vote
0answers
42 views

Poisson distribution confidence interval

Edit : this is the data I used for the first part of the problem : \begin{matrix} Rocks & 0& 1& 2& 3& 4& 5& 6 & 7\\ samples & 12& 27& 28& 19& ...
0
votes
0answers
34 views

Testing for the compatibility of inferences

Consider that I have two balances (called 1 and 2). Each of these balances gives a posterior distribution for the weight of the object of the form $m_1 \pm s_1$ (for balance 1) and $m_2 \pm s_2$ (for ...
0
votes
0answers
20 views

Comparing two means and need to know if they are statistically different

I have the net revenue from 81 companies in one year and I'm comparing to the net revenue of the same 81 companies 3 years later. How do I compare (simple subtraction of the means or t-test?), and how ...
0
votes
0answers
19 views

How to test the mean difference of two Gamma distributions

If I don't have the data, but only have the estimates of mean and variance of two independent Gamma distributions. What type of test I can use to test the null hypothesis μ1=μ2?
0
votes
1answer
13 views

F-test formula under robust standard error

I am attempting to write a program that will (among other things) use the F-test in multivariate regression under standard robust errors. I am having trouble finding a specific formula for the ...
0
votes
1answer
26 views

impact on hypothesis if t-stat is equal to t-critical value for one-tail two-sample t-test? [duplicate]

I have a two-sample t-test where the t-statistic is equal to the critical t-value (at three decimal points) at a p-value of 0.05. does this mean i reject the null hypothesis or the opposite? thank you ...
2
votes
1answer
74 views

Hypothesis testing on Poisson Binomial distribution

Imagine $N$ baskets each filled with a different number of products chosen from a set $P$. It is possible to have repeated products in the same basket. For instance: ...
1
vote
1answer
53 views

Interpretation of Maximum likelihood estimation

I have some problem to interpret the result of MLE estimation : Is it possible to get some advise about how to interpret it? the log likelihood function : $\sum^{n}_{i=1}\log\left( \phi\left( ...
4
votes
1answer
35 views

Testing equality of coefficients from two different regressions

This seems to be a basic issue, but I just realized that I actually don't know how to test equality of coefficients from two different regressions. Can anyone shed some light on this? More formally, ...
2
votes
1answer
63 views

Non parametric Wilcoxon Signed Rank test

I have the following data vector(in fact its 2392 data points long): ...
9
votes
1answer
163 views

Testing whether two regression coefficients are significantly different (in R ideally)

If this is a duplicate question, please point to the right way, but the similar questions I've found here haven't been sufficiently similar. Suppose I estimate the model $$Y=\alpha + \beta X + u$$ ...
1
vote
0answers
8 views

Fligner Wolfe test and 2-sample Wilcoxon test

What is the significant difference between the Fligner Wolfe test and 2-sample Wilcoxon test? How can I compare the treatment groups with the control groups of different studies after pooling?
3
votes
1answer
38 views

Determine if many coins are fair

Imagine I have many coins ($>100$), and for each coin I have the data: $(n_{\rm heads}, n_{\rm tails})$ where $\sum(n_{\rm heads}, n_{\rm tails})$ is decreasing for each next coin. Any one of the ...
0
votes
0answers
20 views

How to compare the results of two classifiers are statistically significant different?

I am applying kNN and SVM classifiers to my classification problem. Both of the classifiers get over 95% cross-validation accuracy (leave one out cross validation used). Not sure how to tell if the ...
1
vote
1answer
33 views

Multiple testing problem - can these test results be caused by chance?

I conduct 30 independent significance tests on $p<.05$. I observe that in $X=3$ cases the test is rejected. Can this event be caused by chance due to a multiple testing problem? I understand that ...
0
votes
0answers
10 views

sequential testing and hierarchical tesing

With respect to the hypothesis testing, I once heard sth such as sequential testing, hierarchical testing, and multi-level testing. But I could not find a good reference discussing these topics. Any ...
3
votes
3answers
72 views

Which test for this data set of chemical concentrations

I have a very simple data set: a parameter (concentration of a chemical) was measured at day 0, day 1 and day 2 in three subjects (there is a control group as well, but here all the values are always ...
2
votes
1answer
32 views

Wilcoxon rank sum test methodology

I'm comparing the performance of two algorihtms $A$ and $B$ based on a metric. For each algorithm, I have $31$ independent samples that represent its performance. This samples are grouped in two ...
1
vote
0answers
25 views

Regression - volatility vs return

I am attempting to estimate a linear model as: $$ y = a +bX +e $$ I have a series of annual returns and I would like to estimate the effect of volatility on losses. My Null hypothesis is that ...
1
vote
1answer
77 views

How to compare subjects with different weights?

I have a collection of products that could be rated as good or bad. Every product has a grade, that is the sum of "good" votes minus the sum of "bad" votes. These products are also split into two ...
0
votes
0answers
18 views

Significant box's test equality covariance matrices, How bad it is?

Having equal number of cases across two groups (60 total cases), if one wants to perform a split-plot Anova and finds out that the Box's Test of Equality of Covariance Metrices is less than 0.001 then ...
0
votes
1answer
19 views

Hypothesis testing with the geometric distribution for dummies

I'm a newbie at stats and I need some help. Can anybody tell me, in the most "stupid friendly" way, how to perform hyphotesis testing with a geometric distribution for 2 samples? please take into ...
1
vote
1answer
35 views

Is it reasonable to make inferences to the population from non-parametric tests?

I just had it put to me that one can not reasonably make inferences from non-parametric statistics. This strikes me as absurd as the logical rational supporting counter-factual resampling/rank order ...
0
votes
0answers
17 views

Hausman test VS Mundlak model; the choice between fixed and random effects

I am using panel data and I have to choose between fixed-effect and random-effect models. I run the Hausman test, the H0 (i.e., the difference in the coefficients from the two models is not ...
0
votes
0answers
13 views

SEM for Non-Normal Ordinal Data

In short, I conducted a satisfaction survey in which surveyees are required to answer on a satisfaction scale from 1 to 7: 285 observations, 37 satisfaction variables. Here is an example of what the ...
1
vote
0answers
29 views

Detecting time-shifted time series

Assume there are two time series of real values. How to test hypothesis, that these series are quite the same, but there is a time shift between them? Sorry, if the question is too basic. Thanks in ...
0
votes
1answer
73 views

How to get P-Value when t value is less than 1?

I am doing an assignment for class and I have hit a wall. I'm not sure what to do next. Using a sample with 12 discrete elements, I am trying to test a hypothesis that the population mean is 243 ...
1
vote
1answer
16 views

Test to compare an effect on a variable on a daily basis

I would like to know the effect of an external factor on the number of visits on a website during a period of 4 weeks (only search visits from Google). For this, I measured the number of visits every ...
0
votes
0answers
15 views

Q-Value Less than P-Value

I have a list of p-values from a series of regression equations. Many of these P-values are small. To compute false discovery rate I have been using the q-value package in R. I notice, based on this ...
0
votes
0answers
10 views

R: Shapiro-Wilk test with relation of W and P-Value? [duplicate]

I'm currently learning about the Shapiro-Wilk test for normality and using R for conducting simple experiments. One thing which is confusing me is that I found some results would produce a high W ...
1
vote
0answers
28 views

bootstrapping for a parameter estimation

At the moment I'm studying bootstrap and I want to do some examples to get a feeling for it. Suppose I generate the following data: ...
1
vote
0answers
15 views

Intuition For Overlapping Confidence Intervals and Statistical Significance [duplicate]

Two questions: I have a really hard time with the intuition for why the second part of this statement is true: If two statistics have non-overlapping confidence intervals, they are ...
7
votes
2answers
188 views

Can a narrow confidence interval around a non-significant effect provide evidence for the null?

It is obviously fallacious to assume that failure to reject the null implies that the null is true. But in a case where the null is not rejected and the corresponding confidence interval (CI) is ...
5
votes
2answers
157 views

What could be a statistical test for comparing funnel data before and after important changes?

I have some funnel data from a website I manage. After some time I did some improvement on a multi-step purchase process. I wonder if it's possible to formulate a test that with statistical ...
0
votes
0answers
10 views

NPS confidence intervals with bootstrap

I am looking for a method to find confidence intervals for NPS (net promoter score). One method was already suggested here. But I am thinking of using bootstrap. Do you think the following procedure ...
0
votes
0answers
44 views

One-Sample t Test and Likelihood Ratio Test

Concerning testing the hypotheses about the mean $\mu$ of a single population I know of things like the One-Sample $t$ test where there is a null hypothesis: $H_0: \mu = \mu_0$, and a test statistic ...
0
votes
0answers
16 views

the non-rejection region in level of significance approach eqaul to the area determined by upper and lower bounds in confidence interval approach

For $H_0: \hat \beta=\beta^*$ I want to prove that the non-rejection region in level of significance approach Will be eqaul to the area determined by upper and lower bounds in confidence interval ...