Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

2
votes
0answers
10 views

Number of significant linear predictors if predictors are not independent?

I would like to determine which of a set of candidate predictors $\{x_1, x_2,\ldots, x_n\}$ are significantly relevant to the linear prediction of $y$. Typically, one can compare a full model ...
1
vote
1answer
29 views

Comparing coefficients of two variables: one is significant, the other is not significant

I'm trying to test whether the coefficient for one independent variable ($X_1$) is larger than coefficient for another variable ($X_2$) in predicting the dependent variable ($Y$). For example, my ...
1
vote
0answers
9 views

Comparing file sizes day on day for outliers, what test to use?

I am quite new to statistical analysis, and have to crunch through several thousand folders/files each day to, at a first glance, see if the file size indicates an error (too large/small etc). The ...
1
vote
1answer
15 views

Statistical significance in binomial variable: how many tests needed?

I have a problem that occurs randomly, in approximately 2 % of tests. I am testing fixes, to prevent the error from occurring. The error occurring once would mean it is still happening and would ...
-4
votes
0answers
15 views

Conduct a hypothesis test of each regression coefficient [on hold]

A regional planner is studying the demographics in a region of a particular state. She has gathered the following data on nine counties. Country Median Income Median Age Coastal A $48,725 ...
2
votes
0answers
26 views

Is binary hypothesis testing a better statistical term than A/B testing?

Is binary hypothesis testing a better statistical term for what business intelligence often refers to as A/B testing? Wikipedia suggests that this is the term used withing the statistics community but ...
0
votes
0answers
4 views

Testing dispersion of values between condition on a group

I may have a tricky question. I have a within design where every participant is tested in 2 conditions. I want to compare the dispersion of the measure, for the two condition, with the hypotheses that ...
2
votes
1answer
73 views

Does one group respond differently from others

I'm looking for the best way to test the hypothesis that two groups are different considering the relationship between two variables. There is a population of individuals and, for each individual ...
0
votes
0answers
6 views

Confidence size and coverage probability in a confidence set?

Let $\theta \in \Theta \subseteq \mathbb{R^d}$ be the parameter of interest and let $\theta_0$ be the true population parameter value. Let $n$ be the sample size. Let $CS_n$ be the confidence set ...
0
votes
0answers
10 views

R - power.prop.test, prop.test, and unequal sample sizes in A/B tests

Say I want to know what sample size I need for an experiment in which I'm seeking to determine whether or not the difference in two proportions of success is statistically significant. Here is my ...
1
vote
0answers
8 views

Joint test for absolute value of a mean [duplicate]

How can I test than the mean of a variable is greater than or equal to -3 and less than or equal to 3? In other words I want to test if the absolute value of the mean is less than or equal to 3. ...
2
votes
0answers
15 views

Significant difference between proportions, found at sample size below that suggested by power analysis

I'm looking at data from experiments that have been run to look for a difference between proportions, 1-tailed. In many of these it has been found that there is a significant difference between the ...
0
votes
0answers
6 views

Comparing IRFs derived from Bayesian VARs with other extraneous information

I was wondering if anyone here could help me with the following: I estimate a standard Bayesian VAR with Normal-Inverse Wishart priors. I identify some policy shock in it, and then derive the IRF for ...
2
votes
0answers
31 views

Are significance tests only about sampling error or other forms of variation also?

When we study differences between a treatment and control group in an experimental setting, we want to test whether those differences are big enough that we can conclude they are not simply due to ...
2
votes
2answers
112 views
+50

Comparing performances during a race between 2 groups, which test should I use?

Imagine I organized a race between 2 types of ants. Type A and B. At the end of the race, I have the ranking, which looks something like : ...
0
votes
0answers
15 views

Test mean for discrete data [closed]

This is a hypothetical case. I would like to conduct a survey on how many times people visited the cinema in the previous month. I would like to confirm whether the mean value I obtained from my ...
4
votes
2answers
232 views

Interpreting one- and two-tailed tests

How do you report results that give you a p-value of 0.08 for a two-tailed test and a p-value of 0.04 for a one-tailed test? Generalizing the issue, if you obtain a p-value between 0.05 and 0.9999 ...
0
votes
0answers
19 views
0
votes
0answers
13 views

Determine minimum number of observations to be checked manually

I'm trying to classify transactions (say credit card transactions) as good or bad without looking at it manually. (The only way to figure out whether a transaction is good or bad is by manually ...
4
votes
2answers
139 views
+50

Drawing numbered balls from an urn

PROBLEM There is an urn with a set of balls where each ball is labeled with a different integer. The numbers on the balls are known and are not a range of integers. For example the set of balls could ...
4
votes
1answer
52 views

Goodness of fit likelihood ratio test with zero values

I have a vector of observed frequencies that have zero values in some cells and a vector of expected frequencies generated by a model. I would like to do a likelihood ratio test rather than a chi ...
4
votes
2answers
140 views

Why is it wrong to refer to results as being “highly significant”?

Why do statisticians discourage us from referring to results as "highly significant" when the $p$-value is well below the conventional $\alpha$-level of $0.05$? Is it really wrong to trust a result ...
2
votes
1answer
38 views

correct statistical test to compare 2 poisson distributions

I know there are similar posts, and I've read a few of them already, but none of them give explanations that I actually understand. I'm completely new to statistics and am finding it more difficult ...
0
votes
0answers
37 views

Where can I find unit tests for evaluating my student t-test?

I have written a paired t-test and I am looking for some standard unit tests that I can make sure my code is correct. Do such tests exist? How does R take care of unit testing for its t.test()?
0
votes
0answers
36 views

Chi-square test for one group

I'm struggling with this problem. For the analysis of my test, I was instructed to use chi-square test for one group. I use Statistica and everywhere I try to do this I need the expected values​​, ...
3
votes
0answers
93 views

Better estimator of expected sum than mean

I am trying to find the optimal estimator for the maximal expected $\Sigma X_i$ where $X_i$ is sampled from an unknown distribution which is chosen to be maximal. To clarify and simplify, there are ...
0
votes
1answer
18 views

How can I create a testable hypotheses to compare benchmark results for the same tests run in 3 environments

I am planning on running the same benchmark tests (i.e. throughput, response time,..) in 3 environments: 1) a mobile device, 2) a virtual machine in VirtualBox, 3) a virtual machine on Amazon EC2. ...
1
vote
0answers
13 views

Chi-squared test where observations can have multiple categories

I am investigating patterns in click-order on images. A user is asked to click on an image in 5 places (can be the same place). This sequence of 5 clicks makes up a graphical password. I am looking ...
0
votes
0answers
32 views

What is a correct way to test these data for significance?

I have data on 1548 disease cases and 1137 controls. Specifically, for each person, I have a certain score $n$. I am interested in the following: First, for either group, I want to know if the ...
3
votes
2answers
53 views

Hypothesis testing if two random variables come from a related underlying function

I have observations of two random variables $S_1(t)$ and $S_2(t)$ and I'm trying to build a test to see if they are related. In other words I'm trying to test if unknown functions $F_1(t)$ and ...
4
votes
0answers
34 views

appropriate hypothesis test for non-negative quantity

This question is intentionally written in a very abstract way, because I am interested in a generic solution, or for pointers to different possible concrete cases in different fields: I am measuring ...
1
vote
1answer
19 views

Which test should be used when paired data (pre/post treatment) have different distributions?

My question is if data are in paired groups (before and after treatment), where the pre-treatment group is normally distributed and the post-treatment group is not normally distributed (i.e. it is ...
-1
votes
1answer
23 views

Hypothesis Testing terminology [duplicate]

I am studying now Hypothesis Testing. I use for it book High-Yield Biostatistics, Epidemiology, and Public Health and videos of Brandon Foltz (recommending these ...
0
votes
0answers
14 views

Pearson Correlation with symmetric pairs?

I am correlating two features in the leaves of a dendrogram for a given tree distance (2,3,...). When i find the pair "A-B" at distance x I will also have the duplicate "B-A" in the same set for ...
1
vote
0answers
20 views

Statistical test on pairs of percentages

I am quantifying a measure of correlation in a graph/network under two different experimental conditions to determine whether there is a significant difference in the measure given by the change of ...
0
votes
1answer
41 views

FDR (multiple testing correction) with skewed p-value distribution

I am confused with multiple comparisons adjustments. I have a $p$-values with lot of ones ( due to many scores in foreground are 0) from a fisher-exact test. I get some $p$-values which are ...
4
votes
1answer
41 views

Proper Number of Clicks for Conversion Rate Testing

I need to track the conversion rate of a landing page. I want to figure out how many clicks I need to get before I can be sure that I have an accurate conversion rate calculation. I first figured I ...
5
votes
2answers
77 views

Data on a circle - testing if points are close to another given point

I have a set of points that lie on a circle, and I know their angles. Is there a way that I can test whether they are closer to another point x on the circle than ...
1
vote
0answers
8 views

Identify significant deviations (gaps) of points in a 2-D distribution

Consider an $X_i$, $Y_i$ distribution of points in a 2D plane. How can one assess if a given region in this 2D plane has a significant lack of points when comparing with the rest through a ...
1
vote
1answer
51 views

Which test to use to compare means of groups with overlapping data?

I have 7 groups of data. I want to test if there is a significant difference between these groups of data. However, some of this data is overlapping. ie. some data in Group 1 might be in group 3. ...
0
votes
3answers
70 views

Large sample size for t-test

I am working on a physics experiment, and I ran 500 runs to calculate a parameter. I want to use the t-test to see if my mean from 500 runs matches the actual value. u0: mean is actual value u1: ...
3
votes
2answers
189 views

Is p-value also the false discovery rate?

In http://surveyanalysis.org/wiki/Multiple_Comparisons_(Post_Hoc_Testing) It states "For example, if we have a p-value of 0.05 and we conclude it is significant the probability of a false discovery ...
1
vote
0answers
6 views

Counterpart of Chow test for Least absolute deviations (regression analysis)

Does is exist counterpart of Chow test for Least absolute deviations method in analytical or not version ? In least absolute deviations we minimize sum of absolute values of errors.
1
vote
0answers
49 views

Good Reading/Bibliography

Before posting this question, I searched CV for a similar question that could helped me, but I didn't find one. So, I'm sorry if this has already been asked before. So, I'm self-studying from Keith ...
1
vote
0answers
36 views

Identify points significantly outside a regression model

I would like to update my previous question "Methods to determine reliability of measurements using median and median absolute deviation". I have data from biological experiments, that look like ...
1
vote
1answer
32 views

Can I hypothesise an insignificant mediation? (Very basic stats)

This is for a simple psychology report. I was wondering if I could hypothesise an insignificant mediation. Eg: "...based on this research it is predicted that group identity is not a significant ...
0
votes
0answers
11 views

Test if Two Categorical Samples Have the Same Joint

It seems to me that the standard way to deal with the problem of testing wether two multivariate samples of categorical data have the same joint probability distribution is to employ a goodness-of-fit ...
2
votes
0answers
39 views

Methods to determine reliability of measurements using median and median absolute deviation

I have several datasets containing hundreds of variables, measured at the same time point and with the same method. Some of these variables have been measured more often and assume consistent values. ...
2
votes
2answers
59 views

Test whether there is a significant difference between two groups

I have some trouble with the last test I need to perform for my bachelor thesis. I have two variables and I need to test whether there is a significant difference. The first variable has all the ...
0
votes
1answer
39 views

Unknown null-distribution, known alternative distribution

I'm rather new to statistics, so please bear with me. I would like to be able to say "to within 95% confidence, this data is exponentially-distributed." In this case, I know how the data should be ...