Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

0
votes
0answers
5 views

Two independent sample test one sided hypothesis test

Basic question: In a two independent sample test of differences in means, is it possible to have a one sided hypothesis? Typically, when you have 2 groups the two sample test only tests whether the ...
0
votes
0answers
16 views

How can I maintain a streaming value and be 95% confident that the measure for the population dropped below some value?

I weigh hail stones one at a time, producing a sequence of weights. I want to tell the weatherman when I'm 95% confident that hail stones are less than 50g in weight based on the previous $K$ hail ...
2
votes
1answer
30 views

Statistical criteria for signal registration

I want to find statistical criteria for signal registration (see picts). When I don't have a signal I have a simple gaussian two-dimenshial distribution. When I have a signal I have gaussian plus some ...
1
vote
0answers
13 views

A Hypothesis Testing Question and Verification

Suppose we have two p.d.f.'s: $f_0(x)=1,$ if $0\leq x\leq1$, and $f_0(x)=0$ otherwise $f_1 (x)=2x$ if $0\leq x\leq1$, and $f_1(x)=0$ otherwise We want to test the hypotheses ...
0
votes
0answers
9 views

Breusch-Pagan Test in Weighted Least Squares

When fitting an ordinary linear regression model, we can conduct a test for heteroscedasticity by applying the Breusch-Pagan Test. We fit the linear model, calculate the residuals, and then regress ...
4
votes
1answer
37 views

Post-hoc test for chi-square goodness-of-fit test

I'm conducting a chi-square goodness-of-fit (GOF) test with three categories and specifically want to test the null that the population proportions in each category are equal (i.e., the proportion is ...
2
votes
1answer
54 views

Permutation test: when the null hypothesis is **non**-equivalence of two models/predictors [on hold]

Suppose I have two models $M_1$ and $M_2$ and I want to compare their performances in terms of measure (accuracy on classification instances, i.e. number of correct predictions to size of all ...
0
votes
0answers
10 views

1 sample z test of proportions

We are trying to work out whether what we currently do is accurate. We want to work out if a proportion (% scoring 5 on a 5 point scale) are significantly below a target score. Normally a 1-sample ...
2
votes
1answer
30 views

Mixed effect modelling with multiple, nested random variable

Goal: comparing pitch (Hz) on three types of words Dependent variable: Hz Fixed predictor variable: word-type, points (measurements taken from five points on each token, to capture Hz change within ...
0
votes
0answers
12 views

test of correlation among binary variables prior to running logistic regression analysis

I am running a logistic regression analysis with binary variables on SPSS: dependent variable: preterm birth (Y/N) independent variables: hypertension (Y/N), diabetes (Y/N), C section (Y/N), ...
1
vote
0answers
20 views

Power analysis for AB testing— multiple variants

I'd like to do an experiment that is basically an A/B test with about 10 different conditions. A single trial results in either success or failure. The null hypothesis is that all of the conditions ...
5
votes
2answers
76 views

Test if 2 exponentially distributed datasets are different

I have 2 exponentially distributed datasets and I want to be sure that they are from different distributions. Unfortunately a necessary error in the detection of the data forces me to discard all data ...
1
vote
0answers
27 views

Test of differences in count data

I have observations from two data-sets outlining the number of nucleotide differences. Observations from the first data-set are from actual data and the second data-set contains simulated ...
0
votes
1answer
22 views

Asymptotic chi square tables?

I just need to calculate the value of the right hand side of the test statistic which is an asymptotic chi square distribution. How can I find those values? All I have is the normal chi square ...
1
vote
1answer
20 views

Developing probability distributions

An event occurs, and after this event has occurred there is a set of conclusions which can be drawn. All of these conclusions have results which are distinct. I am trying to keep this as general as ...
2
votes
1answer
41 views

One model performs better than the other. How to measure if it is statistically significant?

So, let's say that I train two models on the same dataset. I run the experiment once and I get the following results: Using a Neural Network I get an AUC ROC of 0.941. Using Random Forest I get an ...
0
votes
0answers
23 views

Criteria for signal registration

I want to find statistical criteria for signal registration (see pict). When I don't have a signal I registrate a simple gaussian two-dimenshial distribution. When I have a signal I have gaussian plus ...
3
votes
0answers
38 views

Finding a test statistic when you don't know the distribution?

I am working on this problem from my class and it has stumped me for a while now. I will show a picture of the problem and then my work/thoughts: Now we are not given the individual distribution of ...
0
votes
2answers
33 views

Why is this test statistic standard normal? Simple question

My textbook just says that the following test statistic is normal without actually going through the derivation. Here is the problem: Suppose that $X_1...X_n$ are iid RV with each being ...
3
votes
1answer
22 views

Distribution of test statistic under null and alternative

I am currently reading my econometrics notes and there is an example that has really stumped me. The example has an answer with it but I do not understand a few things: Now what I do not understand ...
1
vote
0answers
23 views

Uniformly Most Poweful Hypothesis test for the difference between two means

I have data for two groups, $G_1$ of n trials and $G_2$ of m trials, of which datasets $x_1$ and $x_2$ have been collected. These can be binomially distributed, $X_1$ ~ B(n,p), $X_2$ ~ B(m,q). I ...
1
vote
0answers
33 views

Comparing two vectors with the same numbers in different positions [closed]

I have two vectors of the same size representing one score for different sites (x and y coordinates) under distinct situations (each vector is one situation). At each vector the scores only change ...
0
votes
0answers
17 views

Hypothesis test with 1 observation [duplicate]

I'm attempting to tie classwork theory with an actual work example just now. Yesterday I attended a lecture on hypothesis testing and my notes and lecture slides cover hypothesis testing with one ...
3
votes
0answers
27 views

Asymmetry of the Kullback-Leibler distance in hypothesis testing

My question is related to the asymmetry of the Kullback-Leibler distance. I'm using the discrete definition of the Kullback-Leibler dinstance, so we have: $KL(p,q) = \sum_{s \in S} p(s) ...
0
votes
0answers
19 views

Is it possible to validate very small p-values via bootstrap?

Suppose I want to see whether the p-values generated by a certain parametric method are close to the “true” p-values. To avoid relying on any parametric assumptions, the latter are produced via ...
1
vote
0answers
30 views

Testing whether neighbors are more similar to each other than distant points

Suppose you have points x1...xn in a metric space X, each is associated with some measurement y1...yn. I want to test whether points closer to each other in X have similar associated value y. I have ...
0
votes
1answer
17 views

Test equality of coefficients in separate regressions when populations are not independent

I have three regressions with the same IVs. Equation 1: Y1 = X Equation 2: Y1 = X Equation 3: Y2 = X X is a vector of IVs with B1-B8 coefficients. Equations 2 and 3 are tested on the same ...
0
votes
0answers
11 views

Hypothesis testing method for a single measurement variable but three nominal variables

I'm finding it difficult to get a hard and true answer to which test I should use to determine whether the differences in my data are significant. In short: I have 1 measurement variable and 3 ...
1
vote
0answers
21 views

How to analyze data with DV only measured at the group level and moderator measured at the individual level?

This may be a relatively simpleton kind of question to ask, as this forum seems to be rather statistically sophisticated, but I'm rather mixed up right now. I ran a study that involved individuals ...
0
votes
0answers
24 views

Similarity measuring

I would like to statistically prove the hypothesis that a usability measuring method for websites yields similar results if applied by subjects with similar experience. The available data consists of ...
1
vote
0answers
17 views

Compare frequencies of categorical events between two groups

Selectively rendered animations (parts were rendered with higher quality than the rest) were shown to participants of an experiment. The animations were either with or without sound. Then the ...
1
vote
1answer
22 views

Compare cumulative distribution functions of several function point counters

Function point counters are used to measure the size of software. However, they are believed not to deliver exact results. Different measurements sometimes produce different results. The performance ...
0
votes
1answer
18 views

Significance test for 3 groups on gender?

I have three groups, and the quantity of interest is gender, either male M or female F. For example, ...
0
votes
0answers
16 views

Significance Test for two groups, and two time periods (Chi Squared?)

Apologies but as I am not well-versed in statistics, this might work best if I describe my data.Thanks for your patience. The exercise is that I'm testing to see if an advertising campaign had a ...
2
votes
1answer
48 views

Hypothesis Testing for survey

Suppose my null hypothesis is “Not more than 50% person prefer milk” and alternate hypothesis is “More than 50% (or majority) prefer milk”. Actually the null and alternate hypothesis are set so only ...
0
votes
0answers
22 views

Compare variable in two independent samples

There is a hypothesis that in online health communities influential members (higher reputation) tend to post more emotional support than regular members. Emotionality of answers were determined by a ...
0
votes
0answers
18 views

Compare two independent samples with one variable

It is assumed that in computer programming courses, students programming in pairs will have better grades than students programming alone (solo-programming). After collecting data about the grades of ...
1
vote
1answer
24 views

Differences between reviewers and people being reviewed in terms of learning achievement

An experiment about the review process was made. Participants were students visiting a course. One group had to solve some exercises and the other group had to review their work and give feedback. At ...
0
votes
0answers
21 views

Compare similarity of different scores

LSP (logic scoring preference) is a method for measuring usability of a website. Our hypothesis is that usability scores obtained using LSP for the same website are familiar across subjects with ...
0
votes
0answers
25 views

Analyze results of study

It is assumed that users of mobile devices can be incentivized to reduce energy utilization when frequent feedback of energy-related is provided. To test that hypothesis, a study was conducted. It ...
0
votes
1answer
50 views

Compare two groups

In an experiment, 20 project experts (10 from technical roles and 10 from non-technical roles) were instructed to estimate the effort required to complete a web development project.They could use ...
0
votes
0answers
21 views

Proving hypothesis in supply chain simulation

There is data about a simulated supply chain available. Cycle time, return on investment, and an index for the service level were calculated for different planning frequencies, forecasting errors, and ...
0
votes
1answer
34 views

Statistical test to prove correlation between different independent variables and dependent variable

Having information about different variables like age group, intensity of game playing, game violence, social intelligence, and parent-child communication of hundreds of children, how could the ...
2
votes
1answer
33 views

Why are one-sided hypotheses allowed only before seeing data?

A statistics textbook from openintro.org claims that: After observing data, it is tempting to turn a two-sided test into a one-sided test. Avoid this temptation. Hypotheses must be set up ...
1
vote
1answer
57 views

How can a Bayesian analysis say A < B, when both have only 0s?

I've used python to analyse data from AB tests using Bayesian analysis, and for all tests I assume no prior knowledge and so set alpha = beta = 1. However I'm ...
2
votes
1answer
28 views

Formulation of null and alternative to show two sets have similar mean

I have two sets of ratings between 1 to 5. The second set is generated using an algorithm, and I am currently trying to find the best set of parameters, so the ratings are similar to my first set. ...
2
votes
1answer
19 views

Which statistical test to use to test differences in multiple means (multiple populations)

I have 3 populations, let's call them cluster 1, cluster 2 and cluster 3. The data is continuous. I want to see if there's a difference between the means of the three clusters. I know that the t-test ...
1
vote
0answers
21 views

hypothesis test for discrete disributions

I am interested in the number of instances of feature $F$ among the members of two populations, $A_1$ and $A_2$. e.g. $F$ is a some special genetic element that may occur several times within a ...
2
votes
1answer
77 views

Computing the power of Fisher's exact test in R

Suppose that I have the following 3 x 3 contingency table: ...
1
vote
3answers
37 views

How can I run a t.test in this situation of two processes having binary outcomes

I have two processes, lets call them A and B. I want to infer whether their population means are equal for their experimental outcomes. Both of these processes generate 1s and 0s only. That is, the ...