Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

0
votes
0answers
9 views

test of correlation among binary variables prior to running logistic regression analysis

I am running a logistic regression analysis with binary variables on SPSS: dependent variable: preterm birth (Y/N) independent variables: hypertension (Y/N), diabetes (Y/N), C section (Y/N), ...
1
vote
0answers
17 views

Power analysis for AB testing— multiple variants

I'd like to do an experiment that is basically an A/B test with about 10 different conditions. A single trial results in either success or failure. The null hypothesis is that all of the conditions ...
5
votes
2answers
75 views

Test if 2 exponentially distributed datasets are different

I have 2 exponentially distributed datasets and I want to be sure that they are from different distributions. Unfortunately a necessary error in the detection of the data forces me to discard all data ...
1
vote
0answers
25 views

Test of differences in count data

I have observations from two data-sets outlining the number of nucleotide differences. Observations from the first data-set are from actual data and the second data-set contains simulated ...
0
votes
1answer
22 views

Asymptotic chi square tables?

I just need to calculate the value of the right hand side of the test statistic which is an asymptotic chi square distribution. How can I find those values? All I have is the normal chi square ...
1
vote
1answer
19 views

Developing probability distributions

An event occurs, and after this event has occurred there is a set of conclusions which can be drawn. All of these conclusions have results which are distinct. I am trying to keep this as general as ...
2
votes
1answer
40 views

One model performs better than the other. How to measure if it is statistically significant?

So, let's say that I train two models on the same dataset. I run the experiment once and I get the following results: Using a Neural Network I get an AUC ROC of 0.941. Using Random Forest I get an ...
0
votes
0answers
13 views

Criteria for signal registration

I want to find statistical criteria for signal registration (see pict). When I don't have a signal I registrate a simple gaussian two-dimenshial distribution. When I have a signal I have gaussian plus ...
3
votes
0answers
34 views

Finding a test statistic when you don't know the distribution?

I am working on this problem from my class and it has stumped me for a while now. I will show a picture of the problem and then my work/thoughts: Now we are not given the individual distribution of ...
0
votes
2answers
32 views

Why is this test statistic standard normal? Simple question

My textbook just says that the following test statistic is normal without actually going through the derivation. Here is the problem: Suppose that $X_1...X_n$ are iid RV with each being ...
3
votes
1answer
22 views

Distribution of test statistic under null and alternative

I am currently reading my econometrics notes and there is an example that has really stumped me. The example has an answer with it but I do not understand a few things: Now what I do not understand ...
1
vote
0answers
22 views

Uniformly Most Poweful Hypothesis test for the difference between two means

I have data for two groups, $G_1$ of n trials and $G_2$ of m trials, of which datasets $x_1$ and $x_2$ have been collected. These can be binomially distributed, $X_1$ ~ B(n,p), $X_2$ ~ B(m,q). I ...
1
vote
0answers
33 views

Comparing two vectors with the same numbers in different positions [on hold]

I have two vectors of the same size representing one score for different sites (x and y coordinates) under distinct situations (each vector is one situation). At each vector the scores only change ...
0
votes
0answers
17 views

Hypothesis test with 1 observation [duplicate]

I'm attempting to tie classwork theory with an actual work example just now. Yesterday I attended a lecture on hypothesis testing and my notes and lecture slides cover hypothesis testing with one ...
3
votes
0answers
23 views

Asymmetry of the Kullback-Leibler distance in hypothesis testing

My question is related to the asymmetry of the Kullback-Leibler distance. I'm using the discrete definition of the Kullback-Leibler dinstance, so we have: $KL(p,q) = \sum_{s \in S} p(s) ...
0
votes
0answers
19 views

Is it possible to validate very small p-values via bootstrap?

Suppose I want to see whether the p-values generated by a certain parametric method are close to the “true” p-values. To avoid relying on any parametric assumptions, the latter are produced via ...
1
vote
0answers
30 views

Testing whether neighbors are more similar to each other than distant points

Suppose you have points x1...xn in a metric space X, each is associated with some measurement y1...yn. I want to test whether points closer to each other in X have similar associated value y. I have ...
0
votes
1answer
17 views

Test equality of coefficients in separate regressions when populations are not independent

I have three regressions with the same IVs. Equation 1: Y1 = X Equation 2: Y1 = X Equation 3: Y2 = X X is a vector of IVs with B1-B8 coefficients. Equations 2 and 3 are tested on the same ...
1
vote
0answers
20 views

How to analyze data with DV only measured at the group level and moderator measured at the individual level?

This may be a relatively simpleton kind of question to ask, as this forum seems to be rather statistically sophisticated, but I'm rather mixed up right now. I ran a study that involved individuals ...
0
votes
0answers
24 views

Similarity measuring

I would like to statistically prove the hypothesis that a usability measuring method for websites yields similar results if applied by subjects with similar experience. The available data consists of ...
0
votes
0answers
16 views

Compare frequencies of categorical events between two groups

Selectively rendered animations (parts were rendered with higher quality than the rest) were shown to participants of an experiment. The animations were either with or without sound. Then the ...
0
votes
0answers
16 views

Compare cumulative distribution functions of several function point counters

Function point counters are used to measure the size of software. However, they are believed not to deliver exact results. Different measurements sometimes produce different results. The performance ...
0
votes
1answer
18 views

Significance test for 3 groups on gender?

I have three groups, and the quantity of interest is gender, either male M or female F. For example, ...
0
votes
0answers
16 views

Significance Test for two groups, and two time periods (Chi Squared?)

Apologies but as I am not well-versed in statistics, this might work best if I describe my data.Thanks for your patience. The exercise is that I'm testing to see if an advertising campaign had a ...
2
votes
1answer
48 views

Hypothesis Testing for survey

Suppose my null hypothesis is “Not more than 50% person prefer milk” and alternate hypothesis is “More than 50% (or majority) prefer milk”. Actually the null and alternate hypothesis are set so only ...
0
votes
0answers
22 views

Compare variable in two independent samples

There is a hypothesis that in online health communities influential members (higher reputation) tend to post more emotional support than regular members. Emotionality of answers were determined by a ...
0
votes
0answers
18 views

Compare two independent samples with one variable

It is assumed that in computer programming courses, students programming in pairs will have better grades than students programming alone (solo-programming). After collecting data about the grades of ...
1
vote
1answer
24 views

Differences between reviewers and people being reviewed in terms of learning achievement

An experiment about the review process was made. Participants were students visiting a course. One group had to solve some exercises and the other group had to review their work and give feedback. At ...
0
votes
0answers
21 views

Compare similarity of different scores

LSP (logic scoring preference) is a method for measuring usability of a website. Our hypothesis is that usability scores obtained using LSP for the same website are familiar across subjects with ...
0
votes
0answers
25 views

Analyze results of study

It is assumed that users of mobile devices can be incentivized to reduce energy utilization when frequent feedback of energy-related is provided. To test that hypothesis, a study was conducted. It ...
0
votes
1answer
46 views

Compare two groups

In an experiment, 20 project experts (10 from technical roles and 10 from non-technical roles) were instructed to estimate the effort required to complete a web development project.They could use ...
0
votes
0answers
20 views

Proving hypothesis in supply chain simulation

There is data about a simulated supply chain available. Cycle time, return on investment, and an index for the service level were calculated for different planning frequencies, forecasting errors, and ...
0
votes
1answer
33 views

Statistical test to prove correlation between different independent variables and dependent variable

Having information about different variables like age group, intensity of game playing, game violence, social intelligence, and parent-child communication of hundreds of children, how could the ...
2
votes
1answer
32 views

Why are one-sided hypotheses allowed only before seeing data?

A statistics textbook from openintro.org claims that: After observing data, it is tempting to turn a two-sided test into a one-sided test. Avoid this temptation. Hypotheses must be set up ...
1
vote
1answer
56 views

How can a Bayesian analysis say A < B, when both have only 0s?

I've used python to analyse data from AB tests using Bayesian analysis, and for all tests I assume no prior knowledge and so set alpha = beta = 1. However I'm ...
2
votes
1answer
27 views

Formulation of null and alternative to show two sets have similar mean

I have two sets of ratings between 1 to 5. The second set is generated using an algorithm, and I am currently trying to find the best set of parameters, so the ratings are similar to my first set. ...
2
votes
1answer
19 views

Which statistical test to use to test differences in multiple means (multiple populations)

I have 3 populations, let's call them cluster 1, cluster 2 and cluster 3. The data is continuous. I want to see if there's a difference between the means of the three clusters. I know that the t-test ...
1
vote
0answers
21 views

hypothesis test for discrete disributions

I am interested in the number of instances of feature $F$ among the members of two populations, $A_1$ and $A_2$. e.g. $F$ is a some special genetic element that may occur several times within a ...
2
votes
1answer
75 views

Computing the power of Fisher's exact test in R

Suppose that I have the following 3 x 3 contingency table: ...
1
vote
3answers
35 views

How can I run a t.test in this situation of two processes having binary outcomes

I have two processes, lets call them A and B. I want to infer whether their population means are equal for their experimental outcomes. Both of these processes generate 1s and 0s only. That is, the ...
1
vote
1answer
52 views

Self Selection bias for estimating a valiable correlated to the selector

I am trying to find a way to see if a measured variable between two groups is significantly different. This would normally be done through a t-test if the two groups were randomly selected from the ...
4
votes
1answer
67 views

Solving formula for confidence intervals on two proportions

I'm interested in comparing two independent proportions from two samples. The formula for doing so is available in the Internet (e.g. here). So far, so good. But my main purpose is not to build a ...
2
votes
2answers
42 views

Output of chisq.test in r

I have a question regarding the below output from a chi-squares test, which I find to be confusing and contrary to my expected results - my chi-squared value is infinity here :) I have two questions ...
7
votes
2answers
139 views

What is the null hypothesis of a MANOVA?

Background In order to analyze differences in some continuous variable between different groups (given by a categorical variable), one can perform a one-way ANOVA. If there are several explanatory ...
2
votes
0answers
19 views

Alternatives to Fisher's method?

I'm using the Mann-Whitney U test to compare scores from a foreground (n ranging between 5-500) to a large background (up to 2000). Since my foreground is quite small I've been taking smaller random ...
2
votes
1answer
65 views

two-sample KS test: data becomes significantly different after normalization

I'm currently working on a data set with two sets of samples. The csv file of the data could be found here. I would like to use KS test to see if these two sets of samples are from different ...
0
votes
2answers
24 views

Test for unimodal symmetric distribution

I am trying to test whether data from a sample I have follows a t distribution with n degrees of freedom for a given n. I am looking for something more powerful/recent than Kolmogorov-Smirnov test. ...
1
vote
1answer
36 views

paired t-tests and interpretation of results

My study is about comparing the scores a group of students (sample, N=14) in two different conditions. They play the same game in a tablet and using a computer. They were administered with a ...
1
vote
0answers
23 views

Hypothesis testing, find $n$ to limit type II errors

I'm trying to solve the following (basic) problem, but I don't seem to get the last part 3). The average lifespan of a certain mechanical part is set to be at least 2 years by experts. The ...
1
vote
0answers
19 views

How to test if model can explain data?

I have a purely deterministic system-theoretic background, so please bear with me if this is elementary. The question is related to: How to test whether a series data follow Ornstein-Uhlenbeck ...