Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

0
votes
0answers
9 views

How do I perform a Kolmogorov test for the beta distribution, in Stata? [on hold]

I'm trying to perform the Kolmogorov test for a beta model in Stata, however as far as I can find so far, in Stata I can only do this test for a normal distribution. So, does anyone know if the ...
0
votes
0answers
8 views

How can you make the Kolmogorov-Smirnov test on stata for a beta model? [on hold]

I need to make the Kolmogorov-Smirnov test in stata for a beta model, and i don´t know what is the command for this model. Thanks
1
vote
0answers
5 views

Statistically verifying distribution of users within an A/B Test

Hoping you can help me determine the best way to statistically verify that an A/B test was set up in an unbiased way. The A/B test was set up to split users on my website 50/50 into a test/control ...
0
votes
2answers
54 views

What follows if we fail to reject the null hypthesis?

What conclusions can we draw if p>alpha? Does not rejecting the H0 mean anything?
0
votes
1answer
12 views

Why are the Wald standard errors often very poor estimates of the uncertainty of variances?

As from this post as @Ben Bolker pointed out that : .. note that these (as often pointed out by Doug Bates) the Wald standard errors are often very poor estimates of the uncertainty of variances, ...
0
votes
0answers
11 views

Wald confidence interval

Are Wald Type confidence interval and confidence interval based on asymptotic standard normal distribution synonymous ? Can you please give me some reference ?
19
votes
12answers
622 views

Why would parametric statistics ever be preferred over nonparametric?

This may be a stupid question but it's been bugging me for years. Can someone explain to me why would anyone choose a parametric over a nonparametric statistical method for hypothesis testing or ...
0
votes
0answers
12 views

Statistical significance of the Lorenz curve (Gini index)

What would be the best way to statistically compare results from the Lorenz curves (a number of curves plotted on the same graph)? I know that these curves can be expressed in terms of Gini indices, ...
1
vote
3answers
68 views

How to test $ H_0: \mu=0 \quad \text{vs.} \quad H_a: \mu=1$?

The Statement of the Problem: Let $X_1,..., X_n$ be a random sample from $N(\mu, 1)$. Consider testing $$ H_0: \mu=0 \quad \text{vs.} \quad H_a: \mu=1. $$ Let the rejection region be $C = ...
0
votes
1answer
18 views

Statistic test for comparing two methods? [on hold]

I don't have very good knowledge about statistical testing. Accept my apology if my question sounds stupid. I have developed two methods for competing discomfort level of communities. one is static ...
1
vote
0answers
8 views

What is the purpose of specifying a “control” in an A/B/N split test?

I define control as the currently accepted, best known variation. The test to be performed would introduce n new variations. Each variation will be served randomly for the duration of the test. I am ...
0
votes
0answers
13 views

Aggregate Pseudo-Paired T-Tests

I would like to determine whether there is a significant difference between two different servers with regard to run-time. My data is split into subgroups each of which is a different Page. The same ...
0
votes
0answers
21 views

Statistical test with unequal sample sizes

If I have two samples with vastly different sample sizes (say n1 = 800 and n2 = 21,000) what statistical test would give me the most reliable results? I've been using the Mann Witney U test. Is the ...
0
votes
0answers
15 views

Accepting or rejecting hypothesis in two tail test

I have calculated the t value and p value which is 2.08 and 0.045 on the basis of two different samples having different number of obs, mean, and variance. Can I conclude that the calculated p value ...
0
votes
1answer
19 views

compare multiple algorithms in the same dataset

I want to do a comparison between multiple algorithms when they applied to the same dataset. For example, I have a set of texts in Arabic and another version translated to English. I did a sentiment ...
0
votes
0answers
18 views

Custom Tables: How does SPSS treat multi response sets differently from categorical vars?

I have come across an SPSS-specific scenario where I cannot understand how SPSS is calculating its proportions test results. The scenario only takes place when applying t-tests and z-tests on "SPSS ...
2
votes
1answer
24 views

Can I use a Bayes factor to compare cells in a contingency table?

I'm trying to compare which features of a website more active and less active users make use of. I've divided up the users into "active" and "inactive" and there are several page types they can visit. ...
0
votes
0answers
29 views

How to analyze survey data, interval or ordinal, and how to account for nonresponse bias?

I have a question regarding a survey. I gave a test to people and they were asked to rate the tester on a scale of 1 to 5, 5 being they liked it and gave it the highest rating, with 1 being the ...
1
vote
1answer
20 views

hypothesis test one-sample vs two-sample

An industrial process is in place that increases the strength of a metal component. We are tuning a couple of settings on the system to optimize the strength. There are already some settings in place, ...
1
vote
1answer
33 views

t-test in large, unequal sample size + additional info such as effect size

I have 2 samples, named "1" and "3": (1) n = 1282, mean = 14.77, sd = 8.27 (3) n = 5360, mean = 15.88, sd = 8.55 Their distribution look: ...
0
votes
2answers
86 views

What is a statistical book that focus on showing that statistical test work?

What is a book that tells how can we evaluate how well hypothesis tests work, and and compare them? For example: 1)To investigate the significance of the difference between a frequency distribution ...
1
vote
0answers
20 views

Is it possible to use spatial autocorrelation test to determine the tuning parameter in the thin plate spline smoother?

I am currently working with some insurance data and try to estimate spatial structure of claims frequencies. The common approach is to perform some kind of regression on the non-spatial data then ...
0
votes
0answers
22 views

Differences between Distributions [closed]

I have three samples with different values about same random variables. I want to test the difference between the three distributions (position, shape, etc...) You can suggest a list of tests to do ...
0
votes
0answers
7 views

Statistical significance of difference between samples given total success rate when test was applied by group

I am comparing treatments that select members to receive some email, and we are measuring the response to that email. The emails are similar, but are sent to a different group of members and a ...
0
votes
1answer
58 views

Multiple regresssion K-S test in R

As suggested, this question first appeared on SO but was now merged across to CV So we can run a K-S test to assess if we have a difference in the distribution of two datasets, as outlined here. So ...
0
votes
1answer
32 views

Difference between multi-factor ANOVA and Cox proportional hazard model?

I am wondering what is the difference between multi-factor ANOVA and Cox proportional hazard model? As I understood both of them test the significance of some independent factors on a dependent ...
1
vote
0answers
22 views

A/B Testing (Pearson Ch-Square Test) with Unequal Sample Sizes

We have run A/B tests in the past using a 50/50 split, and have used the power prop function for calculating the sample size using the power.prop.test in R. My question is how do I calculate what my ...
3
votes
1answer
82 views
+50

How to determine the strongest player in a team game

I have an idea for a "King of the Hill" contest in the Programming Puzzles and Code Golf Stack Exchange (http://codegolf.stackexchange.com/). The game I have in mind has four players divided into two ...
2
votes
1answer
14 views

Comparing performance of a single classifier on two datasets

I'm using a single classifier on two different datasets, consisting of non-overlapping set of observations. The performance on one dataset is higher than the other, and I want to show that the ...
1
vote
2answers
16 views

Hypothesis test for mutually exclusive samples from a single population?

Let's say I gave 100,000 people a survey on their favorite fruit, where they can bubble in "Apple" or "Pear" (but not both). They can also leave it blank. The results are 90,000 people left it blank, ...
1
vote
0answers
14 views

Feedback on Experiment: bosses and meetings

As my context is rather specific, I'll try to write an analogy that sounds more natural and preserves all characteristics of the original problem. It goes like this: A certain company has around 2k ...
0
votes
0answers
9 views

Test proportionality between curves [closed]

Is there a test in statistics which examines if the proportion (or ratio) of 2 similar curves is a constant. For example if $y_{1} = sin(x+1.7) - 1$ and $y_{2} = x^{2}$ for domain $x$ in $[-1, 1]$
0
votes
0answers
17 views

Nonparametric equal variance tests

I have two large, non-normal samples as evidenced by the Kolmogorov-Smirnov test. I now wish to test for equality of variance nonparametrically. I'm confused as to which nonparametric test is ...
0
votes
1answer
33 views

Non parametric: How to detect different groups

I have data sets for different serial numbers of devices. Those data are not following a normal distribution. I would like to know which serial numbers are behaving differently from the overall ...
1
vote
0answers
24 views

Seperate regressions approach vs. interaction term approach

I am writing my thesis in finance, and my thesis advisor want me to do a categorical analysis, where I include control variables. He tells me I cannot simply include interaction terms (i.e. category x ...
0
votes
0answers
17 views

Sampling non-normal (near power-law) distribution

Context: I have a population that shows three distinct behaviors (slope) on a cumulative distribution function (survival proportion over time) and I want to find factors that may explain these ...
0
votes
1answer
29 views

Converting a 5-point Likert scale to 0 to 30 range

Hi thanks for viewing my question. In my research I want to adopt a measure from prior work and apply it to a new context. The question related to a 5- point likert-scale, however, further reading ...
75
votes
10answers
11k views

Is this really how p-values work? Can a million research papers per year be based on pure randomness?

I'm very new to statistics, and I'm just learning to understand the basics, including $p$-values. But there is a huge question mark in my mind right now, and I kind of hope my understanding is wrong. ...
0
votes
1answer
30 views

Statistical test for logical vectors in R

The first issue that I feel like I have is that I have limited experience with actually using statistical tests. I apologize ahead of time if this question is illogical. I have two example vectors ...
0
votes
0answers
14 views

Interpretation of ADF Test

I am doing a augumented-dick-fuller test to check if my series are stationary or not. ...
1
vote
0answers
31 views

For Mann-Whitney, should I report effect size or Hodges-Lehmann pseudomedian?

When reporting a Mann-Whitney-U test result, is it better to report it's effect size or the Hodges-Lehmann pseudomedian (as R give us as "difference in location") ?
3
votes
0answers
34 views

Two sample one-sided Kuiper Test and KS-statistic

With the KS-Test it is possible to conduct a two sample one-sided test between two different random samples $A$ and $B$ to test whether one CDF is larger or smaller than the other, i.e. is $CDF_A$ ...
0
votes
0answers
7 views

Interpreting Tukey test for significant differences

Hi I have 38 categories and I have their means. I want to see if the differences in means are significantly different. I ran an anova and the p-value is <2e-16. Then I wanted to investigate ...
2
votes
0answers
40 views

Comparing likelihoods from non-nested models

Short: I have a series of joint probabilities (likelihoods) for how likely sample $Q$ belongs to group $K$. I need to compute a p-value describing how "significant" the "top" group is compared to ...
2
votes
2answers
74 views

Why does the p-value double when using two-tailed test compared to one-tailed one? [duplicate]

Since this has been marked as a duplicate, I want to clarify that it's not about critical values of one- vs two-tailed tests, but the calculation of the p-Value in this case. I get that in a ...
0
votes
0answers
14 views

Analyzing the sequence of alterations to a system

Let's say... I have a 100x100 matrix where cells have been randomly assigned one of the 7 colours from the rainbow. It's a mismatched matrix of rainbow colours. Now, I wrote an algorithm that found ...
2
votes
0answers
27 views

Paired Hypothesis Test in TWO Linear Regressions

I am wondering how to perform a paired hypothesis test in a panel regression. I have been looking in many stats books but I have not found anything. The question goes: assume for $i=1,2,\cdots, N$ ...
1
vote
1answer
28 views

Kuiper's Test P Value in R

I am trying to implement a kuiper's test on a set of data and looking for an R package (or other program) that can give a p-value without monte carlo simulation or only a range of p-values. All of the ...
0
votes
0answers
9 views

Questions on same sample, significant difference on proportions?

I need some help with choosing the right statistics to use in the following cases.. especially the first one. Wish someone can help. select 1000 sample students out of a population (>10000), 300 get ...
3
votes
1answer
64 views

Significance/confidence intervals for PCA or factor loadings - how can such be defined?

Current discussions here in SSE made me to reconsider the PCA and FA models and procedures. I got curious how one would determine confidence intervals for the components/factor loadings by assuming ...