Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

1
vote
0answers
16 views

Goodness Of Fit Testing When Multiple Parameters Are Estimated

I am working with independent data points $X_1,...,X_N$ each of which, under my model assumptions, is a sum of exponential waiting times with different rates, and so should come from gamma ...
0
votes
0answers
10 views

Location level a/b testing sample size

We are setting up experiments to measure impact on the city level. Customer in certain cities are treated and we have list of holdout cities with similar behavior. Measurement of lift of the ...
1
vote
0answers
13 views

Bootstrap test of means using pooled groups - is there a problem?

In his book "Resampling: the New Statistics" (available for free online), Julian Simon presents several examples where he Bootstraps the differences in group means, assuming that the observations of ...
0
votes
1answer
33 views

Independent or Dependent sample

I am comparing whether Spot Gold prices and Gold ETF prices have the same performance. A spot price is the current price in the Precious Metals marketplace at which a given asset such as a security, ...
1
vote
1answer
25 views

Is non-sampling error included in hypothesis testing assumptions?

I understand that, in hypothesis testing, we are dealing with sampling error. We calculate the statistic from the sample data and test what the probability of getting that result is when the null ...
0
votes
0answers
11 views

Formula for Power of Upper Tail Sign Test

Given Consider the upper tail $H_0: \theta \leq 0 \,\,\, \text{vs} \,\,\, H_A: \theta > 0$ sign test with the test statistic $B = \sum_{i=1}^n{\psi_i}$ where $\psi_i = \mathbb{I}(Z_i > \theta)$...
0
votes
1answer
34 views

Properties of Nonparametric Test Statistics $B$

Given Consider the upper tail $H_0: \theta \leq 0 \,\,\, \text{vs} \,\,\, H_a: \theta > 0$ sign test with the test statistic $B = \sum_{i=1}^n{\psi_i}$ where $\psi_i = \mathbb{I}(Z_i > \theta)$...
-1
votes
2answers
60 views

can one calculate a p value in a distribution [closed]

I have an event which happens so many times, I want to know how significantly is 1300$ in comparison to the distribution. which test should I use ?
0
votes
0answers
21 views

One-tailed Conover-Iman test?

I'm new to non-parametric statistics and want to do a post hoc analysis of some data after a Kruskal-Wallis test. I am using the implementation of the Conover-Iman test available in the scikit-...
0
votes
0answers
42 views

Can Bayes factors be an alternative to multiple comparisons corrections?

I am currently using p-values and Bayes factors to interpret my results. I have multiple comparisons so was going to perform a Bonferroni correction, however I am hesistant due to its highly ...
0
votes
1answer
24 views

How to handle uncertain counts in poisson test

I am curious about performing poisson test where I have uncertainty about my count. For example, I expect to see 15 bunny rabbits per hike. On a given hike, I positively identify 19 bunny rabbits, and ...
0
votes
1answer
42 views

A statistical test to check whether a set of data are Pareto distributed

I need to construct a statistical test which outputs the p value for the hypothesis, H0: Data are Pareto distributed Vs H1: Data are not Pareto distributed. I found a test in stack exchange, but it's ...
1
vote
1answer
33 views

Statistical Test on One Sample: Difference in Dispersion Mesures above and below the Central Tendency

I'm a novice in statistics. I highly appreciate if you could provide me with any piece of information about the following: Is there any statistical test to check whether dispersion measures (standard ...
1
vote
2answers
43 views

Comparing the mean of MSE for two models

I've estimated 2 models on simulated data and basically replicate the estimations 100 times. What I want to see is if the models are actually different in terms of their MSE. What I've done is to keep ...
0
votes
0answers
17 views

Proper interpretation of statistical significance

If an A/B test does not meet some significance threshold, say 95%, but was only 91%. Is it accurate to say the test showed an effect with 91% significance or can one only say it did not meet the 95% ...
1
vote
1answer
26 views

Non-analytical application of Neyman-Pearson lemma

I have a discrete random variable $N$, from which a random sample $N_1,\dots,N_{15}$ is drawn. I want to test two hypotheses about the distribution of $N$ which are represented by two histograms. In ...
1
vote
2answers
16 views

Choosing trend analysis period

I'm having trouble figuring out whether its important to have a common period of time when performing hypothesis testing for trend analysis. I have time-series data of varied length - some sites have ...
1
vote
0answers
18 views

Hypothesis testing with two dependent multilevel categorical variables [closed]

I was presented with a requirement of comparing two sources of diagnoses on the same subjects, resulting in two 4-level categorical variables. I offered to calculate Cohen's Kappa, but the interested ...
1
vote
0answers
17 views

Which statistical test would be most appropriate? Chi-Squared or something else?

My data is essentially: Var_A and Var_B are treatments assigned to the id and Var_C is the outcome. The id's are randomly assigned treatments so that , for example, 40% get Var_A only, 30% get Var_A ...
2
votes
1answer
32 views

Comparing Data Sets Basics

I'm posing a question on behalf of my daughter who is participating in an elementary school science fair. She has two sets of data, A and B. Both are test scores given to students. The B set are ...
3
votes
1answer
23 views

What are the recommended practices/techniques to compare “index” statistics?

Background: We've created an "in-house index" to help quantify something that was never measured/quantified before to aid better communication and provide more objective validations of internal ...
2
votes
1answer
24 views

What causes low power on hypothesis tests?

I've been doing hypothesis tests to compare two proportions in a product. Although the sample size is supposed to be more than enough based on the population and $\alpha$ (type I error), the power of ...
0
votes
0answers
19 views

How to use RSSI (Received Signal Strength) data to find out a wireless channel model?

I am trying to obtain the distribution of RSSI measurements collected from 802.15.4 devices like Zolertia Re-Motes. These devices provide RSSI values in dBm units with +/-1 dBm error in measurements. ...
0
votes
1answer
25 views

Intuition behind choosing between versions of Engle-Granger and Johansen cointegration tests

No matter how much I've been searching so far, I haven't found any clear explanation of the logic behind choosing the optimum version of cointegration tests (No constand, with constant, with constant ...
1
vote
0answers
19 views

How to test for significant 2D movement including distance and direction?

We performed a controlled experiment where the experimental units are aquariums with either no treatment or application of a treatment with several replicates of each. Within the aquariums, there were ...
3
votes
0answers
38 views

Algebraic Manipulations in Mann-Whitney-Wilcoxon Test Statistics

Given Let $\Delta > 0 $ be positive real number. Consider the Wilcoxon-Mann-Whitney upper tail test $H_0: \Delta \leq 0 \,\,\, \text{vs} \,\,\, H_a: \Delta > 0$ aimed at testing the difference ...
0
votes
1answer
17 views

2-sample bootstrap hypothesis test - comparing locations but different estimators in two samples

I have two independent samples X and Y where $x_i \sim F$ and $y_i \sim G$. Two different estimators A and B map X to $x_0$ and Y to $y_0$ respectively. I'd like to compare $x_0$ and $y_0$. The ...
2
votes
2answers
55 views

Nonparametric Sign Test

Given Likert scale survey responses: ...
2
votes
2answers
107 views

t-test/regression - how to account for random effects? [closed]

I need your help on how best to test the following hypotheses in R. Each observation in my data has RaterID and RaterGender, ...
8
votes
2answers
479 views

Are there any “esoteric” statistic tests with very low power?

Background In computer science, mathematics, and sometimes in other fields, “esoteric” examples cannot only be entertaining, but helpful to illustrate certain concepts, for example: Bogosort and ...
0
votes
1answer
27 views

Assumptions on the variance of the null model in one-sample Z-test?

Apologies if the answer to this is obvious, but I can't understand why the usual interpretation of the p-value (probability under the null model of obtaining a test statistic at least as unlikely as ...
0
votes
1answer
30 views

Types of Normality Test used in Minitab

I recently performed a normality test for a set of data. I noticed that when I use the AD test, the p-value is < 0.05; whereas when I use RJ test, the p-value showed is >0.05. My question here is: ...
1
vote
1answer
249 views

Determine if data is IID

I have data usage from Android and Iphones, and I want to check if the Iphone users consume more than the Android ones. I thought about doing a t-test, but I am not sure if the ID - I think we should ...
0
votes
0answers
17 views

How do I determine the critical r value for Pearson correlation if I compute the result via bootstrapping?

The critical r value for a Pearson correlation analysis depends on sample size. For example, consider a test with the following parameters: n = 20 alpha = .05 I ...
1
vote
1answer
35 views

Rho Spearman correlation test interpretation for sample equal to population

I have done a pair of cuestionaries to measure a pair of variables in a small population, 87 people, so I have taken the whole population as a sample, the cuestionaries have likert scales as answers (...
0
votes
1answer
25 views

hypothesis testing to check for occurrence

I am struggling to understand if I can make such a hypothesis or not and if so, which test is best to validate it. I have a data with a size of 50 (quality of wine) I see that a sensory quality ...
0
votes
0answers
16 views

Bayesian Model Validation in BEST

I am trying to perform BEST using pymc3 for finding difference between 2 groups of values (values from same group before and after). After performing similar analysis as shown in the link, I see no ...
1
vote
1answer
18 views

How to determine earliest point of change in repeated cross sectional study?

I have an experiment where animals are exposed to a temperature change and then a continuous response variable is measured at set time points after the change. I have a baseline, 8 hours after change, ...
0
votes
1answer
67 views

How are p-values computed from t-values when doing regressions?

I'm performing a regression analysis using the statsmodels module in Python. The regression gives both t-values and p-values for each coefficient, but I'd like to understand exactly which test is ...
1
vote
1answer
10 views

Testing for the significance of treatment on intervention/target group compared to control group when group sizes are different?

So I have have been conducting an experiment of an interesting feed on livestock. So essentially what I have done is, divided the total livestock $N$ in two different sized groups $n_1 $ and $ n_2$. I ...
1
vote
1answer
22 views

Comparison of the mean of a binary variable from two independent sets

I have two sets of data, one is akin to high performing companies, and the other contains low performing companies. I want to compare the mean of a binary value. For instance, "CEO has a bachelor ...
2
votes
0answers
40 views
2
votes
1answer
21 views

How to test if the probability of one category is larger than another in the same sample?

I have a multiple choice problem with 4 options, A, B, C, and D. I know the number of people choosing each of the four options. How should I test the null hypothesis that the probability of choosing A ...
1
vote
2answers
35 views

Test on Ordinal data with interval

I have a query regarding statistical analysis. I have collected data on percentage of savings done by individuals. These data are ordinal, grouped into equal intervals with the exception of the final ...
2
votes
1answer
27 views

Why there are two p-values for the F value, one from Summary and others from ANOVA?

Consider the 'estandar' output of R that I copied from Anova from R output interpretation and added other variables. Why there are two p-values? One from Summary ...
0
votes
0answers
33 views

Test for change in correlation of same two variables from T1 to T2

I am looking for an online calculator that will test for a significant change in correlation of the the same two variables (x and y) at 2 times, T1 (pre-study) and T2 (post-study). I want to know the ...
2
votes
1answer
28 views

The significance of two categorical variables on students' scores

I am analysing a set of students' scores on a Maths test. My data set includes 41 students. I have the students' marks on each question of the test. I have the gender of each student. I also have ...
0
votes
0answers
13 views

Estimating true positive rate with a confidence interval given a classifier + unknown dataset truths

Let's say I've built a binary classifier - one that for instance, can classify whether a particular transaction is fraudulent or not. This classifier outputs a 1 or a 0, with a given degree of ...
0
votes
0answers
13 views

Appropriate statistical test for continuos bounded r.v

I have a number of continuous random variables bounded in the domain [0,b] and I need to perform a statistical test to check whether their average is different from ...
0
votes
0answers
14 views

Test for equality of means for vector-valued random process with different variances

I am studying linearity range of an RF amplifier (henceforth DUT). For that I am stimulating the DUT with a periodic deterministic probe signal (which is known only roughly) and measuring the DUT's ...