Questions tagged [tost]
TOST, an acronym for Two One-Sided Tests, is a straightforward way of constructing a test of the "negativist" null hypothesis that two population statistics differ by no more than a small researcher-selected equivalence threshold.
42
questions
1
vote
0
answers
29
views
Equivalance testing when one of two (paired) samples has high variance
I have two paired samples of data that include the same number of observations (N = 878). My aim is to show that the mean difference between sample one and sample two is not statistically significant.
...
- 215
1
vote
0
answers
67
views
Is the Intersection of two one-sided confidence intervals equivalent to the two-sided confidence interval?
I am interested in testing for equivalence. I know about the TOST procedure, but many people who I work with do not, so I wanted to apply a method that they are more familiar with it. Specifically, I ...
- 1,850
0
votes
0
answers
21
views
How to report simulation results on TOST procedure for multiple comparisons
I am not well versed in statistics, so please bear with me. I will try to explain things as well as I can.
I have 256 variables, and for each variable I have a before $(\mu_i, \sigma_i, N_i)$ and an ...
- 101
0
votes
0
answers
23
views
TOST on mediation result
Dear people of the internet
I have made a mediation test on a multiple linear regression and it comes out insignificant. However, I am having trouble trying to make a TOST equivalence test of the ...
1
vote
1
answer
58
views
Does TOST equivalence test handles subgroups within the group?
I just started on statistics so this is pretty hard for me. I have two identical experiments. Each experiment have gene expressions for 12 samples with different conditions: untreated. Dosage 50. 100. ...
- 141
0
votes
1
answer
138
views
When are equivalent TOST test possible?
For my end-of-study work in architecture, i am comparing different reconstruction (~10) distances from reference 3D model.
I'd like to test if reconstruction are different using statistical tests.
On ...
- 21
1
vote
1
answer
109
views
Experimental Design for Equivalence Testing
I'm working on setting up a study that will test how quickly users click on various icons appearing on a computer screen using three different prototype mouse types. Subjects will visit on three ...
- 6,780
1
vote
1
answer
71
views
Simulate Equivalence Test
I am trying to simulate a paired t-test equivalence test. I generate x and y from the same Normal distribution thus I expect to ...
- 6,780
0
votes
1
answer
241
views
Equivalence test for two samples of categorical data
Let's say I have two packets of sweets, which can either be red or black. The packets look different, but I think they were produced at the same factory. I decide that if the distributions of the ...
- 133
3
votes
1
answer
156
views
Analysing TOST test output
I am given the following R output for a TOST test and would like to confirm whether my understanding is correct: p1 and p[2] are both <0.05 and thus one can reject the null hypothesis that both ...
1
vote
0
answers
50
views
Equivalence Testing for Absolute Mean Difference
I have a paired dataset: for each sample $x_i$ I have calculated $\theta^A_i, \theta^B_i$ using models A,B. Let $\xi_i=\theta^A_i - \theta^B_i$ and assuming equal-sized equivalence boundaries $\...
- 3,400
1
vote
1
answer
343
views
Equivalence test for non-normal distribution: how to determine equivalence bounds?
I am trying to conduct a Mann-Whitney equivalence test (as described in Wellek's book Testing Statistical Hypotheses of Equivalence and Noninferiority) with the following code in R:
...
2
votes
0
answers
120
views
Sample size determination for TOST
I am currently working on analyzing the behavior of two algorithms on the same input data and am trying to establish whether they are reasonably equivalent to each other within specified bounds to ...
- 21
0
votes
1
answer
49
views
Sample size for mean comparison
Suppose that I have a new machine so I want to compare it to the older one. I would like to conduct a mean comparison of a parameter, to verify if these 2 machines produce the same results or not. How ...
- 31
4
votes
1
answer
198
views
TOST and its two null hypotheses
Background
I have a device which is used to size potatoes. I want to use statistics to assess how accurate this device is.
To that end, I've collected two data sets, $X$ and $Y$, where $X$ is the set ...
- 277
7
votes
1
answer
183
views
Possible multiplicity issues in equivalence testing
I'm currently looking to compare 3 groups, trying to prove equivalence between them. For this, 5 specific parameters are measured for each group, and a pairwise comparison for each parameter among the ...
- 71
2
votes
1
answer
145
views
In the equivalence test (TOST procedure), why is the null hypothesis the presence of a real effect?
In the test for equivalence (or non-inferiority / non-superiority) we define a "minimal effect size" $d$, and test that the measured effect is not larger that $d$
$$X_1 \sim PDF1$$
$$X_2 \sim PDF2$$...
- 1,110
4
votes
0
answers
1k
views
TOST equivalence test in excel
I had a prof once refer to doing science in excel as doing watch repair with oven mitts. Nevertheless, I'm trying...
I'm trying to do a TOST test using excel. I'm basing the equivalence of variances ...
- 41
2
votes
0
answers
624
views
Understanding equivalence testing. Why there are two hypothesis?
I have to two groups and I would like to test that difference between means of these two groups is at least 0.02. I am using TOSTER R package. Here are details:
...
- 667
6
votes
1
answer
1k
views
Equivalence test for binominal data
I want to apply an equivalence test on my sample to infer whether they are equivalent or not.
Since my data are bionominal [0,1] I don’t know whether the TOST procedure (tost() in R) can handle my ...
- 109
3
votes
0
answers
807
views
Kolmogorov–Smirnov TOST based on confidence bands
I am trying to setup a two one-sided test (TOST) version of the Kolmogorov–Smirnov test (KS) based on confidence bands.
I would like to know if there is anything wrong with my approach.
Similar to ...
- 131
0
votes
0
answers
577
views
Equivalence testing for repeated measures with two independent variables
I have a repeated measures experiment design with two independent variables ('condition' with 2 levels and 'repeat' with 10 levels) and one dependent variable ('performance'). I'd like to know whether ...
- 13
11
votes
2
answers
545
views
Can we accept the null in noninferiority tests?
In a usual t-test of means, using the usual hypothesis testing methods, we either reject the null or fail to reject the null but we never accept the null. One reason for this is that if we got more ...
- 110k
-2
votes
2
answers
1k
views
R - what is magnitude of region of similarity (epsilon) when using tost() from equivalence package
I have two vectors:
...
- 59
7
votes
1
answer
324
views
equivalence test - why isn't it more common?
Often in frequentist hypothesis testing, the null hypothesis is of the form: $H_0: \theta = 0$
I've seen many posts about how the p-value when doing tests against this null hypothesis is just a ...
1
vote
2
answers
1k
views
TOST for equivalence test
Let's say that we are measuring the tracking position error of two controllers and we want to know if both controllers are similar (we already perform a "differences" test but we are requested to ...
- 39
2
votes
1
answer
2k
views
Equivalence testing and difference-in-difference measures
I have some data from a recent experiment that requires slightly more sophisticated testing than I'm used to. Any advice would be most appreciated!
The setup: There are control (C) a treatment (T) ...
8
votes
3
answers
1k
views
What is the best method of reporting multiple tests of equivalence?
I am doing a study which will involve multiple tests of equivalence. Is there a standard table for reporting such results?
EDIT with more detail:
It is a longitudinal study with 5 time points. Our ...
- 110k
2
votes
0
answers
455
views
Calculating epsilon for two one sided t-tests
I am using the equivalence::tost method in R. It takes a parameter epsilon, but I am unsure of how to calculate this when I require a test for non-zero Difference%. Currently, I do this by using the ...
- 21
8
votes
1
answer
2k
views
Can you use the Kolmogorov-Smirnov test to directly test for equivalence of two distributions?
There has been talk on other questions of how one might use the Two One-Sided Tests (TOST) approach for the Kolmogorov-Smirnov (KS) test, but I was wondering whether it was possible to directly use ...
0
votes
3
answers
1k
views
Paired two one-sided t-tests (TOST) with unequal sample sizes
I have data from two populations (let's call them "before" and "after"), collected in a paired fashion. That is, I take a measurement under one set of conditions before, and then I can take multiple ...
- 76
9
votes
2
answers
4k
views
Equivalence testing - tost method - why CI of 90%?
In testing for equivalence via the two one-sided test approach with confidence intervals, a (1–2α) × 100% confidence interval is calculated to check for equivalence. I assume this is because you ...
- 1,342
5
votes
1
answer
213
views
Point hypothesis and equivalence hypothesis at once
Sometimes researchers (especially in collaborations) have two opposite but sound theories: There is a difference between two groups or there is only negligible difference. Now they ask their ...
- 5,155
13
votes
2
answers
2k
views
Is there a simple equivalence test version of the Kolmogorov–Smirnov test?
Has two one-sided tests for equivalence (TOST) been framed for the Kolmogorov–Smirnov test to test the negativist null hypothesis that two distributions differ by at least some researcher-specified ...
- 29.2k
2
votes
0
answers
174
views
What ANOVA non-superiority test corresponds to an omnibus set of TOST equivalence tests?
I am not sure if such a beast exists, but is there some non-superiority test for a oneway ANOVA of $k$ groups, probably based on a $\Delta^{2}$ equivalence threshold, for $m=\left[k(k-1)\right]/2$ ...
- 29.2k
10
votes
1
answer
2k
views
Intuitive explanation of differences between TOST and UMP tests for equivalence
Hypothesis tests for equivalence differ from the more common hypothesis tests for difference.
In tests for difference, the null hypothesis is some form of "separate quantities are the same", and ...
- 29.2k
60
votes
4
answers
20k
views
Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?
Traditional statistical tests, like the two sample t-test, focus on trying to eliminate the hypothesis that there is no difference between a function of two independent samples. Then, we choose a ...
- 2,530
6
votes
1
answer
1k
views
Use of Wilcoxon test for non-normal data akin to Two One Sided T-test
I'm analysing paired data for equivalency and it's not normally distributed, i.e., the difference of the paired result is not normally distributed due to, amongst other things, outliers. If it were ...
- 129
14
votes
1
answer
603
views
Null hypothesis of equivalence
Suppose $X_1, X_2, \, ... \, , X_n$ are a simple random sample from a Normal$(\mu,\sigma^2)$ distribution.
I'm interested in doing the following hypothesis test:
$$
H_0: | \mu| \le c \\
H_1: |\mu| &...
- 141
13
votes
3
answers
5k
views
Equivalence tests for non-normal data?
I have some data that I can't necessarily assume to be drawn from normal distributions, and I would like to conduct tests of equivalence between groups. For normal data, there are techniques like TOST ...
- 373
3
votes
0
answers
687
views
How do I estimate sample size for a single-sample equivalence test?
From literature I have a theoretically proposed value for human performance in a particular task.
I want to experimentally measure performance in this task across a sample of humans and test whether ...
- 63
41
votes
8
answers
25k
views
How to test hypothesis of no group differences?
Imagine you have a study with two groups (e.g., males and females) looking at a numeric dependent variable (e.g., intelligence test scores) and you have the hypothesis that there are no group ...
- 44.2k