Questions tagged [tost]

TOST, an acronym for Two One-Sided Tests, is a straightforward way of constructing a test of the "negativist" null hypothesis that two population statistics differ by no more than a small researcher-selected equivalence threshold.

13 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
623 views

TOST equivalence test in excel

I had a prof once refer to doing science in excel as doing watch repair with oven mitts. Nevertheless, I'm trying... I'm trying to do a TOST test using excel. I'm basing the equivalence of variances ...
3
votes
0answers
432 views

Kolmogorov–Smirnov TOST based on confidence bands

I am trying to setup a two one-sided test (TOST) version of the Kolmogorov–Smirnov test (KS) based on confidence bands. I would like to know if there is anything wrong with my approach. Similar to ...
3
votes
0answers
644 views

How do I estimate sample size for a single-sample equivalence test?

From literature I have a theoretically proposed value for human performance in a particular task. I want to experimentally measure performance in this task across a sample of humans and test whether ...
2
votes
0answers
515 views

Understanding equivalence testing. Why there are two hypothesis?

I have to two groups and I would like to test that difference between means of these two groups is at least 0.02. I am using TOSTER R package. Here are details: ...
2
votes
0answers
353 views

Calculating epsilon for two one sided t-tests

I am using the equivalence::tost method in R. It takes a parameter epsilon, but I am unsure of how to calculate this when I require a test for non-zero Difference%. Currently, I do this by using the ...
2
votes
0answers
157 views

What ANOVA non-superiority test corresponds to an omnibus set of TOST equivalence tests?

I am not sure if such a beast exists, but is there some non-superiority test for a oneway ANOVA of $k$ groups, probably based on a $\Delta^{2}$ equivalence threshold, for $m=\left[k(k-1)\right]/2$ ...
1
vote
1answer
44 views

Equivalence test for non-normal distribution: how to determine equivalence bounds?

I am trying to conduct a Mann-Whitney equivalence test (as described in Wellek's book Testing Statistical Hypotheses of Equivalence and Noninferiority) with the following code in R: ...
1
vote
0answers
14 views

Sample size determination for TOST

I am currently working on analyzing the behavior of two algorithms on the same input data and am trying to establish whether they are reasonably equivalent to each other within specified bounds to ...
1
vote
0answers
21 views

Possible multiplicity issues in equivalence testing

I'm currently looking to compare 3 groups, trying to prove equivalence between them. For this, 5 specific parameters are measured for each group, and a pairwise comparison for each parameter among the ...
0
votes
1answer
25 views

Sample size for mean comparison

Suppose that I have a new machine so I want to compare it to the older one. I would like to conduct a mean comparison of a parameter, to verify if these 2 machines produce the same results or not. How ...
0
votes
0answers
20 views

Combined equivalence and difference testing

I have some data with two conditions, and a pre- and post-measure for each condition. I would like to know 2 things: That there was a significant increase from pre to post in both conditions, That ...
0
votes
1answer
45 views

In the equivalence test (TOST procedure), why is the null hypothesis the presence of a real effect?

In the test for equivalence (or non-inferiority / non-superiority) we define a "minimal effect size" $d$, and test that the measured effect is not larger that $d$ $$X_1 \sim PDF1$$ $$X_2 \sim PDF2$$...
0
votes
0answers
298 views

Equivalence testing for repeated measures with two independent variables

I have a repeated measures experiment design with two independent variables ('condition' with 2 levels and 'repeat' with 10 levels) and one dependent variable ('performance'). I'd like to know whether ...