Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 11887

Statistical tests based on rearrangements of data that are consistent with the null hypothesis.

1 vote

What is the proper way to report test statistics used in a permutation analysis?

If you are computing (approximating/simulating) the p-value of your test statistic, be it an F or otherwise, the usual normal-theory null distribution is irrelevant. That means the "degrees of freedom …
kjetil b halvorsen's user avatar
6 votes

Is $T_{initial} = T_{permuted}$ tallied as significant or insignificant in permutation testing?

Your question has the tag p-value. Reading its tag wiki excerpt you find In frequentist hypothesis testing, the -value is the probability of a result as extreme (or more) than the observed result, . …
kjetil b halvorsen's user avatar
0 votes

What statistical test should I use for this type of data comparison?

You say The integers can go up to some finite number but usually somewhere around 4 to 10 at most. so with a low upper limit you can assemble your data as a contingency table and do a chi-square tes …
kjetil b halvorsen's user avatar
4 votes

Mann-Whitney with repeated measures on only *some* participants

So far just some ideas. According to this paper, also referenced in this book by Frank Harrell, the Mann-Whitney test is equivalent (in some sense) to ordinal logistic regression. In the case of two g …
kjetil b halvorsen's user avatar
2 votes

Chi-Square test with relative values?

The chi-squared test for homogeneity in a contingency table would not be appropriate here. You do not have a table of independent counts! It seems to me that each respondent, which distributes somehow …
kjetil b halvorsen's user avatar
2 votes

Should I use a t-test to compare the means?

Test should definitely be unpaired, car users and public transport users are presumably defined as disjoint groups. Walking distance to nearest shop (min) will not be normally distributed, and there i …
kjetil b halvorsen's user avatar
0 votes

How to properly test for difference in number of user actions?

So you have two treatments (A and B) and randomize users into treatments groups$^\dagger$. The result is $n$ users (A) and $m$ users (B). For each user you observe a count variable $y_i$. If the count …
kjetil b halvorsen's user avatar
1 vote

Bootstrap resampling for constructing hypothesis test

As for your more general question, how to use bootstrapping for hypothesis testing, in my understanding (which might be wrong ...), bootstrapping in the usual sense is not well adapted for hypothesis …
kjetil b halvorsen's user avatar
2 votes

When are observations not weakly exchangeable?

I did not see this term before, but my guess is that it is used in opposition to the term "infinitely exchangeable". The latest is necessary for the deFinetti representation theorem. As you have seen …
kjetil b halvorsen's user avatar