"post-hoc" refers to analyses that are decided upon after the data has been collected, as opposed to "a priori".

learn more… | top users | synonyms

0
votes
0answers
11 views

Post-hoc test for prop.test with 3 samples

I am performing a prop.test() in R for 3 different groups (samples). The result is a p-value that tells me that the observed proportions differ between the groups. --> How can I now find out whether ...
3
votes
1answer
77 views

What is the difference between various Kruskal-Wallis post-hoc tests?

[There seem to be a lot of similar questions here, so please point me the right direction if this has already been answered, but I think it's reasonably differentiated.] There are many different ...
0
votes
1answer
18 views

Post Hoc Analysis in Mixed linear models

I tested whether different version-styles of a loading screen (hourglass vs. progress bar) in different progression patterns (linear, accelerate, decelerate, irregular, binary) affect time estimations ...
0
votes
0answers
5 views

Post-hoc test on 3 groups comparison

I have 3 groups each with 6 values. After performing acceptable levene test for Homogeneity of Variance, I performed Anova on my data. It was significant, and I started to perform post-hoc test. The ...
4
votes
1answer
45 views

MANOVA multiple comparisons with equivalence testing

For a MANOVA with $n$ variables, I would like to do pairwise comparisons between $k$ levels for one of the variables. What is the suitable method to adopt for ...
0
votes
0answers
13 views

Why is it inappropriate to use a post hoc test on a random effect?

This is a bit more conceptual, but I know its incorrect to run a post hoc test on a random effect, though I'm not entirely sure as to why. I figure it has to do with the selection of random variables, ...
0
votes
0answers
25 views

Fisher's exact test for 3x5 contingency table in R with post-hoc? Consistently with using Fisher or Chi-squared?

I'm struggling with some (relatively simple) stats questions for some work I'm doing in R, and can't seem to find answers online... I have a factorial response variable of habitat type of a species ...
0
votes
1answer
33 views

How can I interpret a significant one-way repeated measures ANOVA with non-significant pairwise, bonferroni adjusted, comparisons?

I have a dataset with one factor consisting of four levels. I've run a one-way repeated measures ANOVA on the data, which came out significant. However, for the follow-up pairwise, bonferroni ...
0
votes
1answer
45 views

nlme fixed effects analysis recommendations

I have only a very basic background in statistics, and I have a possibly simple question, but I'm having a bit of trouble with my model. I suppose this is also an R question, but also statistical! ...
4
votes
1answer
95 views

Post-hoc test for chi-square goodness-of-fit test

I'm conducting a chi-square goodness-of-fit (GOF) test with three categories and specifically want to test the null that the population proportions in each category are equal (i.e., the proportion is ...
0
votes
1answer
52 views

Can assumptions of a statistical test be tested post-hoc?

Suppose I ran 100 1-factor ANOVAs. I find some significant results. Now, since ANOVA has some assumptions, I should test if they hold. So, can I run for example Levene's tests (to check equity of ...
0
votes
1answer
36 views

Tukey's test on two way ANOVA

So I have done a two way ANOVA, and would like to do a post-hoc Tukey's HSD test. What should I use for the $k$, SE, degrees of freedom and what is my $q$ and HSD? The exp is done in 4 places with ...
0
votes
0answers
40 views

Post-hoc analysis

Ok so maybe stupid question but I need to know, if im doing a post-hoc, and my experiment has two sources of variation, and one of them is significant and one is not. Do I only look at the means of ...
0
votes
1answer
69 views

Post-tests to consider in mixed models

I have a mixed model of the form y~condition + Replicate + Error(Replicate) but at the moment, and am running into difficulties in performing a post-hoc test. I ...
2
votes
1answer
53 views

Multiple comparisons with many groups

I would like to determine if using multiple comparisons test would be appropriate for my data. I used the Kruskal-Wallis test to determine if there were differences in mean inhibition among $17$ ...
1
vote
1answer
100 views

Bonferroni correction on multiple Kruskal-Wallis tests

My data consists of 3 groups, and 6 variables. The data are not normal so I want to use non-parametric tests to uncover significance. The first thing I wanted to get your opinion on is, is it ...
2
votes
1answer
228 views

How to follow up a factorial MANOVA with discriminant analysis?

This is a follow-up to to my previous question: How can MANOVA report a significant difference when none of the univariate ANOVAs reaches significance? I have two IVs with each having three levels ...
2
votes
0answers
46 views

ANOVA P-value adjustments for semi-continuous data

In tests such as the Bonferroni post-hoc p-value adjustment test, convention is to correct the data with a constant, equivalent to the length (number) of pairwise comparisons that are being performed. ...
7
votes
2answers
298 views

What is the problem with post-hoc testing?

My statistic professor says so, all the books that I look at state it: post-hoc-testing is unscientific. You must derive a hypothesis from theory first, and then collect data and analyse it. But I ...
2
votes
2answers
65 views

Minimum sample size for 1 way ANOVA?

I have tested a group of participants over various time points and I want to investigate whether mean score on each subsequent time point is significantly different to the mean score at baseline (eg. ...
0
votes
0answers
13 views

post hoc nested

Hy, need to do post hoc test for nested factor in SAS. I have two factors, A and B with B nested within A and I want to perform post hoc test in GLM in SAS. Is it possible? Stevan
0
votes
0answers
28 views

What type of post hoc test does a LME use by default?

I need to know what type of post hoc test a LME model is using in R, by default? Is it Tukey? And is the alpha modified?
2
votes
0answers
157 views

Converting Chi Square Adjusted Residuals to p values

I am running a chi squared analysis in SPSS on a 5 x 2 contingency table. The overall chi square p value was < 0.0005, so I ran post hoc tests (adjusted standardized residuals on the individual ...
0
votes
0answers
35 views

What is the relationship between degrees of freedom and number of comparisons in Nemenyi's post hoc test?

I have some data consisting of non-normally distributed samples drawn from one of several different groups. A Kruskal-Wallis 1-way ANOVA rejects the null hypothesis that the medians of the groups are ...
2
votes
1answer
45 views

Can I justify using a one-tailed test in for this interaction effect?

I have an experimental setup with 2 factors, site and disturbance treatment. I have reason to suspect that plots at site A will be more affected by treatment than plots at site B. My response ...
0
votes
0answers
57 views

When an effect size has to be considered sufficiently large?

I submitted a paper in which I analyzed the data by a mixed design ANOVA. I reported generalized eta squared as effect size. After significant interactions, I conducted planned comparisons. A reviewer ...
0
votes
1answer
161 views

Post Hoc test after lme [closed]

I am trying to run a Post Hoc test (glht) after a linear mixed model (lme) in R. I was ...
3
votes
1answer
70 views

Post-hoc after GLM: What does it exactly say?

Background: I have been asked to model the change of weight of a few animals undergoing experimentation via a simple GLM (General Linear Model). The data looks something like this. Note that all data ...
0
votes
0answers
87 views

Post-hoc with Bonferroni a correction after ANOVA with repeated measure in SPSS

does somebody know where I can find the t value of post-hoc tests with Bonferroni correction when using SPSS.From what I get so far, I only see p values. Should I add a command in the script? Thank ...
0
votes
3answers
162 views

Testing and reporting interactions in multiple regression

I have a model with two between-participants predictors -- one continuous (a), and one categorical with two levels (b) -- and ...
0
votes
0answers
50 views

Can one make a Tukey post-hoc test for multiple regression in R and how?

I saw that the Tukey post-hoc test is usually done after performing an ANOVA. However, is it possible to carry it out in the case of multiple regression with the following model: ...
3
votes
0answers
67 views

Post-hoc power analysis of complex sample survey data

I am working with a complex sample survey data using Stata to determine the predictors of a given dependent variable. As part of my analysis result I want to report the post-hoc power for each ...
0
votes
0answers
46 views

Pairwise comparison of slopes from multivariate regression model in R

I am investigating size changes over time. I have five size variables in a multivariate linear model against year. I used the Anova() function in the car package to test whether the slopes are equal ...
0
votes
0answers
11 views

Follow up 2-way ANOVAs

I have a three-way significant interaction in a mixed-ANOVA, with two repeated-measures factors and one between-subjects factor. I would now like to follow it up with a repeated-measure ANOVA for each ...
0
votes
0answers
66 views

Post hoc for GLM that looks at interactions (in R)

I’d like some help with analysing some count data. I am very new to R (and statistical analysis for that matter!) and have done my best to work it out on my own … but seemed to have got stuck! I am ...
0
votes
0answers
32 views

How to use controls as a reference in GLM?

I'm running glms in R on two datasets, both with three discrete explanatory variables and one continuous dependent variable. My question is about the use of controls - I want to use my controls as a ...
0
votes
0answers
73 views

mixed design and simple main effect analysis in SPSS

Hope someone can help me. I have a within subject variable (Question, with 11 conditions) and a between subject variable (stimulation, with 3 conditions). I did an ANOVA and I obtained a main effect ...
0
votes
1answer
265 views

Which post-hoc is more valid for multiple comparison of an unbalanced lmer-model: lsm or mcp?

After doing a model comparison with my mixed lmer model, I have a model with three main effects, no interaction, say ...
0
votes
0answers
76 views

How do I report the result of an mcp-Tukey-test, i.e. how do I report it's z value?

After doing a model comparison with my mixed lmer model, I have a model with two main effects, no interaction, say signal ~ factor A + factor B + (1|subj). Factor ...
0
votes
0answers
63 views

GEE and post hoc comparisons

I am trying to analyze a dataset using the GEE. This is what I have so far ...
0
votes
0answers
47 views

Looking for a better post-hoc analysis

I'm a PhD student in Neuroscience, with a master degree in Psychology and I use R for my statistical analyses. As you know, in NHST usually post-hoc analysis in continuous data are essentially ...
0
votes
1answer
388 views

F stats for post hoc test of a linear mixed effects model

I have an unbalanced linear mixed effects model with three fixed factors of various levels and one random factor for my repeated measures data (for details see here). Thanks to your help I managed to ...
1
vote
2answers
65 views

Post hoc Scheffé test

My 1-way ANOVA test is not significant. Is it possible that a Scheffé test as a post hoc test be significant? If not, please say why not.
0
votes
1answer
99 views

Appropriate non-parametric post-hoc test for baseline comparisons?

I want to evaluate several "classifiers" (machine-learning algorithms) with paired samples. I do not want to compare each algorithms' performance to every other (n x m comparison) but only compare the ...
0
votes
1answer
40 views

Refitting with different contrasts vs. pairwise comparisons

Say, I fit a linear or generalised linear model in R with dummy coding (contr.treatment for ...
0
votes
1answer
69 views

Effect sizes for post-hoc paired comparisons in one-way ANOVA

Is there any alternative (like Cohen's d in t-test) to report about effect sizes for post-hoc paired comparisons in a one-way ANOVA (3 factor levels, correlated samples)?. Many thanks!!
1
vote
1answer
145 views

Mixed ANOVA post hoc analysis (and multiple comparisons)

I have a set of 12 subjects: 6 administred with drug A and 6 with drug B. For each subject two time-points have been collected (before and after drug treatment) for each analyte (over 6000). I had a ...
0
votes
2answers
226 views

Post-hoc tests for 2x2 ANOVAs (Type II & III) with interactions in R

I am trying to analyze data from an experiment using R and ran across a problem regarding the use of post-hoc tests with Type II & III ANOVAs. I only know of R functions that perform post-hoc ...
3
votes
1answer
80 views

GLM post hoc with non-parametric tests?

I have a question regarding the appropriate use of comparisons for independent samples (3 factor levels). Overall sample size is N=546, subsamples: 218 or 228 or 100), convenience sampling, ...
1
vote
1answer
406 views

Standard error bars overlap but significance - estimated marginal means versus observed means

I'm running a Mixed effects model ANOVA with two fixed factors (condition, repetition) and one random factor (subject). Subsequently, a Tukey multiple comparisons test is performed. Now I'd like to ...