Timeline for Post-hoc tests for unexpected outcome of binomial models
Current License: CC BY-SA 4.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jun 15, 2022 at 17:51 | vote | accept | Adam_G | ||
| Jun 14, 2022 at 21:07 | comment | added | Adam_G |
My experiment was actually a spontaneous conversation; no one was given anything to type. In this case my question is "Are there significant differences in the way people type statements vs questions?" The 2nd half of my study will actually be typing-pattern ~ sentence-type, to answer the question of whether sentence types have distinct typing signatures, even if some of those signatures are the same for some sentence types (there are 10 different types).
|
|
| Jun 14, 2022 at 21:02 | comment | added | EdM | @Adam_G then think about which really is the "predictor" here. If people are given different types of sentences to type, then type of sentence would seem to be the independent/predictor variable, while "how people type them" would seem to be the set of dependent/outcome variables. Then you could do a true "multivariate" analysis of variance that takes into account correlations among the outcomes. Also, if the same individual is given multiple sentences to type, you need to take that correlation within individuals into account in the model, for example with a random-effects model. | |
| Jun 14, 2022 at 20:53 | comment | added | Adam_G | I'm comparing types of sentences, and how people type them (all the predictors are typing patterns/timings). In this case A1=Statement-non-opinion, A2=Statement-opinion, and A3=Question. A vs B is testing Statement vs Question. So in answer to your question, there is no inherent order. | |
| Jun 14, 2022 at 20:21 | comment | added | EdM |
@Adam_G R^2 isn't so helpful for examining goodness-of-fit of a binomial or multinomial model. At least that's true of the usual R^2 measures; there are some types of "pseudo-R^2" for models fit by maximum likelihood. Do your three outcome categories have a natural ordering, like A1 < A2 < B in some sense? Then you should use ordinal regression. Also, ask yourself what specific hypothesis you want to test: what does it mean to compare a model predicting 3 outcomes to one predicting only 2?
|
|
| Jun 14, 2022 at 19:52 | comment | added | Adam_G | Thanks! This is extremely helpful. If I do run a multinomial model with the 3 responses, what's the best way to compare it to the binomial model? Should I just use R^2 or some other goodness of fit? | |
| Jun 14, 2022 at 17:38 | history | answered | EdM | CC BY-SA 4.0 |