Does the order of the items in a questionnaire matter? If so, how do I know which item should go first, second, third etc. when devising a questionnaire?
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It only takes a minute to sign up.Sign up to join this community
Order certainly can matter. As a simple example, suppose I have two items on my questionnaire, which I could give in two different orders.
(a) Rate your happiness (Very Unhappy, Unhappy, Neutral, Happy, Very Happy)
(b) Are you in a relationship with another person (Yes, No)
If I ask question (b) first, it will likely influence the answer to question (a).
Based on the information provided, it is difficult to provide an answer to "which item should go first, second, third, etc." but here is a link to some general guidelines for question order:
It depends on the nature of the questionnaire. For instance, I've read that the first few items in lists that participants rank (e.g., from most to least favorite/true/important/etc.) tend to be ranked higher, presumably due to serial position effects. However, I'm not sure where I read that, and in searching for the reference, I instead found a contradictory result regarding Rokeach's Value Survey, which is a ranking-based assessment. Greenstein and Bennett (1974) randomized item ordering, and reported:
The amount of bias created by presentation order was sufficiently small as to suggest that order effects are not a problem in the instrument.
Of course, other questionnaires may be much more sensitive, but no one general answer applies. Randomization of presentation order across participants is a good way to balance any bias for nomothetic research though.
Greenstein, T., & Bennett, R. R. (1974). Order effects in Rokeach's Value Survey. Journal of Research in Personality, 8(4), 393–396.