1
vote
2answers
74 views

What factors do I have to consider when deciding if creating a composite score using four t-scores is defensible psychometrically?

Edit: I've conducted an item analysis on four variables - two quizzes and two psychological attributes, namely emotional intelligence and happiness. Its a within-subject design with students as ...
3
votes
0answers
623 views

For intraclass correlation coefficients (ICC), interpret both “single” and “average” measured ICC values for reproducibility test?

Say there's a new machine for use in testing a biochemical marker's concentration in the blood, and we would like to know the reproducibility of this test. We draw blood samples from 10 volunteers, ...
1
vote
0answers
223 views

Assessing scale reliability: how to get the p-value for corrected item-total correlation?

I assessed the internal reliability of a self-created scale with eight items (N total = 150) by calculating Cronbach’s α. It appears that one item correlates low with the overall score of the scale ...
6
votes
3answers
598 views

Validating an existing questionnaire into another language

I am doing research and trying to use a questionnaire that is available in English in another language. Is there a systematic approach for validating a questionnaire in another language? What ...
3
votes
2answers
261 views

How to “prove” that new measurement tool & process gives same result as old?

I am new to the area of statistics and I am hoping you can suggest methods I may use. Sorry if this is long but I might as well be as clear as possible on my first post :) What I am worried most is ...
4
votes
2answers
2k views

Should I reverse score items before running reliability analyses (item-total correlation) and factor analysis?

I want to assess item-total correlations on a 19-item questionnaire (some of the questions are meant to be reverse-scored). My question is: Do I reverse score the items PRIOR to calculating the ...