Questions tagged [scale-construction]
Construction of a measuring scale for a "trait" as a sum (or other function) of individual variables ("items"). Various methods to validate the construction exist (including factor analysis, external criterion, experts opinion etc.).
33
questions
0
votes
1
answer
32
views
Do you need validators for a demographic profile questionnaire?
I am conducting a thesis and I created a survey questionnaire that would help to answer the questions in my statement of the problem.
Now, I am wondering if the questionnaire I created is already good ...
- 11
1
vote
0
answers
12
views
Is it necessary to do a second order CFA to create a total score summing across factors?
I am in the process of developing a scale. I have already performed EFA on the first dataset I collected, which showed strong support for a 4 factor structure. I am now planning to collect another ...
- 125
1
vote
0
answers
22
views
Is it legitimate to combine two scales of interest on different topics to one based on the intervention condition?
I am doing research where we study students' motivation when working on physics learning tasks. In doing so, we give students learning tasks that are motivated by different contexts, so that they ...
- 11
5
votes
1
answer
446
views
How to do exploratory factor analysis in a repeated measure design?
In my experiment participants answered to the same scale twice, after the presentation of two different stimuli, i.e., repeated measures design.
The scale validation is not the main focus of my study, ...
- 113
2
votes
0
answers
601
views
Equation for weighted average with normalization(?)
I am trying to understand how I should denote the equation for rescaling the following 7 categories into one value. The final weighted average is 0.57, which is possible by subtracting one and ...
- 31
2
votes
1
answer
52
views
item response theory - criteria for selecting items
I'm trying to use IRT to select the best items for a one-factor scale that has 20 items.
I was wondering what I need to be looking at if I wanted to select 5 or so items from these items (for a short ...
- 331
2
votes
0
answers
18
views
Why/when do attitudinal scales introduce endogeneity?
I use an example to illustrate my question.
I have a model that explains choice of low fat vs full fat milk, that was actually bought in a store. We model it with a binary logistic regression.
The ...
0
votes
1
answer
25
views
0
votes
0
answers
41
views
Factor analysis for categorical data
I was wondering if some of you, experts can provide me advise on my data analysis. I have created a scale with categorical data (options with individual values rather than rating/likert scale or ...
- 21
2
votes
0
answers
405
views
How to test for unidimensionality using the mirt r-package?
As it is my understanding that the ltm-package is obsolete, I'm looking for an equivalent to ltm::unidimTest() in the mirt-...
- 243
1
vote
1
answer
206
views
Negative factor-level correlations between factors, which don't show at the manifest level
I am developing a scale which consists of six scale dimensions, six items per dimension, with hypothesized positive relationships between all factors. All scale dimensions have positive correlations ...
- 13
1
vote
1
answer
162
views
Should subscales be analyzed separately under the IRT Graded Response model?
Suppose I have a Likert scale type questionnaire that assesses the amount of social support a patient receives. The questionnaire is divided into four subscales that measure:
Emotional support
...
- 345
1
vote
0
answers
19
views
Interesting and unusual dependent variable--how do you think it should be handled?
We have 2 dependent measures, which are both distributed from -4 to +4 in discrete steps. This is because the values are based on people's responses to four questions about whether they spend more ...
- 55
2
votes
1
answer
90
views
Is there a point to using EFA for scale validation when you can always fit a second-order CFA?
I have been trying to understand the use of Exploratory Factor Analysis for the purpose of scale validation.
Say you have developed a scale to measure construct X, which is supposed to be one unified ...
- 21
0
votes
1
answer
40
views
Multiple dimension scale development - validation using SEM
I'm developing a scale for measuring customer experience. Based on the principal component analysis I established that it has three components (11 items). Now I need to validate it by relating it to ...
1
vote
2
answers
102
views
What does scale exactly mean?
I am not so familiar with statistical concepts. I am preparing a questionnaire to measure underlying constructs that affect pedestrian's road crossing behavior. However, I came across this term called ...
1
vote
1
answer
77
views
How to Interpret Reflective Measurement Model?
Given $F$ is a latent construct (cause), and $Y_1$, $Y_2$, and $Y_3$ are the manifest (indicator) variables (effects) which are measured. Then, there are two groups of people (A and B). According to ...
- 11
3
votes
1
answer
94
views
Scales correlate negatively, but average correlates positively!
I have a total relationship quality variable constructed as the mean of three other scales. Each of these three (family, friend, and spouse) scales is significantly negatively associated with an ...
- 129
2
votes
1
answer
42
views
Are average online ratings of products (say out of 5) assumed to be on a linear scale as understood by the user?
Suppose 2 washing machines A & B are rated as 3.5 and 4.0 (out of 5) respectively, vs another 2, C & D, that are rated as 4.2 and 4.7 respectively. Can I make some useful inference based on ...
- 175
3
votes
0
answers
36
views
Using a constructed scale and an individual component of that scale in a statistical model
I am working with a colleague who wants to include a term in our linear mixed effect model that is also an individual component of a scale that we constructed and have in our model (both as predictors)...
- 31
1
vote
0
answers
161
views
Interpretation of factor loadings/eigenvalues
I have conducted an exploratory factor analysis using principal axis factoring, with direct oblimin rotation. The results indicate two factors, in that there are two factors with eigenvalues above 1, ...
1
vote
0
answers
115
views
Combining items with low correlation and low internal validity using combinatory logic
So I want to combine four items into an index on strong theoretical grounds (scroll all the way down in case you are interested in what those grounds are) but looking at the statistics, I get abysmal ...
- 108
1
vote
0
answers
909
views
How to calculate alpha reliability of a scale (factor) when it is expressed in factor scores?
I am doing a Principal Axis Factor Analysis, I found two factors and saved the factor scores for each, using the regression approach (as in the SPSS option by default).
My question is, how do I ...
- 113
0
votes
1
answer
47
views
Convergent Validity with Multiple New Scales
I am interested in creating a new scale in a field that is overwhelmingly understudied in the research literature. I would like to test the convergent validity by modifying another survey instrument ...
- 3
15
votes
1
answer
44k
views
What is the difference between formative and reflective measurement models?
Can anyone provide examples as to why choose one over the other? Are they calculated diferently?
- 591
2
votes
3
answers
2k
views
"Two stage" factor Analysis: factoring saved factor scores
I have a model which consists of 19 questions, which are divided in three factors (factor 1 - nine questions, factor 2 - six questions, factor 3 - four questions). For this I did a factor analysis and ...
- 21
18
votes
2
answers
19k
views
Creating a single index from several principal components or factors retained from PCA/FA
I am using Principal Component Analysis (PCA) to create an index required for my research. My question is how I should create a single index by using the retained principal components calculated ...
- 283
10
votes
1
answer
6k
views
What is the relationship between scale reliability measures (Cronbach's alpha etc.) and component/factor loadings?
Let's say I have a dataset with scores on a bunch of questionnaire items, which are theoretically comprised of a smaller number of scales, like in psychology research.
I know a common approach here ...
- 101
8
votes
1
answer
897
views
Validation of a questionnaire in a new population
I have 400 responses to a 20 item questionnaire which purports to measure an attitudinal constuct in medical students. The instrument was validated in the US for a single year of medical students and ...
- 81
3
votes
1
answer
921
views
Item response theory vs. summative Likert scale
If the items to be "summed" or combined to create an overall index are collectively the underlying construct (i.e. I am trying to measure compliance to an intervention which has different components), ...
- 53
5
votes
3
answers
2k
views
When is appropriate to run a factor analysis at items level vs. scale level in a questionnaire?
I am doing a research validating a new questionnaire, which has 156 items divided up in 12 scales. I have run a factor analysis at scale level, which gives me two nice constructs (consistent with ...
- 51
4
votes
1
answer
9k
views
Item analysis for a likert-type questionnaire - item discrimination, point-biserial, factor analysis, cronbach's alpha, other diagnostics?
I'm working on a questionnaire that is intended to measure two constructs. There are presently 26 items in the questionnaire -- eleven for construct 1 and 15 for construct 2 -- and each item has five ...
- 295
12
votes
3
answers
8k
views
Validating questionnaires
I am designing a questionnaire for my dissertation. I am in the process of validating the questionnaire I have applied a Cronbach's alpha test to the initial sample group. The responses to the ...
john hall