Questions tagged [scale-construction]
Construction of a measuring scale for a "trait" as a sum (or other function) of individual variables ("items"). Various methods to validate the construction exist (including factor analysis, external criterion, experts opinion etc.).
39
questions
1
vote
1
answer
27
views
Measurement of construct confusion
What are the different ways of measuring a construct? I have three items for one construct. The three questions are derived from articles, and they are used commonly as items to measure the variable. ...
- 65
1
vote
2
answers
120
views
Psychometrics - transferability of CFA and factor loadings to observed scores/sum scores in scale development
I have come across a situation in a dataset using a not very used scale, evaluated partly using confirmatory factor analysis (CFA). The CFA has provided support for a number of subscales. In some of ...
0
votes
0
answers
40
views
Development of an adaptive scale
I need your help with a problem that I noticed and I don't know the solution (I am not from statistics). In sum, I would like to create a measurement instrument that is adaptive in that respondents ...
2
votes
0
answers
234
views
How to construct a scale from factor analysis
I have conducted exploratory factor analysis with psych and confirmatory factor analysis with lavaan (following the code on ch 15 of this book: https://doi.org/10.1515/9783110786088) on a dataset. ...
- 93
2
votes
1
answer
636
views
Using Factor Analysis for Items on Different Scales [closed]
I have a quick question about factor analysis from different scales. Is it advisable to use, conjunctly, items from different measures? For example, if I am interested in doing EFA in the context of ...
- 61
1
vote
0
answers
266
views
Computing IRT score reliability across a range of ability in mirt
I am using mirt and would like to get reliability estimates across a range of ability for a 1-factor scale. Essentially, I would like to extract the data used to ...
- 11
0
votes
2
answers
332
views
Do you need validators for a demographic profile questionnaire?
I am conducting a thesis and I created a survey questionnaire that would help to answer the questions in my statement of the problem.
Now, I am wondering if the questionnaire I created is already good ...
- 11
1
vote
0
answers
315
views
Is it necessary to do a second order CFA to create a total score summing across factors?
I am in the process of developing a scale. I have already performed EFA on the first dataset I collected, which showed strong support for a 4 factor structure. I am now planning to collect another ...
- 87
1
vote
0
answers
26
views
Is it legitimate to combine two scales of interest on different topics to one based on the intervention condition?
I am doing research where we study students' motivation when working on physics learning tasks. In doing so, we give students learning tasks that are motivated by different contexts, so that they ...
- 11
6
votes
1
answer
2k
views
How to do exploratory factor analysis in a repeated measure design?
In my experiment participants answered to the same scale twice, after the presentation of two different stimuli, i.e., repeated measures design.
The scale validation is not the main focus of my study, ...
- 143
2
votes
0
answers
2k
views
Equation for weighted average with normalization(?)
I am trying to understand how I should denote the equation for rescaling the following 7 categories into one value. The final weighted average is 0.57, which is possible by subtracting one and ...
- 31
2
votes
1
answer
215
views
item response theory - criteria for selecting items
I'm trying to use IRT to select the best items for a one-factor scale that has 20 items.
I was wondering what I need to be looking at if I wanted to select 5 or so items from these items (for a short ...
- 371
2
votes
0
answers
27
views
Why/when do attitudinal scales introduce endogeneity?
I use an example to illustrate my question.
I have a model that explains choice of low fat vs full fat milk, that was actually bought in a store. We model it with a binary logistic regression.
The ...
- 235
0
votes
1
answer
25
views
0
votes
0
answers
47
views
Factor analysis for categorical data
I was wondering if some of you, experts can provide me advise on my data analysis. I have created a scale with categorical data (options with individual values rather than rating/likert scale or ...
- 21
2
votes
0
answers
937
views
How to test for unidimensionality using the mirt r-package?
As it is my understanding that the ltm-package is obsolete, I'm looking for an equivalent to ltm::unidimTest() in the mirt-...
- 293
1
vote
1
answer
962
views
Negative factor-level correlations between factors, which don't show at the manifest level
I am developing a scale which consists of six scale dimensions, six items per dimension, with hypothesized positive relationships between all factors. All scale dimensions have positive correlations ...
- 13
2
votes
1
answer
286
views
Should subscales be analyzed separately under the IRT Graded Response model?
Suppose I have a Likert scale type questionnaire that assesses the amount of social support a patient receives. The questionnaire is divided into four subscales that measure:
Emotional support
...
- 415
1
vote
0
answers
27
views
Interesting and unusual dependent variable--how do you think it should be handled?
We have 2 dependent measures, which are both distributed from -4 to +4 in discrete steps. This is because the values are based on people's responses to four questions about whether they spend more ...
- 55
2
votes
1
answer
252
views
Is there a point to using EFA for scale validation when you can always fit a second-order CFA?
I have been trying to understand the use of Exploratory Factor Analysis for the purpose of scale validation.
Say you have developed a scale to measure construct X, which is supposed to be one unified ...
- 21
0
votes
1
answer
62
views
Multiple dimension scale development - validation using SEM
I'm developing a scale for measuring customer experience. Based on the principal component analysis I established that it has three components (11 items). Now I need to validate it by relating it to ...
1
vote
2
answers
122
views
What does scale exactly mean?
I am not so familiar with statistical concepts. I am preparing a questionnaire to measure underlying constructs that affect pedestrian's road crossing behavior. However, I came across this term called ...
1
vote
1
answer
121
views
How to Interpret Reflective Measurement Model?
Given $F$ is a latent construct (cause), and $Y_1$, $Y_2$, and $Y_3$ are the manifest (indicator) variables (effects) which are measured. Then, there are two groups of people (A and B). According to ...
- 111
4
votes
1
answer
105
views
Scales correlate negatively, but average correlates positively!
I have a total relationship quality variable constructed as the mean of three other scales. Each of these three (family, friend, and spouse) scales is significantly negatively associated with an ...
- 365
2
votes
1
answer
62
views
Are average online ratings of products (say out of 5) assumed to be on a linear scale as understood by the user?
Suppose 2 washing machines A & B are rated as 3.5 and 4.0 (out of 5) respectively, vs another 2, C & D, that are rated as 4.2 and 4.7 respectively. Can I make some useful inference based on ...
- 175
3
votes
0
answers
36
views
Using a constructed scale and an individual component of that scale in a statistical model
I am working with a colleague who wants to include a term in our linear mixed effect model that is also an individual component of a scale that we constructed and have in our model (both as predictors)...
- 31
2
votes
0
answers
189
views
Interpretation of factor loadings/eigenvalues
I have conducted an exploratory factor analysis using principal axis factoring, with direct oblimin rotation. The results indicate two factors, in that there are two factors with eigenvalues above 1, ...
1
vote
0
answers
173
views
Combining items with low correlation and low internal validity using combinatory logic
So I want to combine four items into an index on strong theoretical grounds (scroll all the way down in case you are interested in what those grounds are) but looking at the statistics, I get abysmal ...
- 118
1
vote
0
answers
1k
views
How to calculate alpha reliability of a scale (factor) when it is expressed in factor scores?
I am doing a Principal Axis Factor Analysis, I found two factors and saved the factor scores for each, using the regression approach (as in the SPSS option by default).
My question is, how do I ...
- 143
0
votes
1
answer
73
views
Convergent Validity with Multiple New Scales
I am interested in creating a new scale in a field that is overwhelmingly understudied in the research literature. I would like to test the convergent validity by modifying another survey instrument ...
- 3
15
votes
1
answer
51k
views
What is the difference between formative and reflective measurement models?
Can anyone provide examples as to why choose one over the other? Are they calculated diferently?
- 611
2
votes
3
answers
2k
views
"Two stage" factor Analysis: factoring saved factor scores
I have a model which consists of 19 questions, which are divided in three factors (factor 1 - nine questions, factor 2 - six questions, factor 3 - four questions). For this I did a factor analysis and ...
- 21
19
votes
2
answers
22k
views
Creating a single index from several principal components or factors retained from PCA/FA
I am using Principal Component Analysis (PCA) to create an index required for my research. My question is how I should create a single index by using the retained principal components calculated ...
- 293
11
votes
1
answer
6k
views
What is the relationship between scale reliability measures (Cronbach's alpha etc.) and component/factor loadings?
Let's say I have a dataset with scores on a bunch of questionnaire items, which are theoretically comprised of a smaller number of scales, like in psychology research.
I know a common approach here ...
- 111
8
votes
1
answer
1k
views
Validation of a questionnaire in a new population
I have 400 responses to a 20 item questionnaire which purports to measure an attitudinal constuct in medical students. The instrument was validated in the US for a single year of medical students and ...
- 81
3
votes
1
answer
1k
views
Item response theory vs. summative Likert scale
If the items to be "summed" or combined to create an overall index are collectively the underlying construct (i.e. I am trying to measure compliance to an intervention which has different components), ...
- 53
6
votes
3
answers
2k
views
When is appropriate to run a factor analysis at items level vs. scale level in a questionnaire?
I am doing a research validating a new questionnaire, which has 156 items divided up in 12 scales. I have run a factor analysis at scale level, which gives me two nice constructs (consistent with ...
- 61
4
votes
1
answer
10k
views
Item analysis for a likert-type questionnaire - item discrimination, point-biserial, factor analysis, cronbach's alpha, other diagnostics?
I'm working on a questionnaire that is intended to measure two constructs. There are presently 26 items in the questionnaire -- eleven for construct 1 and 15 for construct 2 -- and each item has five ...
- 305
14
votes
3
answers
9k
views
Validating questionnaires
I am designing a questionnaire for my dissertation. I am in the process of validating the questionnaire I have applied a Cronbach's alpha test to the initial sample group. The responses to the ...
john hall