Questions tagged [scale-construction]

Construction of a measuring scale for a "trait" as a sum (or other function) of individual variables ("items"). Various methods to validate the construction exist (including factor analysis, external criterion, experts opinion etc.).

Filter by
Sorted by
Tagged with
0 votes
1 answer
32 views

Do you need validators for a demographic profile questionnaire?

I am conducting a thesis and I created a survey questionnaire that would help to answer the questions in my statement of the problem. Now, I am wondering if the questionnaire I created is already good ...
user avatar
1 vote
0 answers
12 views

Is it necessary to do a second order CFA to create a total score summing across factors?

I am in the process of developing a scale. I have already performed EFA on the first dataset I collected, which showed strong support for a 4 factor structure. I am now planning to collect another ...
user avatar
  • 125
1 vote
0 answers
22 views

Is it legitimate to combine two scales of interest on different topics to one based on the intervention condition?

I am doing research where we study students' motivation when working on physics learning tasks. In doing so, we give students learning tasks that are motivated by different contexts, so that they ...
user avatar
5 votes
1 answer
446 views

How to do exploratory factor analysis in a repeated measure design?

In my experiment participants answered to the same scale twice, after the presentation of two different stimuli, i.e., repeated measures design. The scale validation is not the main focus of my study, ...
user avatar
  • 113
2 votes
0 answers
601 views

Equation for weighted average with normalization(?)

I am trying to understand how I should denote the equation for rescaling the following 7 categories into one value. The final weighted average is 0.57, which is possible by subtracting one and ...
user avatar
  • 31
2 votes
1 answer
52 views

item response theory - criteria for selecting items

I'm trying to use IRT to select the best items for a one-factor scale that has 20 items. I was wondering what I need to be looking at if I wanted to select 5 or so items from these items (for a short ...
user avatar
  • 331
2 votes
0 answers
18 views

Why/when do attitudinal scales introduce endogeneity?

I use an example to illustrate my question. I have a model that explains choice of low fat vs full fat milk, that was actually bought in a store. We model it with a binary logistic regression. The ...
user avatar
0 votes
1 answer
25 views

Problem with stardardization in R [closed]

I have dataframe: I try compute stardardization ...
user avatar
  • 125
0 votes
0 answers
41 views

Factor analysis for categorical data

I was wondering if some of you, experts can provide me advise on my data analysis. I have created a scale with categorical data (options with individual values rather than rating/likert scale or ...
user avatar
2 votes
0 answers
405 views

How to test for unidimensionality using the mirt r-package?

As it is my understanding that the ltm-package is obsolete, I'm looking for an equivalent to ltm::unidimTest() in the mirt-...
user avatar
1 vote
1 answer
206 views

Negative factor-level correlations between factors, which don't show at the manifest level

I am developing a scale which consists of six scale dimensions, six items per dimension, with hypothesized positive relationships between all factors. All scale dimensions have positive correlations ...
user avatar
  • 13
1 vote
1 answer
162 views

Should subscales be analyzed separately under the IRT Graded Response model?

Suppose I have a Likert scale type questionnaire that assesses the amount of social support a patient receives. The questionnaire is divided into four subscales that measure: Emotional support ...
user avatar
  • 345
1 vote
0 answers
19 views

Interesting and unusual dependent variable--how do you think it should be handled?

We have 2 dependent measures, which are both distributed from -4 to +4 in discrete steps. This is because the values are based on people's responses to four questions about whether they spend more ...
user avatar
2 votes
1 answer
90 views

Is there a point to using EFA for scale validation when you can always fit a second-order CFA?

I have been trying to understand the use of Exploratory Factor Analysis for the purpose of scale validation. Say you have developed a scale to measure construct X, which is supposed to be one unified ...
user avatar
0 votes
1 answer
40 views

Multiple dimension scale development - validation using SEM

I'm developing a scale for measuring customer experience. Based on the principal component analysis I established that it has three components (11 items). Now I need to validate it by relating it to ...
user avatar
1 vote
2 answers
102 views

What does scale exactly mean?

I am not so familiar with statistical concepts. I am preparing a questionnaire to measure underlying constructs that affect pedestrian's road crossing behavior. However, I came across this term called ...
user avatar
1 vote
1 answer
77 views

How to Interpret Reflective Measurement Model?

Given $F$ is a latent construct (cause), and $Y_1$, $Y_2$, and $Y_3$ are the manifest (indicator) variables (effects) which are measured. Then, there are two groups of people (A and B). According to ...
user avatar
  • 11
3 votes
1 answer
94 views

Scales correlate negatively, but average correlates positively!

I have a total relationship quality variable constructed as the mean of three other scales. Each of these three (family, friend, and spouse) scales is significantly negatively associated with an ...
user avatar
  • 129
2 votes
1 answer
42 views

Are average online ratings of products (say out of 5) assumed to be on a linear scale as understood by the user?

Suppose 2 washing machines A & B are rated as 3.5 and 4.0 (out of 5) respectively, vs another 2, C & D, that are rated as 4.2 and 4.7 respectively. Can I make some useful inference based on ...
user avatar
  • 175
3 votes
0 answers
36 views

Using a constructed scale and an individual component of that scale in a statistical model

I am working with a colleague who wants to include a term in our linear mixed effect model that is also an individual component of a scale that we constructed and have in our model (both as predictors)...
user avatar
1 vote
0 answers
161 views

Interpretation of factor loadings/eigenvalues

I have conducted an exploratory factor analysis using principal axis factoring, with direct oblimin rotation. The results indicate two factors, in that there are two factors with eigenvalues above 1, ...
user avatar
1 vote
0 answers
115 views

Combining items with low correlation and low internal validity using combinatory logic

So I want to combine four items into an index on strong theoretical grounds (scroll all the way down in case you are interested in what those grounds are) but looking at the statistics, I get abysmal ...
user avatar
  • 108
1 vote
0 answers
909 views

How to calculate alpha reliability of a scale (factor) when it is expressed in factor scores?

I am doing a Principal Axis Factor Analysis, I found two factors and saved the factor scores for each, using the regression approach (as in the SPSS option by default). My question is, how do I ...
user avatar
  • 113
0 votes
1 answer
47 views

Convergent Validity with Multiple New Scales

I am interested in creating a new scale in a field that is overwhelmingly understudied in the research literature. I would like to test the convergent validity by modifying another survey instrument ...
user avatar
15 votes
1 answer
44k views

What is the difference between formative and reflective measurement models?

Can anyone provide examples as to why choose one over the other? Are they calculated diferently?
user avatar
  • 591
2 votes
3 answers
2k views

"Two stage" factor Analysis: factoring saved factor scores

I have a model which consists of 19 questions, which are divided in three factors (factor 1 - nine questions, factor 2 - six questions, factor 3 - four questions). For this I did a factor analysis and ...
user avatar
  • 21
18 votes
2 answers
19k views

Creating a single index from several principal components or factors retained from PCA/FA

I am using Principal Component Analysis (PCA) to create an index required for my research. My question is how I should create a single index by using the retained principal components calculated ...
user avatar
10 votes
1 answer
6k views

What is the relationship between scale reliability measures (Cronbach's alpha etc.) and component/factor loadings?

Let's say I have a dataset with scores on a bunch of questionnaire items, which are theoretically comprised of a smaller number of scales, like in psychology research. I know a common approach here ...
user avatar
  • 101
8 votes
1 answer
897 views

Validation of a questionnaire in a new population

I have 400 responses to a 20 item questionnaire which purports to measure an attitudinal constuct in medical students. The instrument was validated in the US for a single year of medical students and ...
user avatar
  • 81
3 votes
1 answer
921 views

Item response theory vs. summative Likert scale

If the items to be "summed" or combined to create an overall index are collectively the underlying construct (i.e. I am trying to measure compliance to an intervention which has different components), ...
user avatar
5 votes
3 answers
2k views

When is appropriate to run a factor analysis at items level vs. scale level in a questionnaire?

I am doing a research validating a new questionnaire, which has 156 items divided up in 12 scales. I have run a factor analysis at scale level, which gives me two nice constructs (consistent with ...
user avatar
  • 51
4 votes
1 answer
9k views

Item analysis for a likert-type questionnaire - item discrimination, point-biserial, factor analysis, cronbach's alpha, other diagnostics?

I'm working on a questionnaire that is intended to measure two constructs. There are presently 26 items in the questionnaire -- eleven for construct 1 and 15 for construct 2 -- and each item has five ...
user avatar
12 votes
3 answers
8k views

Validating questionnaires

I am designing a questionnaire for my dissertation. I am in the process of validating the questionnaire I have applied a Cronbach's alpha test to the initial sample group. The responses to the ...
user avatar