Questions tagged [item-response-theory]
Item Response Theory (IRT) is a set of statistical methods for modeling responses to test items. Use this tag for on-topic questions about (a) the theory itself (b) models appropriate for a specific case (c) implementing IRT in a specific tool such as an R package.
266
questions
0
votes
0
answers
21
views
irt hybrid model predict latent estimate using bayesian method
I'm having some problem about irt prediction model.
When i use irt hybrid model, it cannot predict the latent value even it has successfully converge during the irt model processed.
It contain binary ...
- 11
1
vote
0
answers
36
views
Model test sensitivity to ability
I have a set of tests and a population of agents whose ability I want to assess. Each agent has taken some of the tests. The agents have no memory of the tests they have taken, so each time an agent ...
- 183
0
votes
0
answers
14
views
What do bad infit and outfit in dichotomous Rasch model signify?
I'm really a beginner with Psychometry. We've just started psychometry in our college and I've used software Jamovi for that purpose.
Working with Dichotomous Rasch models to asses a Multiple choice ...
- 163
1
vote
1
answer
59
views
how do i transform irt discrimination parameters of a 2PL model into factor loadings
I estimated a 2PL model for ordinal data and got discrimination as well as difficulty parameters for each item. To be able to estimate a cut-off value for the discrimination parameter, i wanted to ...
- 11
2
votes
1
answer
43
views
Repeating the same item with different offsets using the *mirt* package
Let's imagine that we want to develop an IRT model that describes the probability that a basketball player scores a basket when he shoots the ball from a certain distance. Distance is a continuous ...
- 801
1
vote
1
answer
42
views
Item response theory has "graded" models for Likert items. Is there an IRT model for if some items that are "Likert" and some that are "binary"?
Item Response Theory is most conventionally applied to binary data, but can also be applied to Likert data with "graded" models. But what if you have data that is a mixture of both Likert ...
- 838
0
votes
0
answers
23
views
Get random effect value from pattern of data
Rasch models are typically fit through an item response theory framework, but can also be estimated through a mixed effects model (e.g., see here). This is highly useful in my case because of some of ...
- 133
0
votes
0
answers
33
views
What does extremely high "item information value" mean in IRT?
As far as I understand, item information tells us how well an item contributes to score estimation precision and it ranges between 0 and 1.
However, in my analysis (see the image), item 15 and item 6 ...
- 857
6
votes
1
answer
197
views
Predict person parameters in explanatory IRT with lme4
I am using glmer from lm4 in R to run an explanatory IRT analysis. The aim is to model person parameters with items nested in persons and to control for age (the test scale has 10 items; all persons ...
0
votes
0
answers
64
views
Longitudinal IRT model specification using MIRT bfactor function
I try to specify / calculate a longitudinal IRT latent growth model to compare learning gains between three school years in a large data set. The test were administered by a computer adaptive testing ...
- 1
0
votes
1
answer
36
views
Is ceiling effect mitigated by standardisation, renorming or combining with other indicators?
I have a psychological test that consist of a set of binary items. It has a noticeable ceiling effect in the sum scores (essentially, a majority of participants get most items correct).
I also see ...
- 275
0
votes
0
answers
34
views
Python implementation of Marginal Maximum Likelihood estimate based 2-PL Dichotomous IRT
I am looking for implementations of simple Marginal Maximum Likelihood Estimate based 2-PL IRT Item estimation in Python. Any relevant Python libraries that do this (similar to snowIRT module in ...
- 121
2
votes
0
answers
49
views
Implementing a 2-PL Dichotomous IRT Module in Python from scratch
I am trying to implement a 2-PL dichotomous IRT Model for my dataset from scratch in Python. Here is my code so far:
...
- 121
0
votes
0
answers
39
views
Development of an adaptive scale
I need your help with a problem that I noticed and I don't know the solution (I am not from statistics). In sum, I would like to create a measurement instrument that is adaptive in that respondents ...
0
votes
0
answers
24
views
What does MSE mean in the calculation of separation reliability for rasch model?
In the Rasch model, the reliability of separation can be calculated as 1 - (MSE / SD^2), where SD represents the standard deviation of person location measures on a logit scale, and MSE refers to the ...
- 33
0
votes
0
answers
18
views
How to interpret factor analysis output here
I am using girth package which uses polychoric correlation and then applies factor analysis. I am using the example code given on above webpage under the subheading "Polychoric Correlation ...
- 9,587
0
votes
0
answers
16
views
When using different groups of examinees to answer the same set of items, whether the item parameter should be invariant?
I am now doing a project to estimate the item parameters from the pharmacotherapy exams. Two groups of students from the same university answer the same set of items. From my understanding, the item ...
- 1
0
votes
1
answer
71
views
How can I solve identifiability problems in my STAN estimation?
So I am trying to validate my STAN model before using real data and am having some trouble estimating parameters separately. My data structure contains count data with people on the rows, and test ...
- 1
1
vote
1
answer
23
views
How to interpret Location parameters in Generalised Partial Credit Model?
I am struggling to interpret the location parameters in generalised partial credit models.
Say you have location parameters $a_1$,$a_2$ and $a_3$. My professor said that for the item to be accepted ...
- 21
1
vote
0
answers
17
views
Must questionnaire questions have the same number of options for IRT models to work?
Given a questionnaire whose questions have different numbers of options available say having questions with ratings from 1-2 and 1-5. Could I use polytomous models such as a partial credit model to ...
- 21
1
vote
0
answers
37
views
Comparing scores on different dimensions in factor models
So I'm currently conducting some research where I'm using item response theory (IRT) to estimate the difficulty of school subjects in Norway. It turns out that a two-dimensional, simple-structure ...
- 11
0
votes
0
answers
134
views
Graded response model and generalized partial credit model show very different discrimination values. Which one to trust?
I have data from N = 265 people for some 7-point Likert-items that I would like to investigate. I am interested in selecting the best items for a scale. The items all load onto the same factor.
I have ...
- 63
2
votes
0
answers
28
views
Factor analysis (or similar) for data set with both continuous and dichotomous variables (+control for age?)
As you can tell from the title I'm in a bit of a fix. I have a data set with three continuous variables and one dichotomous one. Data collected from four groups. The data set is a developmental ...
- 21
1
vote
0
answers
291
views
Fixing item parameters in MIRT
I am trying to estimate a multiple group model where I fix some of the item parameters and estimate the rest. I was expecting that this scenario would allow me to remove the restriction on the ...
2
votes
0
answers
123
views
Estimating a higher-oder IRT model in R
Hi everyone,
I am trying to estimate a higher-order model with the mirt package in R.
I have already conducted an analysis using ...
- 21
0
votes
0
answers
35
views
How can I run IRT-RSM on categorical items for measures of noncognitive skills if for some levels for some items there are 0 observations?
I am working on data with psychosocial scales in Stata. There are five measures of psychosocial ability used in the data, with between 4 to 9 items for each. All the items are measured on 4-pt Likert ...
1
vote
1
answer
264
views
How does an item intercept in CFA relate to the difficulty parameter in IRT?
I am having difficulty clarifying in my mind how item intercepts in Confirmatory Factor Analysis or SEM manifest, and how they are graphically represented in an IRT ICC plot. I understand that multi-...
- 95
3
votes
0
answers
91
views
How is item response theory (IRT) with continuous responses related to factor analysis/SEM?
Nearly all of the papers and posts I've seen focus on the equivalence of confirmatory factor analysis (CFA) or structural equation modeling (SEM) with item response theory (IRT) models when the data ...
- 731
2
votes
1
answer
106
views
How to interpret the Rasch reliability?
I am tasked to model a set of questionnaires in order to investigate about the food insecurity in the region where my project takes place. Using the Rasch model, I was able to conduct the protocol ...
- 243
2
votes
1
answer
42
views
Do you have to assess reliability for non-composite scores?
I feel like this is probably a really stupid question but I'm having issues finding the answer. When I think of reliability, normally I think of several items on a test that are compiled into some ...
- 8,814
0
votes
2
answers
46
views
What is the name for an explanatory item response model where the predictors include latent variables?
Explanatory item response models add predictors of the $\theta$ "ability" parameter. However, these predictors are always observed covariates. Sometimes, one may want to include latent ...
- 731
1
vote
0
answers
29
views
Confirmatory factor analysis parameterization of the 2-PL item response model
For binary item response $i$ by person $j$, the 2-PL item response model is of the form:
$$Response_{ij} \sim Bernoulli(p_{ij})$$
$$logit(p_{ij}) \sim \alpha_i(\theta_j - \eta_i)$$
Usually, $\alpha_i$ ...
- 731
1
vote
0
answers
119
views
Item Factor Analysis, Item Response Theory and Exploratory IRT [duplicate]
I would be grateful if someone could explain the difference between Item Factor Analysis, Item Response Theory and Exploratory IRT. Any references especially for the exploratory IRT are welcome.
Nikos
1
vote
1
answer
495
views
Is it acceptable/common practice to report IRT theta scores as a percentile?
I have been teaching myself IRT. I think I get it, however, I've not yet reached a point where I would say that I'm totally confident.
In assuming that the latent trait is normally distributed with ...
- 235
1
vote
0
answers
197
views
Computing IRT score reliability across a range of ability in mirt
I am using mirt and would like to get reliability estimates across a range of ability for a 1-factor scale. Essentially, I would like to extract the data used to ...
- 11
2
votes
1
answer
242
views
Chi square statistics (chen & thissen, 1997) for local dependence testing in IRT models
I have recently computed the test for local dependence based on X2 statistics (Chen & Thissen, 1997) in RStudio with the mirt package like this:
residuals(fit.SKIDDETdisc,
type = "LD",
...
- 51
0
votes
0
answers
27
views
How do I calculate different reliabilty levels of theta when standard error of theta is known? (IRT-model) [duplicate]
I've recently seen a plot where the level of reliability is given for different SE values of theta estimates:
I have also plotted the standard errors of theta as a function of theta but now I am ...
- 51
1
vote
1
answer
152
views
Calculation of reliability of scale scores in an IRT- model
While trying to compute the reliability of scale scores obtained from IRT models (bifactor models and unidimensional models) I was wondering why there are so many published papers who report omega ...
- 51
4
votes
1
answer
109
views
Methods for drawing population inferences from multiple sub-population datasets
What would be an appropriate model or method for making inferences about a broader population quantity from multiple quantities representing subsets of the population?
Imagine, as an example, that I ...
- 1,272
1
vote
1
answer
76
views
Within item response theory, what is the $\theta$-grid?
Within item response theory, the latent trait (e.g., ability) is often depicted as $\theta$. Within item response theory, I have also come across the term $\theta$-grid. For example, the description ...
- 531
7
votes
2
answers
510
views
Discrimination/Slope Item Response Theory Models
In item response theory (IRT), 1-PL models, which include a slope parameter in addition to the intercept parameter, are better able to discriminate test-taker talent. Higher slopes translate to ...
- 2,517
1
vote
0
answers
51
views
Item Response Theory for Continuous-Unbounded Response
I would like to model a problem using IRT, but my response is continuous and possibly infinite (e.g. score of a game).
I'm aware of Samejima's and Wang and Zeng's approach, but both attempts to bound ...
- 11
0
votes
0
answers
32
views
Rasch Analysis: comparison of the distribution person location estimates across independent samples
I hardly understand Rasch analysis (and this isn't my goal) but I need to clarify the following questions before delving deeper:
Does it make any sense within the framework of Rasch analysis (and ...
- 101
1
vote
1
answer
103
views
IRT when each exam has a different set of questions from a common pool
I have a dataset with 0/1 response data for a set of test questions. There are approx 7.5k items that have been randomly allocated to participants in an online quiz. Just over 10,000 participants (set ...
- 11
1
vote
0
answers
19
views
Using IRT, how would you find the updated ability of someone after answering a calibrated item?
For this project, I have a list of items that were calibrated under the 3PL model using the mirt package. I had a pilot study run to help estimate these items. Now, using a different group of people, ...
2
votes
0
answers
27
views
Which item to administer to improve the standard error of the item difficulty estimate the most?
I have a student with a known ability level and a set of items with an estimated difficulty. The probability of a student getting an item correct follows an 1 parameter logistic model (also known as ...
- 7,399
0
votes
1
answer
123
views
Interpret ANOVA analysis of model fit IRT, TAM Package
I posted this question on Stack Overflow, but was advised to post it here.
I fitted the same data set to a 1PL item response theory model (called onePL below), and ...
- 1
0
votes
0
answers
125
views
mirt: GRM with symmetrical thresholds
I'm looking for a way to fit a graded response model where the thresholds are symmetrically located around zero. The mirt.model command allows you to add an ...
- 801
1
vote
1
answer
38
views
Psychometric test validation question
We are trying to validate a test for young children using IRT analyses (rasch/2pl). Models do not converge due to a floor effect. Teachers also took this assessment. Would it skew results if i ...
- 11
0
votes
0
answers
206
views
How to handle missing data (when items not present) in IRT analysis in R
I am trying to calibrate an Item bank using IRT 2PL analysis in R. I have 60 dichotomous Items in my bank, while at any given instance a random set of 25 items are presented to a test taker. I have ...
- 1