Skip to main content

Questions tagged [item-analysis]

Item analysis is the process by which responses to a test are used to assess the overall quality of the test, and the quality of the items comprising the test.

Filter by
Sorted by
Tagged with
1 vote
1 answer
23 views

Expected test reliability for short, multiple-choice tests?

How might I calculate the expected test reliability (internal, e.g., KR-20) for tests of various lengths? What assumptions would underlie such calculations? Are there existing tables or calculators ...
Joel W.'s user avatar
  • 3,386
0 votes
0 answers
32 views

What do bad infit and outfit in dichotomous Rasch model signify?

I'm really a beginner with Psychometry. We've just started psychometry in our college and I've used software Jamovi for that purpose. Working with Dichotomous Rasch models to asses a Multiple choice ...
Zuhair Al-Johar's user avatar
2 votes
2 answers
239 views

Negative Cronbach's alpha – recode data, or use another method?

Below is a made up scenario to exemplify my issue. I have two questionnaires asking individuals how much headache they have compared with 7 days ago. The scale is from much less through little less, ...
Wandering_geek's user avatar
0 votes
1 answer
81 views

What does extremely high "item information value" mean in IRT?

As far as I understand, item information tells us how well an item contributes to score estimation precision and it ranges between 0 and 1. However, in my analysis (see the image), item 15 and item 6 ...
renakre's user avatar
  • 857
2 votes
0 answers
35 views

Improving Cronbach Alpha after removing highly correlated questions [closed]

I am currently conducing a cronbach alpha analysis on some questionnaire data and the cronbach scores are low. I have created a correlation matrix to see which items are highly correlated and which ...
Anna Caunt's user avatar
1 vote
1 answer
63 views

What kind of correlation is this?

I was wondering whether these 2 variables are correlated. According to the analysis, the correlation is 0.89, which is expected, as they are items of the same scale. But I'm having trouble with ...
iic's user avatar
  • 15
1 vote
0 answers
71 views

simulation of an item response theory 2PL model [closed]

I would like to simulate a 2PL probit model. I want to set up some arbitrary item parameters $a=(a_1,...,a_J)$, $b=(b_1,...,b_J)$ and abilities $\theta=(\theta_1,...,\theta_I)$ ($J$ number of items ...
Ludwig's user avatar
  • 63
1 vote
0 answers
102 views

How to identify careless responders when items negatively correlate with the total scale

I'm calculating the Cronbach's alpha on a dataset with the scores of the Coping Orientations to the Problems Experienced (COPE-NVI-25) with the R package psych. I ...
Gianluca78's user avatar
0 votes
1 answer
53 views

IRT models for repetitive items

I'm looking for literature about IRT models that fit for tests in which items are presented for each examinee more than once and/or different questions are asked for the same item. For example, in the ...
S H's user avatar
  • 1
0 votes
0 answers
19 views

DIF: validity of carrying out a t-test on the final sample?

I have run a DIF analysis of a questionnaire, to see how autistic men and women answer differently, with a total sample of 530 autistic men and 530 autistic women. I have a general hypothesis that the ...
T August's user avatar
0 votes
0 answers
33 views

DIF: match sample randomly or by age?

I am carrying out a DIF analysis comparing the scores of men and women on a questionnaire. A preliminary ANOVA revealed that when comparing total scores on the test, there is a significant effect of ...
T August's user avatar
5 votes
1 answer
2k views

Difference between IRT and EFA to find factors

I am learning about Item Response Theory in which items are used to assess ability. In principle, multiple latent abilities may exist and some items test the one, while other items test another. This ...
LBogaardt's user avatar
  • 582
2 votes
1 answer
154 views

Item analysis Skewness and Kurtosis True False Question

I made a test with 15 true/false Questions and about 100 people answered these questions. Now I'm doing the item analysis in R with the package sjPlot and the function sjt.itemanalysis(). Amongst ...
To Mate's user avatar
  • 87
2 votes
1 answer
47 views

Item sampling techniques to reduce processing time for questionnaire

I have a well-crafted draft of a questionnaire, containing 240 items. The average processing time is 20 secs per item, so the entire questionnaire would take around 1 hour 20 min to complete. I want ...
Comfort Eagle's user avatar
1 vote
1 answer
206 views

Low internal consistency

I am currently analyzing the data for a survey I have completed. In doing so, one question is quite simple (nominal) and require a typical “I do/I do not” and “I do not/I do” response from the ...
user241842's user avatar
0 votes
1 answer
73 views

item selection procedure for a questionnaire representing several latent variables / constructs

i have drafted 51 items that are supposed to measure 9 distinct but related constructs, and have collected data on this questionnaire from 530 people. ultimately, i want to use these data for a sem. ...
heinbl0ed's user avatar
0 votes
1 answer
13 views

Accounting for measurement Bias across manufacturers and multiple treatments

I've been trying to figure out the appropriate statistical approach for the following problem from work (simplified here): I've got 5 manufacturers of a drug and each manufacturer makes their own ...
jamesvillarrubia's user avatar
0 votes
0 answers
76 views

Internal consistency

I have to analyse a dataset in which there are drugs and used animals based on article review. The datasets looks like this: ...
Drone's user avatar
  • 1
1 vote
2 answers
253 views

Item analysis with small sample size

I gave a 12 item true-false quiz (which I created) to my 19 students. I noticed that some questions were very obviously easier than others, so I decided to run an item analysis. By looking at the ...
iamnarra's user avatar
  • 213
0 votes
0 answers
48 views

Handful of IRT scores all exactly the same value

I am using the mirt package in R to model some latent variables. They seem to be working fine, except that a bunch of the scores generated are exactly the same. Most of the scores are within two or ...
karen's user avatar
  • 41
5 votes
1 answer
377 views

Is Item Response Theory (IRT) a form of reinforcement learning?

I was doing studies in reinforcement learning and trying to apply it in Computerised Adaptive Testing (CAT). While learning IRT, I felt it is similar to behaviour of RL setting - receiving feedback ...
Aljo Jose's user avatar
  • 523
-1 votes
1 answer
330 views

What's the criteria of deleting item? [closed]

What's the recognized criteria in statistics world?
WhiteGirl's user avatar
  • 487
2 votes
1 answer
485 views

Item Response Theory vs Rasch Model

1) What's the difference between Item Response Theory and Rasch model? 2) What's the pros and cons between them? To me, they seem to be very similar as in they both analyze the performance of ...
munmunbb's user avatar
0 votes
1 answer
334 views

How to merge measurement items and assess reliability

I have measurement items like (just as an example): "Having taken medicine A .... I felt that I am feeling better I felt that it helped me I felt that it is necessary to take it again I felt that I ...
Ferit's user avatar
  • 175
0 votes
1 answer
2k views

Calculating R-squared from item-factor loadings

If I have run a Confirmatory Factor Analysis and have all of the standardized loadings of each item onto its respective variable, how would I calculate the R-squared for each item? Is it simply the ...
Wade Byron Profe's user avatar
3 votes
1 answer
312 views

How to interpret meaning of regressors in this logistic regression model?

I'm trying to understand the model in this paper where they treat the item response theory model as a form of logistic regression. In the model the probability of getting an item (question) correct ...
2daaa's user avatar
  • 257
1 vote
0 answers
730 views

What are the most important components of an item analysis of a MCQ exam?

I'm analyzing results of undergraduate exams that range from 60 to 100 multiple choice questions. The number of students doing any given exam ranges from ~70 to ~1000. In all cases students select ...
user1205901 - Слава Україні's user avatar