The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [item-analysis]

Item analysis is the process by which responses to a test are used to assess the overall quality of the test, and the quality of the items comprising the test.

Filter by
Sorted by
Tagged with
3
votes
1answer
234 views

How to interpret meaning of regressors in this logistic regression model?

I'm trying to understand the model in this paper where they treat the item response theory model as a form of logistic regression. In the model the probability of getting an item (question) correct ...
3
votes
0answers
244 views

Is Item Response Theory (IRT) a form of reinforcement learning?

I was doing studies in reinforcement learning and trying to apply it in Computerised Adaptive Testing (CAT). While learning IRT, I felt it is similar to behaviour of RL setting - receiving feedback ...
2
votes
1answer
286 views

Item Response Theory vs Rasch Model

1) What's the difference between Item Response Theory and Rasch model? 2) What's the pros and cons between them? To me, they seem to be very similar as in they both analyze the performance of ...
2
votes
1answer
35 views

Item sampling techniques to reduce processing time for questionnaire

I have a well-crafted draft of a questionnaire, containing 240 items. The average processing time is 20 secs per item, so the entire questionnaire would take around 1 hour 20 min to complete. I want ...
1
vote
0answers
461 views

What are the most important components of an item analysis of a MCQ exam?

I'm analyzing results of undergraduate exams that range from 60 to 100 multiple choice questions. The number of students doing any given exam ranges from ~70 to ~1000. In all cases students select ...
0
votes
1answer
20 views

item selection procedure for a questionnaire representing several latent variables / constructs

i have drafted 51 items that are supposed to measure 9 distinct but related constructs, and have collected data on this questionnaire from 530 people. ultimately, i want to use these data for a sem. ...
0
votes
1answer
85 views

Item analysis with small sample size

I gave a 12 item true-false quiz (which I created) to my 19 students. I noticed that some questions were very obviously easier than others, so I decided to run an item analysis. By looking at the ...
0
votes
1answer
792 views

Calculating R-squared from item-factor loadings

If I have run a Confirmatory Factor Analysis and have all of the standardized loadings of each item onto its respective variable, how would I calculate the R-squared for each item? Is it simply the ...
0
votes
1answer
16 views

Item analysis Skewness and Kurtosis True False Question

I made a test with 15 true/false Questions and about 100 people answered these questions. Now I'm doing the item analysis in R with the package sjPlot and the function sjt.itemanalysis(). Amongst ...
0
votes
0answers
16 views

How can Item Response Theory be used to remove questions asked in a customer satisfaction survey?

I have results from a survey of around 30 Likert-style questions that are asked of customers on their opinion about company X. Each of the 30 questions belongs to a certain category. For example, ...
0
votes
1answer
12 views

Accounting for measurement Bias across manufacturers and multiple treatments

I've been trying to figure out the appropriate statistical approach for the following problem from work (simplified here): I've got 5 manufacturers of a drug and each manufacturer makes their own ...
0
votes
0answers
61 views

Internal consistency

I have to analyse a dataset in which there are drugs and used animals based on article review. The datasets looks like this: ...
0
votes
0answers
33 views

Handful of IRT scores all exactly the same value

I am using the mirt package in R to model some latent variables. They seem to be working fine, except that a bunch of the scores generated are exactly the same. Most of the scores are within two or ...
0
votes
1answer
56 views

How to merge measurement items and assess reliability

I have measurement items like (just as an example): "Having taken medicine A .... I felt that I am feeling better I felt that it helped me I felt that it is necessary to take it again I felt that I ...
-1
votes
1answer
105 views

What's the criteria of deleting item? [closed]

What's the recognized criteria in statistics world?