Comparison of CAT Item Selection Criteria for Polytomous Items

Northwestern University Feinberg School of Medicine.
Applied Psychological Measurement (Impact Factor: 1.49). 09/2009; 33(6):419-440. DOI: 10.1177/0146621608327801
Source: PubMed


Item selection is a core component in computerized adaptive testing (CAT). Several studies have evaluated new and classical selection methods; however, the few that have applied such methods to the use of polytomous items have reported conflicting results. To clarify these discrepancies and further investigate selection method properties, six different selection methods are compared systematically. The results showed no clear benefit from more sophisticated selection criteria and showed one method previously believed to be superior-the maximum expected posterior weighted information (MEPWI)-to be mathematically equivalent to a simpler method, the maximum posterior weighted information (MPWI).

Download full-text


Available from: Seung W Choi
  • Source
    • "The item bank consisted of 62 four-category response depression items inquiring about depressive symptom experiences. These items are described extensively by Choi and Swartz (2009). We had response data from 730 respondents. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Widely used in various educational and vocational assessment applications, computerized adaptive testing (CAT) has recently begun to be used to measure patient-reported outcomes Although successful in reducing respondent burden, most current CAT algorithms do not formally consider it as part of the item selection process. This study used a loss function approach motivated by decision theory to develop an item selection method that incorporates respondent burden into the item selection process based on maximum Fisher information item selection. Several different loss functions placing varying degrees of importance on respondent burden were compared, using an item bank of 62 polytomous items measuring depressive symptoms. One dataset consisted of the real responses from the 730 subjects who responded to all the items. A second dataset consisted of simulated responses to all the items based on a grid of latent trait scores with replicates at each grid point. The algorithm enables a CAT administrator to more efficiently control the respondent burden without severely affecting the measurement precision than when using MFI alone. In particular, the loss function incorporating respondent burden protected respondents from receiving longer tests when their estimated trait score fell in a region where there were few informative items.
    Full-text · Article ·

  • No preview · Article · Jan 1995 · Methods in cell biology
  • [Show abstract] [Hide abstract]
    ABSTRACT: Studies the implementation of fractional-order algorithms in hybrid position/force control of robotic manipulators. The system robustness and performances are analysed in terms of time responses, and compared with other control approaches. Moreover, the effect of nonlinear phenomena at the robot joints such as nonlinear friction, dynamic backlash and flexibility is investigated
    No preview · Conference Paper · Jan 1998
Show more