TY - JOUR
T1 - A computer adaptive testing simulation applied to the FIM instrument motor component
AU - Dijkers, Marcel P.
N1 - Funding Information:
From the Department of Rehabilitation Medicine, Mount Sinai School of Medicine, New York, NY. Supported by the National Institute on Disability and Rehabilitation Research, Office of Special Education and Rehabilitative Services, US Department of Education (grant nos. H133N50008, H133N5000027). No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the author(s) or upon any organization with which the author(s) is/are associated. Reprint requests to Marcel P. Dijkers, PhD, Mount Sinai School of Medicine, Dept of Rehabilitation Medicine, Box 1240, One Gustave Levy Pl, New York, NY 10029-6574, e-mail: [email protected]. 0003-9993/03/8403-6254$30.00/0 doi:10.1053/apmr.2003.50006
PY - 2003/3/1
Y1 - 2003/3/1
N2 - Objective: To determine whether computer adaptive testing (CAT) can be used to decrease the number of FIMTM instrument motor component items administered in assessing persons with spinal cord injury (SCI). Design: For a CAT simulation, a 3-step algorithm was used to select 6 FIM items for each individual; items were selected according to the subject's motor ability as estimated by 2 initial items. Separate estimates of motor ability for admission, discharge, and follow-up data (plus combined time points) derived from 6 items were compared statistically with estimates derived from 14 items (walking and wheelchair mobility were split). Setting: Records from the Spinal Cord Injury Model Systems (SCIMS). Participants: Patients served by the SCIMS, for whom complete motor FIM information was available for rehabilitation admission (N=5969), discharge (N=5964), or follow-up at a first or later anniversary (N=5176). Interventions: Not applicable. Main Outcome Measures: Similarity of mean, standard deviation, skewness, kurtosis, and Rasch reliability and separation of persons and items based on 6 and 13 items; intraclass correlation coefficient (ICC) for parallel estimates. Results: Calibrations for FIM items and FIM steps differed for the 3 time points, but showed sufficient agreement (ICC, >.90) that combined calibration was feasible. Means and other distribution characteristics differed minimally between the 6- and 13-item estimates. The person and item separations and reliabilities were somewhat lower and the mean measurement errors somewhat higher for the 6-item estimates, but only marginally so. ICCs between 6- and 13-item estimates were .95 or higher. Conclusion: CAT can be used to reduce data collection time; the level of precision of estimates is minimally less than that provided by traditional assessment approaches.
AB - Objective: To determine whether computer adaptive testing (CAT) can be used to decrease the number of FIMTM instrument motor component items administered in assessing persons with spinal cord injury (SCI). Design: For a CAT simulation, a 3-step algorithm was used to select 6 FIM items for each individual; items were selected according to the subject's motor ability as estimated by 2 initial items. Separate estimates of motor ability for admission, discharge, and follow-up data (plus combined time points) derived from 6 items were compared statistically with estimates derived from 14 items (walking and wheelchair mobility were split). Setting: Records from the Spinal Cord Injury Model Systems (SCIMS). Participants: Patients served by the SCIMS, for whom complete motor FIM information was available for rehabilitation admission (N=5969), discharge (N=5964), or follow-up at a first or later anniversary (N=5176). Interventions: Not applicable. Main Outcome Measures: Similarity of mean, standard deviation, skewness, kurtosis, and Rasch reliability and separation of persons and items based on 6 and 13 items; intraclass correlation coefficient (ICC) for parallel estimates. Results: Calibrations for FIM items and FIM steps differed for the 3 time points, but showed sufficient agreement (ICC, >.90) that combined calibration was feasible. Means and other distribution characteristics differed minimally between the 6- and 13-item estimates. The person and item separations and reliabilities were somewhat lower and the mean measurement errors somewhat higher for the 6-item estimates, but only marginally so. ICCs between 6- and 13-item estimates were .95 or higher. Conclusion: CAT can be used to reduce data collection time; the level of precision of estimates is minimally less than that provided by traditional assessment approaches.
KW - Outcome assessment (health care)
KW - Questionnaires
KW - Rehabilitation
KW - Reproducibility of results
KW - Spinal cord injuries
UR - https://www.scopus.com/pages/publications/0037336147
U2 - 10.1053/apmr.2003.50006
DO - 10.1053/apmr.2003.50006
M3 - Article
C2 - 12638107
AN - SCOPUS:0037336147
SN - 0003-9993
VL - 84
SP - 384
EP - 393
JO - Archives of Physical Medicine and Rehabilitation
JF - Archives of Physical Medicine and Rehabilitation
IS - 3 SUPPL. 1
ER -