University of Massachusetts Medical School Faculty Publications
Title
Difference in method of administration did not significantly impact item response: an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative
UMMS Affiliation
Department of Quantitative Health Sciences
Publication Date
2-1-2014
Document Type
Article
Subjects
Adolescent; Adult; Aged; Aged, 80 and over; Arthritis, Rheumatoid; Cross-Over Studies; Data Collection; Depressive Disorder; Discrimination (Psychology); Female; Humans; *Information Systems; Male; Middle Aged; Outcome Assessment (Health Care); Pulmonary Disease, Chronic Obstructive; Quality of Life; *Questionnaires; *Self Report; *Sickness Impact Profile; Young Adult
Disciplines
Community Health and Preventive Medicine | Health Services Research | Public Health
Abstract
PURPOSE: To test the impact of method of administration (MOA) on the measurement characteristics of items developed in the Patient-Reported Outcomes Measurement Information System (PROMIS).
METHODS: Two non-overlapping parallel 8-item forms from each of three PROMIS domains (physical function, fatigue, and depression) were completed by 923 adults (age 18-89) with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) on the Internet, and a second form by PC, in the same administration. Structural invariance, equivalence of item responses, and measurement precision were evaluated using confirmatory factor analysis and item response theory methods.
RESULTS: Multigroup confirmatory factor analysis supported equivalence of factor structure across MOA. Analyses by item response theory found no differences in item location parameters and strongly supported the equivalence of scores across MOA.
CONCLUSIONS: We found no statistically or clinically significant differences in score levels in IVR, PQ, or PDA administration as compared to PC. Availability of large item response theory-calibrated PROMIS item banks allowed for innovations in study design and analysis.
DOI of Published Version
10.1007/s11136-013-0451-4
Source
Qual Life Res. 2014 Feb;23(1):217-27. doi: 10.1007/s11136-013-0451-4. Epub 2013 Jul 23. Link to article on publisher's site
Related Resources
Journal/Book/Conference Title
Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation
PubMed ID
23877585
Repository Citation
Bjorner, Jakob B.; Rose, Matthias S. F.; Gandek, Barbara L.; Stone, Arthur A.; Junghaenel, Doerte U.; and Ware, John E. Jr., "Difference in method of administration did not significantly impact item response: an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative" (2014). University of Massachusetts Medical School Faculty Publications. 724.
https://escholarship.umassmed.edu/faculty_pubs/724
Comments
Co-author Barbara Gandek is a doctoral student in the Clinical and Population Health Research Program in the Graduate School of Biomedical Sciences (GSBS) at UMass Medical School.