Title

USMLE Step 3 Scores Have Value in Predicting ABR Core Examination Outcome and Performance: A Multi-institutional Study

UMMS Affiliation

Department of Radiology

Publication Date

2020-08-06

Document Type

Article

Disciplines

Medical Education | Radiology

Abstract

RATIONALE AND OBJECTIVES: We analyzed multi-institutional data to determine if Step 3 performance tiers can identify radiology residents with increased risk of Core examination failure and submean performance.

MATERIALS AND METHODS: We collected Step 3 scores (USMLE Step 3 or COMLEX Level 3) and American Board of Radiology (ABR) Core examination outcomes and scores for anonymized residents from 13 different Diagnostic Radiology residency programs taking the ABR Core examination between 2013 and 2019. Step 3 scores were converted to percentiles based on Z-score, with Core outcome and performance analyzed for Step 3 groups based on 50th percentile and based on quintiles. Core outcome was scored as fail when conditionally passed or failed. Core performance was measured by the percent of residents with scores below the mean. Differences between Step 3 groups for Core outcome and Core performance were statistically evaluated.

RESULTS: Data were available for 342 residents. The Core examination failure rate for 121 residents with Step 3 scores < 50th percentile was 19.8% (fail relative risk=2.26), significantly higher than the 2.7% failure rate for the 221 other residents. Of 42 residents with Step 3 scores in the lowest quintile, the Core failure rate increased to 31.0% (fail relative risk=3.52). Core performance improved with higher Step 3 quintiles.

CONCLUSION: Step 3 licensing scores have value in predicting radiology resident performance on the ABR Core examination, enabling residency programs to target higher risk residents for early assessment and intervention.

Keywords

ABR Core examination, Predictors, Radiology residency, USMLE Step score

DOI of Published Version

10.1016/j.acra.2020.06.032

Source

Patel MD, Benefield T, Hunt KN, Tomblinson CM, Ali K, DeBenedectis CM, England E, Gaviola GC, Ho CP, Jay AK, Milburn JM, Ong S, Robbins JB, Sarkany DS, Heitkamp DE, Jordan SG. USMLE Step 3 Scores Have Value in Predicting ABR Core Examination Outcome and Performance: A Multi-institutional Study. Acad Radiol. 2020 Aug 6:S1076-6332(20)30412-8. doi: 10.1016/j.acra.2020.06.032. Epub ahead of print. PMID: 32773330. Link to article on publisher's site

Journal/Book/Conference Title

Academic radiology

Comments

Full author list omitted for brevity. For the full list of authors, see article.

Related Resources

Link to Article in PubMed

PubMed ID

32773330

Link to Full Text

Share

COinS