Development and implementation of an objective structured teaching exercise (OSTE) to evaluate improvement in feedback skills following a faculty development workshop
Department of Pediatrics; Meyers Primary Care Institute; Department of Medicine; Department of Family Medicine and Community Health; Department of Internal Medicine
Education, Medical; Faculty, Medical; Feedback, Psychological; Humans; Learning; Pilot Projects; Program Evaluation; Random Allocation; Reproducibility of Results; Staff Development; Teaching; United States
Health Services Research | Medical Education | Primary Care
BACKGROUND: Faculty development programs focusing on teaching have become widespread.
PURPOSE: Despite the popularity of such programs, evidence as to their effectiveness is limited. This article reports on the development of an objective structured teaching exercise (OSTE) and its pilot implementation in an evaluation of a faculty development program module. A written test intended to measure feedback skills was also developed and pilot tested.
METHODS: A separate-sample, pretest-posttest design was used to pilot test both instruments.
RESULTS: The results showed some evidence of significant differences between groups tested preworkshop and postworkshop. Higher scores were observed for the posttest group compared to the pretest group only for OSTE items focusing on prioritizing and limiting the amount of feedback given at one time and on action planning.
CONCLUSIONS: Results suggest that an OSTE may be sensitive to changes in preceptor skill level for skills that are relatively easy to incorporate immediately into practice. Lack of differences in other skill areas may be due to lack of sensitivity of the measure or to need for practice and reflection before changes in performance on other feedback skills are evident.
DOI of Published Version
Teach Learn Med. 2003 Winter;15(1):7-13. Link to article on publisher's site
Teaching and learning in medicine
Stone, Sarah L.; Mazor, Kathleen M.; Devaney-O'Neil, Sarah; Starr, Susan; Ferguson, Warren J.; Wellman, Scott; Jacobson, Eric; Hatem, David S.; and Quirk, Mark E., "Development and implementation of an objective structured teaching exercise (OSTE) to evaluate improvement in feedback skills following a faculty development workshop" (2003). Meyers Primary Care Institute Publications and Presentations. 306.