A demonstration of the impact of response bias on the results of patient satisfaction surveys

UMMS Affiliation

Meyers Primary Care Institute

Publication Date


Document Type



*Bias (Epidemiology); Data Interpretation, Statistical; Family Practice; Health Care Surveys; Health Maintenance Organizations; Humans; Internal Medicine; Massachusetts; Patient Satisfaction; Primary Health Care; Random Allocation; Reproducibility of Results; Sampling Studies


Life Sciences | Medicine and Health Sciences


OBJECTIVES: The purposes of the present study were to examine patient satisfaction survey data for evidence of response bias, and to demonstrate, using simulated data, how response bias may impact interpretation of results. DATA SOURCES: Patient satisfaction ratings of primary care providers (family practitioners and general internists) practicing in the context of a group-model health maintenance organization and simulated data generated to be comparable to the actual data. STUDY DESIGN: Correlational analysis of actual patient satisfaction data, followed by a simulation study where response bias was modeled, with comparison of results from biased and unbiased samples. PRINCIPAL FINDINGS: A positive correlation was found between mean patient satisfaction rating and response rate in the actual patient satisfaction data. Simulation results suggest response bias could lead to overestimation of patient satisfaction overall, with this effect greatest for physicians with the lowest satisfaction scores. CONCLUSIONS: Findings suggest that response bias may significantly impact the results of patient satisfaction surveys, leading to overestimation of the level of satisfaction in the patient population overall. Estimates of satisfaction may be most inflated for providers with the least satisfied patients, thereby threatening the validity of provider-level comparisons.


Health Serv Res. 2002 Oct;37(5):1403-17.

Journal/Book/Conference Title

Health services research

Related Resources

Link to Article in PubMed

PubMed ID