Examination of the analytic quality of behavioral health randomized clinical trials

UMMS Affiliation

Department of Medicine, Division of Preventive and Behavioral Medicine

Publication Date


Document Type



Behavioral Medicine; *Bibliometrics; Data Interpretation, Statistical; Evidence-Based Medicine; Humans; Periodicals as Topic; Practice Guidelines as Topic; Randomized Controlled Trials as Topic; United States


Behavioral Disciplines and Activities | Behavior and Behavior Mechanisms | Community Health and Preventive Medicine | Preventive Medicine


Adoption of evidence-based practice (EBP) policy has implications for clinicians and researchers alike. In fields that have already adopted EBP, evidence-based practice guidelines derive from systematic reviews of research evidence. Ultimately, such guidelines serve as tools used by practitioners. Systematic reviews of treatment efficacy and effectiveness reserve their strongest endorsements for treatments that are supported by high-quality randomized clinical trials (RCTs). It is unknown how well RCTs reported in behavioral science journals fare compared to quality standards set forth in fields that pioneered the evidence-based movement. We compared analytic quality features of all behavioral health RCTs (n = 73) published in three leading behavioral journals and two leading medical journals between January 2000 and July 2003. A behavioral health trial was operationalized as one employing a behavioral treatment modality to prevent or treat an acute or chronic physical disease or condition. Findings revealed areas of weakness in analytic aspects of the behavioral health RCTs reported in both sets of journals. Weaknesses were more pronounced in behavioral journals. The authors offer recommendations for improving the analytic quality of behavioral health RCTs to ensure that evidence about behavioral treatments is highly weighted in systematic reviews.

DOI of Published Version



J Clin Psychol. 2007 Jan;63(1):53-71. Link to article on publisher's site

Journal/Book/Conference Title

Journal of clinical psychology

Related Resources

Link to Article in PubMed

PubMed ID