A site visit protocol for assessing recovery promotion at the program level: An example from the Veterans Health Administration

UMMS Affiliation

Department of Psychiatry; Implementation Science and Practice Advances Research Center

Publication Date


Document Type



Health Services Administration | Health Services Research | Mental and Social Health | Military and Veterans Studies | Psychiatry | Psychiatry and Psychology | Rehabilitation and Therapy


OBJECTIVE: A site visit protocol was developed to assess recovery promotion in the organizational climate and culture of programs for veterans with serious mental illnesses.

METHOD: The protocol was pilot-tested in 4 programs: 2 that had scored high on the pilot version of a staff survey measure of program-level recovery promotion and 2 that had scored low. Two-person teams conducted onsite visits and assigned global and organizational domain ratings. Interrater agreement was assessed by examining adjacent agreement and computing weighted kappa.

RESULTS: The on-site protocol had good interrater agreement and discriminated between sites that scored high and low on the staff survey.

CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: This site visit protocol and procedure shows promise for evaluating recovery promotion in milieu-based programs. After further refinement of this tool, adaptations could be developed for accreditation protocols or for program self-assessment and quality improvement efforts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).


recovery, program evaluation, protocol, veterans, psychosocial rehabilitation

DOI of Published Version



Psychiatr Rehabil J. 2019 Sep;42(3):323-328. doi: 10.1037/prj0000369. Epub 2019 Jun 24. Link to article on publisher's site

Journal/Book/Conference Title

Psychiatric rehabilitation journal

Related Resources

Link to Article in PubMed

PubMed ID