Development and Validation of an Instrument to Measure Staff Perceptions of Recovery Climate and Culture in Mental Health Programs
Department of Psychiatry; Implementation Science and Practice Advances Research Center
Health Services Administration | Health Services Research | Industrial and Organizational Psychology | Mental and Social Health | Psychiatry | Psychiatry and Psychology
OBJECTIVE: Few existing instruments measure recovery-oriented organizational climate and culture. This study developed, psychometrically assessed, and validated an instrument to measure recovery climate and culture.
METHODS: Organizational theory and an evidence-based conceptualization of mental health recovery guided instrument development. Items from existing instruments were reviewed and adapted, and new items were developed as needed. All items were rated by recovery experts. A 35-item instrument was pilot-tested and administered to a national sample of mental health staff in U.S. Department of Veterans Affairs Psychosocial Rehabilitation and Recovery Centers (PRRCs). Analysis entailed an exploratory factor analysis (EFA) and inter-item reliability and scale correlation assessment. Blinded site visits to four PRRCs were performed to validate the instrument.
RESULTS: The EFA determined a seven-factor solution for the data. The factors identified were staff expectations, values, leadership, rewards, policies, education and training, and quality improvement. Seven items did not meet retention criteria and were dropped from the final instrument. The instrument exhibited good internal consistency (Cronbach's alpha=0.81; subscales, alpha=0.84-0.88). Scale correlations were between 0.16 and 0.61, well below the threshold (alpha=0.9) for indicating overlapping constructs. Site visitors validated the instrument by correctly identifying high-scoring and low-scoring centers.
CONCLUSIONS: These findings provide a psychometrically tested and validated instrument for measuring recovery climate and culture in mental health programs. This instrument can be used in evaluation of mental health services to determine the extent to which programs possess the organizational precursors that drive recovery-oriented service delivery.
Recovery, Research/service delivery
DOI of Published Version
Evans L, Wewiorski NJ, Ellison ML, Ni P, Harvey KLL, Hunt MG, Gorman JA, Charns MP. Development and Validation of an Instrument to Measure Staff Perceptions of Recovery Climate and Culture in Mental Health Programs. Psychiatr Serv. 2020 Mar 10:appips201900181. doi: 10.1176/appi.ps.201900181. Epub ahead of print. PMID: 32151213. Link to article on publisher's site
Psychiatric services (Washington, D.C.)
Evans L, Wewiorski NJ, Ellison ML, Ni P, Harvey KL, Hunt MG, Gorman JA, Charns MP. (2020). Development and Validation of an Instrument to Measure Staff Perceptions of Recovery Climate and Culture in Mental Health Programs. Psychiatry Publications. https://doi.org/10.1176/appi.ps.201900181. Retrieved from https://escholarship.umassmed.edu/psych_pp/939