Center for Clinical and Translational Science
Translational Medical Research
Introduction: Although the science of team science is no longer a new field, the measurement of team science and its standardization remain in relatively early stages of development. To describe the current state of team science assessment, we conducted an integrative review of measures of research collaboration quality and outcomes.
Methods: Collaboration measures were identified using both a literature review based on specific keywords and an environmental scan. Raters abstracted details about the measures using a standard tool. Measures related to collaborations with clinical care, education, and program delivery were excluded from this review.
Results: We identified 44 measures of research collaboration quality, which included 35 measures with reliability and some form of statistical validity reported. Most scales focused on group dynamics. We identified 89 measures of research collaboration outcomes; 16 had reliability and 15 had a validity statistic. Outcome measures often only included simple counts of products; publications rarely defined how counts were delimited, obtained, or assessed for reliability. Most measures were tested in only one venue.
Conclusions: Although models of collaboration have been developed, in general, strong, reliable, and valid measurements of such collaborations have not been conducted or accepted into practice. This limitation makes it difficult to compare the characteristics and impacts of research teams across studies or to identify the most important areas for intervention. To advance the science of team science, we provide recommendations regarding the development and psychometric testing of measures of collaboration quality and outcomes that can be replicated and broadly applied across studies.
UMCCTS funding, Team science, instrument development, measures, outcome measure, psychometrics, research collaboration, research evaluation, research process measure, scientific collaboration, teamwork
Rights and Permissions
© The Association for Clinical and Translational Science 2019. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:// creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
DOI of Published Version
J Clin Transl Sci. 2019 Oct 11;3(5):261-289. doi: 10.1017/cts.2019.402. eCollection 2019 Oct. Link to article on publisher's site
Journal of clinical and translational science
Tigges BB, Miller D, Dudding KM, Balls-Berry JE, Borawski EA, Dave G, Hafer N, Kimminau KS, Kost RG, Littlefield K, Shannon J, Menon U. (2019). Measuring quality and outcomes of research collaborations: An integrative review. Open Access Articles. https://doi.org/10.1017/cts.2019.402. Retrieved from https://escholarship.umassmed.edu/oapubs/4015
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.