University of Massachusetts Medical School Faculty Publications

Title

Machine learning-based outcome prediction and novel hypotheses generation for substance use disorder treatment

UMMS Affiliation

Division of Medical Toxicology, Department of Emergency Medicine

Publication Date

2021-02-11

Document Type

Article

Disciplines

Artificial Intelligence and Robotics | Health Services Administration | Health Services Research | Substance Abuse and Addiction

Abstract

OBJECTIVE: Substance use disorder is a critical public health issue. Discovering the synergies among factors impacting treatment program success can help governments and treatment facilities develop effective policies. In this work, we propose a novel data analytics approach using machine learning models to discover interaction effects that might be neglected by traditional hypothesis-generating approaches.

MATERIALS AND METHODS: A patient-episode-level substance use treatment discharge dataset and a Federal Bureau of Investigation crime dataset were joined using core-based statistical area codes. Random forests, artificial neural networks, and extreme gradient boosting were applied with a nested cross-validation methodology. Interaction effects were identified based on the machine learning model with the best performance. These interaction effects were analyzed and tested using traditional logistic regression models on unseen data.

RESULTS: In predicting patient completion of a treatment program, extreme gradient boosting performed the best with an area under the curve of 89.31%. Based on our procedure, 73 interaction effects were identified. Among these, 14 were tested using traditional logistic regression models where 12 were statistically significant (P < .05).

CONCLUSIONS: We identified new interaction effects among the length of stay, frequency of substance use, changes in self-help group attendance frequency, and other factors. This work provides insights into the interactions between factors impacting treatment completion. Further traditional statistical analysis can be employed by practitioners and policy makers to test the effects discovered by our novel machine learning approach.

Keywords

healthcare analytics, hypothesis generation, machine learning, substance-related disorders, treatment outcome

DOI of Published Version

10.1093/jamia/ocaa350

Source

Nasir M, Summerfield NS, Oztekin A, Knight M, Ackerson LK, Carreiro S. Machine learning-based outcome prediction and novel hypotheses generation for substance use disorder treatment. J Am Med Inform Assoc. 2021 Feb 11:ocaa350. doi: 10.1093/jamia/ocaa350. Epub ahead of print. PMID: 33570148. Link to article on publisher's site

Related Resources

Link to Article in PubMed

Journal/Book/Conference Title

Journal of the American Medical Informatics Association : JAMIA

PubMed ID

33570148

Share

COinS