An assessment of the autism neuroimaging literature for the prospects of re-executability
Document Type
Journal ArticlePublication Date
2021-03-04Keywords
Autistic DisorderHumans
Neuroimaging
Reproducibility of Results
Retrospective Studies
Software
Autistic Disorder
Humans
Neuroimaging
Reproducibility of Results
Retrospective Studies
Software
Data Science
Neuroscience and Neurobiology
Psychiatry
Psychiatry and Psychology
Scholarly Communication
Scholarly Publishing
Metadata
Show full item recordAbstract
Background: The degree of reproducibility of the neuroimaging literature in psychiatric application areas has been called into question and the issues that relate to this reproducibility are extremely complex. Some of these complexities have to do with the underlying biology of the disorders that we study and others arise due to the technology we apply to the analysis of the data we collect. Ultimately, the observations we make get communicated to the rest of the community through publications in the scientific literature. Methods: We sought to perform a ‘re-executability survey’ to evaluate the recent neuroimaging literature with an eye toward seeing if the technical aspects of our publication practices are helping or hindering the overall quest for a more reproducible understanding of brain development and aging. The topic areas examined include availability of the data, the precision of the imaging method description and the reporting of the statistical analytic approach, and the availability of the complete results. We applied the survey to 50 publications in the autism neuroimaging literature that were published between September 16, 2017 to October 1, 2018. Results: The results of the survey indicate that for the literature examined, data that is not already part of a public repository is rarely available, software tools are usually named but versions and operating system are not, it is expected that reasonably skilled analysts could approximately perform the analyses described, and the complete results of the studies are rarely available. Conclusions: We have identified that there is ample room for improvement in research publication practices. We hope exposing these issues in the retrospective literature can provide guidance and motivation for improving this aspect of our reporting practices in the future.Source
Hodge SM, Haselgrove C, Honor L et al. An assessment of the autism neuroimaging literature for the prospects of re-executability [version 2; peer review: 2 approved]. F1000Research 2021, 9:1031. doi: 10.12688/f1000research.25306.2. PMID: 33796274; PMCID: PMC7968525. View article on publisher's site
DOI
10.12688/f1000research.25306.2Permanent Link to this Item
http://hdl.handle.net/20.500.14038/29988PubMed ID
33796274Notes
The PDF available for download is Version 2 of this research article.
Related Resources
Rights
Copyright: © 2021 Hodge SM et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Distribution License
http://creativecommons.org/licenses/by/4.0/ae974a485f413a2113503eed53cd6c53
10.12688/f1000research.25306.2
Scopus Count
Except where otherwise noted, this item's license is described as Copyright: © 2021 Hodge SM et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.