A Bayesian model of shape and appearance for subcortical brain segmentation

UMMS Affiliation

Department of Psychiatry; Intellectual and Developmental Disabilities Research Center



Document Type


Medical Subject Headings

Adolescent; Adult; Aged; Algorithms; Artificial Intelligence; Bayes Theorem; Brain; Female; Humans; Image Processing, Computer-Assisted; Linear Models; Magnetic Resonance Imaging; Male; Middle Aged; *Models, Neurological; Models, Statistical; Reproducibility of Results; Thalamus; Young Adult


Nervous System | Neuroscience and Neurobiology | Psychiatry and Psychology | Radiology | Statistical Models


Automatic segmentation of subcortical structures in human brain MR images is an important but difficult task due to poor and variable intensity contrast. Clear, well-defined intensity features are absent in many places along typical structure boundaries and so extra information is required to achieve successful segmentation. A method is proposed here that uses manually labelled image data to provide anatomical training information. It utilises the principles of the Active Shape and Appearance Models but places them within a Bayesian framework, allowing probabilistic relationships between shape and intensity to be fully exploited. The model is trained for 15 different subcortical structures using 336 manually-labelled T1-weighted MR images. Using the Bayesian approach, conditional probabilities can be calculated easily and efficiently, avoiding technical problems of ill-conditioned covariance matrices, even with weak priors, and eliminating the need for fitting extra empirical scaling parameters, as is required in standard Active Appearance Models. Furthermore, differences in boundary vertex locations provide a direct, purely local measure of geometric change in structure between groups that, unlike voxel-based morphometry, is not dependent on tissue classification methods or arbitrary smoothing. In this paper the fully-automated segmentation method is presented and assessed both quantitatively, using Leave-One-Out testing on the 336 training images, and qualitatively, using an independent clinical dataset involving Alzheimer's disease. Median Dice overlaps between 0.7 and 0.9 are obtained with this method, which is comparable or better than other automated methods. An implementation of this method, called FIRST, is currently distributed with the freely-available FSL package.

Rights and Permissions

Citation: Patenaude B, Smith SM, Kennedy DN, Jenkinson M. A Bayesian model of shape and appearance for subcortical brain segmentation. Neuroimage. 2011 Jun 1;56(3):907-22. doi: 10.1016/j.neuroimage.2011.02.046. Epub 2011 Feb 23. PubMed PMID: 21352927; PubMed Central PMCID: PMC3417233. Link to article on publisher's site

Related Resources

Link to Article in PubMed

PubMed ID