Evaluating accuracy of striatal, pallidal, and thalamic segmentation methods: Comparing automated approaches to manual delineation
- PMID: 28259781
- DOI: 10.1016/j.neuroimage.2017.02.069
Evaluating accuracy of striatal, pallidal, and thalamic segmentation methods: Comparing automated approaches to manual delineation
Abstract
Accurate automated quantification of subcortical structures is a greatly pursued endeavour in neuroimaging. In an effort to establish the validity and reliability of these methods in defining the striatum, globus pallidus, and thalamus, we investigated differences in volumetry between manual delineation and automated segmentations derived by widely used FreeSurfer and FSL packages, and a more recent segmentation method, the MAGeT-Brain algorithm. In a first set of experiments, the basal ganglia and thalamus of thirty subjects (15 first episode psychosis [FEP], 15 controls) were manually defined and compared to the labels generated by the three automated methods. Our results suggest that all methods overestimate volumes compared to the manually derived "gold standard", with the least pronounced differences produced using MAGeT. The least between-method variability was noted for the striatum, whereas marked differences between manual segmentation and MAGeT compared to FreeSurfer and FSL emerged for the globus pallidus and thalamus. Correlations between manual segmentation and automated methods were strongest for MAGeT (range: 0.51 to 0.92; p<0.01, corrected), whereas FreeSurfer and FSL showed moderate to strong Pearson correlations (range 0.44-0.86; p<0.05, corrected), with the exception of FreeSurfer pallidal (r=0.31, p=0.10) and FSL thalamic segmentations (r=0.37, p=0.051). Bland-Altman plots highlighted a tendency for greater volumetric differences between manual labels and automated methods at the lower end of the distribution (i.e. smaller structures), which was most prominent for bilateral thalamus across automated pipelines, and left globus pallidus for FSL. We then went on to examine volume and shape of the basal ganglia structures using automated techniques in 135 FEP patients and 88 controls. The striatum and globus pallidus were significantly larger in FEP patients compared to controls bilaterally, irrespective of the method used. MAGeT-Brain was more sensitive to shape-based group differences, and uncovered widespread surface expansions in the striatum and globus pallidus bilaterally in FEP patients compared to controls, and surface contractions in bilateral thalamus (FDR-corrected). By contrast, after using a recommended cluster-wise thresholding method, FSL only detected differences in the right ventral striatum (FEP>Control) and one cluster of the left thalamus (Control>FEP). These results suggest that different automated pipelines segment subcortical structures with varying degrees of variability compared to manual methods, with particularly pronounced differences found with FreeSurfer and FSL for the globus pallidus and thalamus.
Keywords: Automated segmentation; First episode psychosis; Manual delineation; Shape morphometry; Structural MRI; Subcortical structure.
Copyright © 2017 Elsevier Inc. All rights reserved.
Similar articles
-
Multi-atlas segmentation of the whole hippocampus and subfields using multiple automatically generated templates.Neuroimage. 2014 Nov 1;101:494-512. doi: 10.1016/j.neuroimage.2014.04.054. Epub 2014 Apr 29. Neuroimage. 2014. PMID: 24784800
-
Hippocampus and amygdala volumes from magnetic resonance images in children: Assessing accuracy of FreeSurfer and FSL against manual segmentation.Neuroimage. 2016 Apr 1;129:1-14. doi: 10.1016/j.neuroimage.2016.01.038. Epub 2016 Jan 26. Neuroimage. 2016. PMID: 26824403 Free PMC article.
-
Subcortical and hippocampal brain segmentation in 5-year-old children: Validation of FSL-FIRST and FreeSurfer against manual segmentation.Eur J Neurosci. 2022 Sep;56(5):4619-4641. doi: 10.1111/ejn.15761. Epub 2022 Jul 18. Eur J Neurosci. 2022. PMID: 35799402 Free PMC article.
-
Toward defining deep brain stimulation targets in MNI space: A subcortical atlas based on multimodal MRI, histology and structural connectivity.Neuroimage. 2018 Apr 15;170:271-282. doi: 10.1016/j.neuroimage.2017.05.015. Epub 2017 May 20. Neuroimage. 2018. PMID: 28536045 Review.
-
3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study.Neuroimage. 2018 Apr 15;170:456-470. doi: 10.1016/j.neuroimage.2017.04.039. Epub 2017 Apr 24. Neuroimage. 2018. PMID: 28450139 Review.
Cited by
-
A potential imaging biomarker distinguishing neurodegenerative parkinsonism using brainstem MRI shape analysis.Eur Radiol. 2023 Jul;33(7):4537-4539. doi: 10.1007/s00330-023-09683-0. Epub 2023 May 8. Eur Radiol. 2023. PMID: 37154953 No abstract available.
-
Morphological changes in Parkinson's disease based on magnetic resonance imaging: A mini-review of subcortical structures segmentation and shape analysis.World J Psychiatry. 2022 Dec 19;12(12):1356-1366. doi: 10.5498/wjp.v12.i12.1356. eCollection 2022 Dec 19. World J Psychiatry. 2022. PMID: 36579355 Free PMC article. Review.
-
Multisite test-retest reliability and compatibility of brain metrics derived from FreeSurfer versions 7.1, 6.0, and 5.3.Hum Brain Mapp. 2023 Mar;44(4):1515-1532. doi: 10.1002/hbm.26147. Epub 2022 Nov 27. Hum Brain Mapp. 2023. PMID: 36437735 Free PMC article.
-
Anatomically curated segmentation of human subcortical structures in high resolution magnetic resonance imaging: An open science approach.Front Neuroanat. 2022 Sep 30;16:894606. doi: 10.3389/fnana.2022.894606. eCollection 2022. Front Neuroanat. 2022. PMID: 36249866 Free PMC article.
-
A Volumetric Study of the Corpus Callosum in the Turkish Population.J Neurol Surg B Skull Base. 2021 Jun 30;83(4):443-450. doi: 10.1055/s-0041-1731033. eCollection 2022 Aug. J Neurol Surg B Skull Base. 2021. PMID: 35903660 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical