Abstract
The hippocampus plays a vital role in the diagnosis and treatment of many neurological disorders. Recent years, deep learning technology has made great progress in the field of medical image segmentation, and the performance of related tasks has been constantly refreshed. In this article, we focus on the hippocampus segmentation task and propose a novel hierarchical feedback chain network. The feedback chain structure unit learns deeper and wider feature representation of each encoder layer through the hierarchical feature aggregation feedback chains and achieves feature selection and feedback through the feature handover attention module. Then, we embed a global pyramid attention unit between the feature encoder and the decoder to further modify the encoder features, including the pairwise pyramid attention module for achieving adjacent attention interaction and the global context modeling module for capturing the long-range knowledge. The proposed approach achieves state-of-the-art performance on three publicly available datasets compared with existing hippocampus segmentation approaches. The code and results can be found from the link of https://github.com/easymoneysniper183/sematic_seg.
- [1] . 2009. Combination strategies in multi-atlas image segmentation: Application to brain MR data. IEEE Trans. Med. Imag. 28, 8 (2009), 1266–1277.Google Scholar
Cross Ref
- [2] . 2019. Fast and precise hippocampus segmentation through deep convolutional neural network ensembles and transfer learning. Neuroinformatics 17, 4 (2019), 563–582.Google Scholar
Cross Ref
- [3] . 2000. Hippocampal volume reduction in major depression. Am. J. Psychiatr. 157, 1 (2000), 115–118.Google Scholar
Cross Ref
- [4] . 2017. Multi-task neural networks for joint hippocampus segmentation and clinical score regression. Multimedia Tools Appl. 77 (2017), 29669–29686.Google Scholar
Cross Ref
- [5] . 2019. Adaptive Bayesian label fusion using kernel-based similarity metrics in hippocampus segmentation. J. Med. Imag. 6, 1 (2019), 014003.Google Scholar
Cross Ref
- [6] . 2017. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Pattern Anal. Mach. Intell. 40, 4 (2017), 834–848.Google Scholar
Cross Ref
- [7] . 2017. Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587. Retrieved from https://arxiv.org/abs/1706.05587.Google Scholar
- [8] . 2018. Hippocampus analysis by combination of 3-D DenseNet and shapes for Alzheimer’s disease diagnosis. IEEE J. Biomed. Health Inf. 23, 5 (2018), 2099–2107.Google Scholar
Cross Ref
- [9] . 2012. FreeSurfer. Neuroimage 62, 2 (2012), 774–781.Google Scholar
Cross Ref
- [10] . 2019. Dilated deeply supervised networks for hippocampus segmentation in MRI. In Bildverarbeitung für die Medizin 2019. Springer, 68–73.Google Scholar
- [11] . 2019. Dual attention network for scene segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3146–3154.Google Scholar
Cross Ref
- [12] . 2021. Learning with context feedback loop for robust medical image segmentation. IEEE Trans. Med. Imag. 40 (2021), 1542–1554.Google Scholar
Cross Ref
- [13] . 2019. Dynamic multi-scale filters for semantic segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 3562–3572.Google Scholar
Cross Ref
- [14] . 2019. Adaptive pyramid context network for semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7519–7528.Google Scholar
Cross Ref
- [15] . 2018. Squeeze-and-excitation networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7132–7141.Google Scholar
Cross Ref
- [16] . 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700–4708.Google Scholar
Cross Ref
- [17] . 2020. MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121 (2020), 74–87.Google Scholar
Digital Library
- [18] . 2018. nnu-net: Self-adapting framework for u-net-based medical image segmentation. arXiv:1809.10486.Google Scholar
- [19] . 2019. Panoptic feature pyramid networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6399–6408.Google Scholar
Cross Ref
- [20] . 2018. H-DenseUNet: Hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans. Med. Imag. 37, 12 (2018), 2663–2674.Google Scholar
Cross Ref
- [21] . 2018. Multi-channel multi-scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images. Med. Image Anal. 46 (2018), 106–117.Google Scholar
Cross Ref
- [22] . 2021. Residual refinement network with attribute guidance for precise saliency detection. ACM Trans. Multimedia Comput. Commun. Appl. 17, 3 (2021), 1–19.Google Scholar
Digital Library
- [23] . 2017. A survey on deep learning in medical image analysis. Med. Image Anal. 42 (2017), 60–88.Google Scholar
- [24] . 2018. Brain tumor segmention based on dilated convolution refine networks. In Proceedings of the IEEE 16th International Conference on Software Engineering Research, Management and Applications. IEEE, 113–120.Google Scholar
Cross Ref
- [25] . 2020. Superpixel region merging based on deep network for medical image segmentation. ACM Trans. Intell. Syst. Technol. 11, 4 (2020), 1–22.Google Scholar
Digital Library
- [26] . 2020. A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease. NeuroImage 208 (2020).Google Scholar
Cross Ref
- [27] . 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431–3440.Google Scholar
Cross Ref
- [28] . 2017. Emotional arousal impairs association-memory: Roles of amygdala and hippocampus. NeuroImage 156 (2017), 14–28.Google Scholar
Cross Ref
- [29] . 2018. Attention u-net: Learning where to look for the pancreas. arXiv:1804.03999. Retrieved from https://arxiv.org/abs/1804.03999.Google Scholar
- [30] . 2015. World Alzheimer report 2015-the global impact of dementia: An analysis of prevalence, incidence, cost and trends.Google Scholar
- [31] . 2020. Inception u-net architecture for semantic segmentation to identify nuclei in microscopy cell images. ACM Trans. Multimedia Comput. Commun. Appl. 16, 1 (2020), 1–15.Google Scholar
Digital Library
- [32] . 2015. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, 234–241.Google Scholar
Cross Ref
- [33] . 2011. A supervised patch-based approach for human brain labeling. IEEE Trans. Med. Imag. 30, 10 (2011), 1852–1862.Google Scholar
Cross Ref
- [34] . 2018. Gene expressions, hippocampal volume loss, and MMSE scores in computation of progression and pharmacologic therapy effects for Alzheimer’s disease. IEEE/ACM Trans. Comput. Biol. Bioinf. 17, 2 (2018), 608–622.Google Scholar
- [35] . 2021. Discriminative feature network based on a hierarchical attention mechanism for semantic hippocampus segmentation. IEEE J. Biomed. Health Inf. 25 (2021), 504–513.Google Scholar
Cross Ref
- [36] . 2004. Boundary and medial shape analysis of the hippocampus in schizophrenia. Med. Image Anal. 8, 3 (2004), 197–203.Google Scholar
Cross Ref
- [37] . 2015. Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct. Funct. 220, 2 (2015), 841–859.Google Scholar
Cross Ref
- [38] . 2020. Machine learning techniques for the diagnosis of Alzheimer’s disease: A review. ACM Trans. Multimedia Comput. Commun. Appl. 16, 1s (2020), 1–35.Google Scholar
Digital Library
- [39] . 2018. Segmentation of the hippocampus by transferring algorithmic knowledge for large cohort processing. Med. Image Anal. 43 (2018), 214–228.Google Scholar
Cross Ref
- [40] . 2019. Hand modeling and simulation using stabilized magnetic resonance imaging. ACM Trans. Graph. 38, 4 (2019), 1–14.Google Scholar
Digital Library
- [41] . 2019. Salient object detection with pyramid attention and salient edges. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1448–1457.Google Scholar
Cross Ref
- [42] . 2018. Cbam: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision. 3–19.Google Scholar
Digital Library
- [43] . 2021. A densely connected network based on U-Net for medical image segmentation. ACM Trans. Multimedia Comput. Commun. Appl. 17, 3 (2021), 1–14.Google Scholar
Digital Library
- [44] . 2019. Spatial structure preserving feature pyramid network for semantic image segmentation. ACM Trans. Multimedia Comput. Commun. Appl. 15, 3 (2019), 1–19.Google Scholar
Digital Library
- [45] . 2014. Accurate and fully automatic hippocampus segmentation using subject-specific 3D optimal local maps into a hybrid active contour model. IEEE J. Transl. Eng. Health Med. 2 (2014), 1–16.Google Scholar
Cross Ref
- [46] . 2020. Dense attention fluid network for salient object detection in optical remote sensing images. IEEE Trans. Image Process. 30 (2020), 1305–1317.Google Scholar
Digital Library
- [47] . 2018. Icnet for real-time semantic segmentation on high-resolution images. In Proceedings of the European Conference on Computer Vision. 405–420.Google Scholar
Digital Library
- [48] . 2017. Pyramid scene parsing network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2881–2890.Google Scholar
Cross Ref
- [49] . 2020. A discriminative convolutional neural network with context-aware attention. ACM Trans. Intell. Syst. Technol. 11, 5 (2020), 1–21.Google Scholar
Digital Library
- [50] . 2018. Unet++: A nested u-net architecture for medical image segmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Springer, 3–11.Google Scholar
Digital Library
- [51] . 2019. Dilated dense U-Net for infant hippocampus subfield segmentation. Front. Neuroinf. 13 (2019).Google Scholar
Cross Ref
- [52] . 2019. Asymmetric non-local neural networks for semantic segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 593–602.Google Scholar
Cross Ref
- [53] . 2018. Convolutional neural network with shape prior applied to cardiac MRI segmentation. IEEE J. Biomed. Health Inf. 23, 3 (2018), 1119–1128.Google Scholar
Cross Ref
Index Terms
Feedback Chain Network for Hippocampus Segmentation
Recommendations
Three-Dimensional Segmentation of Hippocampus in Brain MRI Images Based on 3CN-net
ICIAI '19: Proceedings of the 2019 3rd International Conference on Innovation in Artificial IntelligenceThe hippocampus is very small, with complex in shape and structure, and its boundary with surrounding tissues is blurred in brain MRI images, so the traditional segmentation method cannot achieve ideal segmentation effect. In this paper, an improved ...
Atlas selection for hippocampus segmentation: Relevance evaluation of three meta-information parameters
AbstractCurrent state-of-the-art methods for whole and subfield hippocampus segmentation use pre-segmented templates, also known as atlases, in the pre-processing stages. Typically, the input image is registered to the template, which provides ...
Multi-task neural networks for joint hippocampus segmentation and clinical score regression
Feature representations extracted from hippocampus in magnetic resonance (MR) images are widely used in computer-aided Alzheimer's disease (AD) diagnosis, and thus accurate segmentation for the hippocampus has been remaining an active research topic. ...






Comments