Abstract
Smart hospitals are important components of smart cities. An intelligent medical system for brain tumor segmentation is required to construct smart hospitals. To achieve intelligent brain tumor segmentation, morphological variety and serious category imbalance must be managed effectively. Conventional deep neural networks have difficulty in predicting high-accuracy segmentation images due to these issues. To solve these problems, we propose using multimodal brain tumor images combined with the UNET and LSTM models to construct a new network structure with a mixed loss function to solve sample imbalance and describe an intelligent segmentation process to identify brain tumors. To verify the practicability of this algorithm, we used the open source Brain Tumor Segmentation Challenge dataset to train and verify the proposed network. We obtained DSCs of 0.91, 0.82, and 0.80; sensitivities of 0.93, 0.85, and 0.82; and specificities of 0.99, 0.99, and 0.98 in three tumor regions, including the whole tumor (WT), tumor core (TC), and enhanced tumor (ET). We also compared the results of the proposed network with those of other brain tumor segmentation methods, and the results showed that the proposed algorithm could segment different tumor lesions more accurately, highlighting its potential application value in the clinical diagnosis of brain tumors.
- W. J. Niessen. 2016. MR brain image analysis in dementia: From quantitative imaging biomarkers to ageing brain models and imaging genetics. Medical Image Analysis 33 (2016), 107–113.Google Scholar
Cross Ref
- R. Lu, L. Qiang, G. Xin, et al. 2019. Three-dimensional segmentation of brain tumors in magnetic resonance imaging based on improved continuous max-flow. Laser & Optoelectronics Progress 55, 11 (2019), 111011.Google Scholar
- K. J. Shanthi and M. S. Kumar. 2007. Skull stripping and automatic segmentation of brain MRI using seed growth and threshold techniques. In 2007 International Conference on Intelligent and Advanced Systems. IEEE, 422–426.Google Scholar
- M. Kaleem, M. Sanaullah, M. A. Hussain, et al. 2012. Segmentation of brain tumor tissue using marker controlled watershed transform method. In International Multi Topic Conference. Springer, Berlin, Heidelberg, 222–227.Google Scholar
Cross Ref
- M. R. Kaus, S. K. Warfield, A. Nabavi, et al. 2001. Automated segmentation of MR images of brain tumors. Radiology 218, 2 (2001), 586–591.Google Scholar
Cross Ref
- D. Zikic, Y. Ioannou, M. Brown, et al. 2014. Segmentation of brain tumor tissues with convolutional neural networks. Proceedings MICCAI-BRATS (2014), 36–39.Google Scholar
- Y. Li, F. Jia, and J. Qin. 2016. Brain tumor segmentation from multimodal magnetic resonance images via sparse representation. Artificial Intelligence in Medicine 73 (2016), 1–13. Google Scholar
Digital Library
- S. Pereira, A. Pinto, V. Alves, et al. 2016. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Transactions on Medical Imaging 35, 5 (2016), 1240–1251.Google Scholar
Cross Ref
- D. Zikic, Y. Ioannou, M. Brown, et al. 2014. Segmentation of brain tumor tissues with convolutional neural networks. Proceedings MICCAI-BRATS (2014), 36–39.Google Scholar
- P. D. Chang. 2016. Fully convolutional neural networks with hyperlocal features for brain tumor segmentation. In Proceedings MICCAI-BRATS Workshop. 4–9.Google Scholar
- L. Zhao and K. Jia. 2016. Multiscale CNNs for brain tumor segmentation and diagnosis. Computational and Mathematical Methods in Medicine 2016 (2016).Google Scholar
- K. Kamnitsas, C. Ledig, V. F. J. Newcombe, et al. 2017. Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Medical Image Analysis 36 (2017), 61–78.Google Scholar
Cross Ref
- O. Ronneberger, P. Fischer, and T. Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 234–241.Google Scholar
- M. D. Zeiler, and R. Fergus. 2014. Visualizing and understanding convolutional networks. In European Conference on Computer Vision. Springer, Cham, 818–833.Google Scholar
- Q. Dou, L. Yu, H. Chen, et al. 2017. 3D deeply supervised network for automated segmentation of volumetric medical images. Medical Image Analysis 41 (2017), 40–54.Google Scholar
Cross Ref
- B. Yu, L. Zhou, L. Wang, et al. 2018. 3D cGAN based cross-modality MR image synthesis for brain tumor segmentation. In 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI’18). IEEE, 626–630.Google Scholar
Cross Ref
- W. Bao, J. Yue, and Y. Rao. A deep learning framework for financial time series using stacked autoencoders and long-short term memory. PLoS One 12, 7 (2017), e0180944.Google Scholar
- F. A. Gers, N. N. Schraudolph, and J. Schmidhuber. 2002. Learning precise timing with LSTM recurrent networks. Journal of Machine Learning Research 3 (Aug. 2002), 115–143. Google Scholar
Digital Library
- F. A. Gers, J. Schmidhuber, and F. Cummins. 1999. Learning to forget: Continual prediction with LSTM. In 9th International Conference on Artificial Neural Networks, 850–855. Google Scholar
Digital Library
- A. Gulli, and S. Pal. 2017. Deep Learning with Keras. Packt Publishing Ltd. Google Scholar
Digital Library
- B. H. Menze, A. Jakab, S. Bauer, et al. 2014. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Transactions on Medical Imaging 34, 10 (2014), 1993–2024.Google Scholar
Cross Ref
- S. Bakas, H. Akbari, A. Sotiras, et al. 2017. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data 4 (2017), 170117.Google Scholar
Cross Ref
- S. Bakas, M. Reyes, A. Jakab, et al. 2018. Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. https://arxiv.org/abs/1811.02629 Retrived November, 2018.Google Scholar
- B. Kayalibay, G. Jensen, and P. van der Smagt. 2017. CNN-based segmentation of medical imaging data. https://arxiv.org/abs/1701.03056 Retrived January, 2017.Google Scholar
- M. Havaei, A. Davy, D. Warde-Farley, et al. 2017. Brain tumor segmentation with deep neural networks. Medical Image Analysis 35 (2017), 18–31.Google Scholar
Cross Ref
- C. Zhang, X. Shen, H. Cheng, et al. 2019. Brain tumor segmentation based on hybrid clustering and morphological operations. International Journal of Biomedical Imaging 2019 (2019).Google Scholar
- Cheng'en He, Huijun Xu, Zhong Wang, and Ma Liping. 2020. Automatic segmentation algorithm for multimodal magnetic resonance-based brain tumor images. Acta Optica Sinica 40, 6 (2020), 0610001.Google Scholar
Cross Ref
- Konstantinos Kamnitsas et al. 2017. Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Medical Image Analysis 36 (2017), 61–78.Google Scholar
Cross Ref
Index Terms
Multimodal Brain Tumor Segmentation Based on an Intelligent UNET-LSTM Algorithm in Smart Hospitals
Recommendations
Automated brain tumour segmentation techniques- A review
Automatic segmentation of brain tumour is the process of separating abnormal tissues from normal tissues, such as white matter WM, gray matter GM, and cerebrospinal fluid CSF. The process of segmentation is still challenging due to the diversity of ...
A Survey on Brain Tumor Segmentation and Classification
Brain tumor segmentation and classification is really a difficult process to identify and detect the tumor region. Magnetic resonance image (MRI) gives valuable information to find the affected area in the brain. The MRI brain image is initially ...
CapsNet-based brain tumor segmentation in multimodal MRI images using inhomogeneous voxels in Del vector domain
AbstractGlioma is a type of brain tumor that is the most typical and most aggressive tumor. Magnetic resonance imaging (MRI) has a widespread utilization as an imaging method for assessing the tumor; however, a lot of information obtained from MRI would ...






Comments