skip to main content
research-article

Automatic Parotid Gland Segmentation in MVCT Using Deep Convolutional Neural Networks

Published:20 December 2021Publication History
Skip Abstract Section

Abstract

Radiation-induced xerostomia, as a major problem in radiation treatment of the head and neck cancer, is mainly due to the overdose irradiation injury to the parotid glands. Helical Tomotherapy-based megavoltage computed tomography (MVCT) imaging during the Tomotherapy treatment can be applied to monitor the successive variations in the parotid glands. While manual segmentation is time consuming, laborious, and subjective, automatic segmentation is quite challenging due to the complicated anatomical environment of head and neck as well as noises in MVCT images. In this article, we propose a localization-refinement scheme to segment the parotid gland in MVCT. After data pre-processing we use mask region convolutional neural network (Mask R-CNN) in the localization stage after data pre-processing, and design a modified U-Net in the following fine segmentation stage. To the best of our knowledge, this study is a pioneering work of deep learning on MVCT segmentation. Comprehensive experiments based on different data distribution of head and neck MVCTs and different segmentation models have demonstrated the superiority of our approach in terms of accuracy, effectiveness, flexibility, and practicability. Our method can be adopted as a powerful tool for radiation-induced injury studies, where accurate organ segmentation is crucial.

REFERENCES

  1. [1] Brosch T., Tang L. Y. W., Yoo Y., Li D. K. B., Traboulsee A., and Tam R.. 2016. Deep 3D convolutional encoder networks with shortcuts for multiscale feature integration applied to multiple sclerosis lesion segmentation. IEEE Transactions on Medical Imaging 35, 5 (May 2016), 12291239. DOI: https://doi.org/10.1109/TMI.2016.2528821Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Choi Hongyoon and Jin Kyong Hwan. 2016. Fast and robust segmentation of the striatum using deep convolutional neural networks. Journal of Neuroscience Methods 274, 1 (2016), 146153.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Çiçek Özgün, Abdulkadir Ahmed, Lienkamp Soeren S., Brox Thomas, and Ronneberger Olaf. 2016. 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016, Ourselin Sebastien, Joskowicz Leo, Sabuncu Mert R., Unal Gozde, and Wells William (Eds.), Springer International Publishing, Cham, 424.Google ScholarGoogle Scholar
  4. [4] Deasy Joseph O., Moiseenko Vitali, Marks Lawrence, Chao K. S. Clifford, Nam Jiho, and Eisbruch Avraham. 2010. Radiotherapy dose-volume effects on salivary gland function. International Journal of Radiation Oncology*Biology*Physics 76, 3 (2010), S58–S63.Google ScholarGoogle Scholar
  5. [5] Dijk Lisanne V. Van, Brouwer Charlotte L., Schaaf Arjen Van Der, Burgerhof Johannes G. M., Beukinga Roelof J., Langendijk Johannes A., Sijtsema Nanna M., and Steenbakkers Roel J. H. M.. 2017. CT image biomarkers to improve patient-specific prediction of radiation-induced xerostomia and sticky saliva. Radiotherapy Oncology 122, 2 (2017), 185191.Google ScholarGoogle Scholar
  6. [6] He Kaiming, Gkioxari Georgia, Dollar Piotr, and Girshick Ross. 2017. Mask R-CNN. In 2017 IEEE International Conference on Computer Vision. 2980–2988. https://doi.org/10.1109/ICCV.2017.322Google ScholarGoogle Scholar
  7. [7] Hollensen Christian, Cannon George, Cannon Donald, Bentzen Søren, and Larsen Rasmus. 2012. Lung tumor segmentation using electric flow lines for graph cuts. In Proceedings of the Image Analysis and Recognition, Campilho Aurélio and Kamel Mohamed (Eds.), Springer Berlin Heidelberg, Berlin, 206213. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Huo J., Wu J., Cao J., and Wang G.. 2018. Supervoxel based method for multi-atlas segmentation of brain MR images. Neuroimage 175, 15 (2018), 201214.Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Ibragimov B. and Xing L.. 2017. Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Medical Physics 44, 2 (2017), 547.Google ScholarGoogle Scholar
  10. [10] Ivo Beetz, Cornelis Schilstra, Arjen Van Der Schaaf, R. Van Den Heuvel, Edwin, Patricia Doornaert, Peter Van Luijk, Arjan Vissink, M. van der Laan Bernard F. A., Leemans Charles R., and Bijl Henk P.. 2012. NTCP models for patient-rated xerostomia and sticky saliva after treatment with intensity modulated radiotherapy for head and neck cancer: The role of dosimetric and clinical factors. Radiotherapy Oncology 105, 1 (2012), 101106.Google ScholarGoogle Scholar
  11. [11] Jens Kleesiek, Gregor Urban, Alexander Hubert, Daniel Schwarz, Klaus Maier-Hein, Martin Bendszus, and Armin Biller. 2016. Deep MRI brain extraction: A 3D convolutional neural network for skull stripping. NeuroImage 129, 1 (2016), 460469. DOI: https://doi.org/10.1016/j.neuroimage.2016.01.024Google ScholarGoogle Scholar
  12. [12] Korolev S., Safiullin A., Belyaev M., and Dodonova Y.. 2017. Residual and plain convolutional neural networks for 3D brain MRI classification. In Proceedings of the 2017 IEEE 14th International Symposium on Biomedical Imaging. 835838. DOI: https://doi.org/10.1109/ISBI.2017.7950647Google ScholarGoogle Scholar
  13. [13] Lee Lay Khoon, Liew Siau Chuin, and Thong Weng Jie. 2015. A review of image segmentation methodologies in medical image. In Proceedings of the Advanced Computer and Communication Engineering Technology, Sulaiman Hamzah Asyrani, Othman Mohd Azlishah, Othman Mohd Fairuz Iskandar, Rahim Yahaya Abd, and Pee Naim Che (Eds.), Springer International Publishing, Cham, 10691080.Google ScholarGoogle Scholar
  14. [14] Liu Yaru, Yue Chenxi, Zhu Jian, Yu Haining, Cheng Yang, Yin Yong, Li Baosheng, and Dong Jiwen. 2019. A Megavoltage CT image enhancement method for image-guided and adaptive helical tomotherapy. Frontiers in Oncology 9, 362 (2019), 362. DOI: https://doi.org/10.3389/fonc.2019.00362Google ScholarGoogle Scholar
  15. [15] Long Jonathan, Shelhamer Evan, and Darrell Trevor. 2014. Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis Machine Intelligence 39, 4 (2014), 640651. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Men Kuo, Dai Jianrong, and Li Yexiong. 2017. Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks. Medical Physics 44, 12 (2017), 63776389.Google ScholarGoogle Scholar
  17. [17] Milletari F., Navab N., and Ahmadi S.. 2016. V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In Proceedings of the 2016 4th International Conference on 3D Vision. 565571. DOI: https://doi.org/10.1109/3DV.2016.79Google ScholarGoogle Scholar
  18. [18] Pereira S., Pinto A., Alves V., and Silva C. A.. 2016. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Transactions on Medical Imaging 35, 5 (2016), 12401251.Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Perna L., Sini C., Cozzarini C., Agnello G., Cattaneo G. M., Hysing L. B., Muren L. P., Fiorino C., and Calandrino R.. 2016. Deformable registration-based segmentation of the bowel on Megavoltage CT during pelvic radiotherapy. Physica Medica 32, 7 (2016), 898904.Google ScholarGoogle Scholar
  20. [20] Ren S., He K., Girshick R., and Sun J.. 2017. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis Machine Intelligence 39, 6 (2017), 11371149. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Romanchikova M., Johnston D. I., Harrison K., Sutcliffe M. P. F., Scaife J. E., Thomas S. J., and Burnet N. G.. 2016. EP-1894: Evaluation of a novel method for automatic segmentation of rectum on daily MVCT prostate images. Radiotherapy Oncology 119, S1 (supplement) (2016), S896.Google ScholarGoogle Scholar
  22. [22] Ronneberger Olaf, Fischer Philipp, and Brox Thomas. 2015. U-Net: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention.Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Ruchala K. J., Cox A., Kupelian P. A., and Meeks S. L.. 2008. Patient dose from megavoltage computed tomography imaging. International Journal of Radiation Oncology*Biology*Physics 70, 5 (2008), 15791587.Google ScholarGoogle Scholar
  24. [24] Ruchala K. J., Olivera G. H., Schloesser E. A., and Mackie T. R.. 1999. Megavoltage CT on a tomotherapy system. Physics in Medicine Biology 44, 10 (1999), 2597.Google ScholarGoogle Scholar
  25. [25] S. Tribius M. D., Prosch C., Bajrovic A., Muenscher A., Blessmann M., Kruell A., Petersen C., Todorovic M., and Tennstedt P.. 2013. Xerostomia after radiotherapy. Strahlentherapie Und Onkologie 189, 3 (2013), 216222.Google ScholarGoogle Scholar
  26. [26] Tom Vercauteren, Xavier Pennec, Aymeric Perchant, and Nicholas Ayache. 2009. Diffeomorphic demons: Efficient non-parametric image registration. Neuroimage 45, 1 (2009), S61–S72.Google ScholarGoogle Scholar
  27. [27] Wong S. T., Fung W. W. K., Chiu G., and Atyeo J.. 2014. OC-0178: Comparison of five workflows for automatic re-contouring in MIM software for the purpose of adaptive radiotherapy. Radiotherapy and Oncology 111, 1 (2014), S70. DOI: https://doi.org/10.1016/S0167-8140(15)30283-8ESTRO 33, 4–8 April 2014, Vienna, Austria.Google ScholarGoogle Scholar
  28. [28] Wu H., Chen X., Yang X., Tao Y., Xia Y., Deng X., Zheng C., Robbins J., Schultz C., and Li X. A.. 2018. Early prediction of acute xerostomia during radiation therapy for head and neck cancer based on texture analysis of daily CT. International Journal of Radiation Oncology* Biology* Physics 102, 4 (2018), 13081318.Google ScholarGoogle Scholar
  29. [29] Xie Yuanpu, Zhang Zizhao, Sapkota Manish, and Yang Lin. 2016. Spatial clockwork recurrent neural network for muscle perimysium segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016, Ourselin Sebastien, Joskowicz Leo, Sabuncu Mert R., Unal Gozde, and Wells William (Eds.), Springer International Publishing, Cham, 185193.Google ScholarGoogle Scholar
  30. [30] Yang Xulei, Zeng Zeng, and Yi Su. 2017. Deep convolutional neural networks for automatic segmentation of left ventricle cavity from cardiac magnetic resonance images. Iet Computer Vision 11, 8 (2017), 643649.Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Zhao Y., Li H., Wan S., Sekuboyina A., Hu X., Tetteh G., Piraud M., and Menze B.. 2019. Knowledge-Aided convolutional neural network for small organ segmentation. IEEE Journal of Biomedical and Health Informatics 23, 4 (July 2019), 13631373. DOI: https://doi.org/10.1109/JBHI.2019.2891526Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Automatic Parotid Gland Segmentation in MVCT Using Deep Convolutional Neural Networks

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Computing for Healthcare
      ACM Transactions on Computing for Healthcare  Volume 3, Issue 2
      April 2022
      292 pages
      ISSN:2691-1957
      EISSN:2637-8051
      DOI:10.1145/3505188
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 20 December 2021
      • Accepted: 1 September 2021
      • Revised: 1 April 2021
      • Received: 1 November 2020
      Published in health Volume 3, Issue 2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!