skip to main content
research-article

Pre-Trained Convolutional Neural Networks for Breast Cancer Detection Using Ultrasound Images

Authors Info & Claims
Published:16 July 2021Publication History
Skip Abstract Section

Abstract

Volunteer computing based data processing is a new trend in healthcare applications. Researchers are now leveraging volunteer computing power to train deep learning networks consisting of billions of parameters. Breast cancer is the second most common cause of death in women among cancers. The early detection of cancer may diminish the death risk of patients. Since the diagnosis of breast cancer manually takes lengthy time and there is a scarcity of detection systems, development of an automatic diagnosis system is needed for early detection of cancer. Machine learning models are now widely used for cancer detection and prediction research for improving the successive therapy of patients. Considering this need, this study implements pre-trained convolutional neural network based models for detecting breast cancer using ultrasound images. In particular, we tuned the pre-trained models for extracting key features from ultrasound images and included a classifier on the top layer. We measured accuracy of seven popular state-of-the-art pre-trained models using different optimizers and hyper-parameters through fivefold cross validation. Moreover, we consider Grad-CAM and occlusion mapping techniques to examine how well the models extract key features from the ultrasound images to detect cancers. We observe that after fine tuning, DenseNet201 and ResNet50 show 100% accuracy with Adam and RMSprop optimizers. VGG16 shows 100% accuracy using the Stochastic Gradient Descent optimizer. We also develop a custom convolutional neural network model with a smaller number of layers compared to large layers in the pre-trained models. The model also shows 100% accuracy using the Adam optimizer in classifying healthy and breast cancer patients. It is our belief that the model will assist healthcare experts with improved and faster patient screening and pave a way to further breast cancer research.

References

  1. François Chollet. 2017. Deep learning with depth wise separable convolutions. arxiv:1610.02357.Google ScholarGoogle Scholar
  2. Joseph A. Cruz and David S. Wishart. 2006. Applications of machine learning in cancer prediction and prognosis. Cancer Informatics 2006, 2 (Jan. 2006), 59–77. DOI:https://doi.org/10.1177/117693510600200030Google ScholarGoogle Scholar
  3. Travis Desell. 2017. Large scale evolution of convolutional neural networks using volunteer computing. arxiv:1703.05422. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ahemd Ghoneim, Ghulam Muhammad, and M. Shamim Hossain. 2020. Cervical cancer classification using convolutional neural networks and extreme learning machines. Future Generation Computer Systems 102 (Jan. 2020), 643–649. DOI:https://doi.org/10.1016/j.future.2019.09.015Google ScholarGoogle Scholar
  5. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. arxiv:1512.03385.Google ScholarGoogle Scholar
  6. Geoffrey Hinton. 2020. Lecture 6e RMSprop: Divide the gradient by a running average of its recent magnitude. Retrieved May 2, 2020 from https://www.cs.toronto.edu/ hinton/coursera/lecture6/lec6.pdf.Google ScholarGoogle Scholar
  7. M. Shamim Hossain, Syed Umar Amin, Mansour Alsulaiman, and Ghulam Muhammad. 2019. Applying deep learning for epilepsy seizure detection and brain mapping visualization. ACM Transactions on Multimedia Computing 15, 1 (Feb. 2019), 1–17. DOI:https://doi.org/10.1145/3241056 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. Shamim Hossain. 2017. Cloud-Supported Cyber-Physical Localization Framework for Patients Monitoring. IEEE Systems Journal 11, 1, (March 2017), 118–127. https://doi.org/10.1109/JSYST.2015.2470644.Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Shamim Hossaina and Ghulam Muhammad. 2019. Emotion recognition using deep learning approach from audio–visual emotional big data. Information Fusion 49, 2019 (Sept. 2019), 69–78. DOI:https://doi.org/10.1016/j.inffus.2018.09.008Google ScholarGoogle Scholar
  10. Gao Huang, Zhuang Liu, Laurens van der Maaten, and Kilian Q. Weinberger. 2018. Densely connected convolutional network. arxiv:1608.06993Google ScholarGoogle Scholar
  11. Daniel S. Kermany, Michael Goldbaum, Wenjia Cai, Carolina C. S. Valentim, Huiying Liang, Sally L. Baxter, Alex McKeown, et al. 2018. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 5 (Feb. 2018), 1122–1231. DOI:https://doi.org/10.1016/j.cell.2018.02.010Google ScholarGoogle ScholarCross RefCross Ref
  12. Ekasit Kijsipongse, Apivadee Piyatumrong, and Suriya U-ruekolan. 2018. A hybrid GPU cluster and volunteer computing platform for scalable deep learning. Journal of Supercomputing 74 (April 2018), 3236–3263. DOI:https://doi.org/10.1007/s11227-018-2375-9 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ekasit Kijsipongse, Apivadee Piyatumrong, and Suriya U-ruekolan. 2018. A hybrid GPU cluster and volunteer computing platform for scalable deep learning. Journal of Supercomputing 74 (April 2018), 3236–3263. DOI:https://doi.org/10.1007/s11227-018-2375-9 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arxiv:1412.6980.Google ScholarGoogle Scholar
  15. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM 60, 6 (May 2017), 84–90. DOI:https://doi.org/10.1145/3065386 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Scotty Kwok. 2018. Multiclass classification of breast cancer in whole-slide images. In Proceedings of the 15th International Conference on Image Analysis and Recognition (ICIAR’18). IEEE, Los Alamitos, CA, 931–940. DOI:https://doi.org/10.1007/978-3-319-93000-8_106Google ScholarGoogle ScholarCross RefCross Ref
  17. Xiaowen Liang, Jinsui Yu, Jianyi Liao, and Zhiyi Chen. 2020. Convolutional neural network for breast and thyroid nodules diagnosis in ultrasound imaging. BioMed Research International 2020 (Jan. 2020), 9. DOI:https://doi.org/10.1155/2020/1763803Google ScholarGoogle Scholar
  18. Ning Mao, Ping Yin, Qinglin Wang, Meijie Liu, Jianjun Dong, Xuexi Zhang, Haizhu Xie, and Nan Hong. 2019. Added value of radiomics on mammography for breast cancer diagnosis: A feasibility study. Journal of the American College of Radiology 16, 4 (April 2019), 485–491. DOI:https://doi.org/10.1016/j.jacr.2018.09.041Google ScholarGoogle ScholarCross RefCross Ref
  19. Mehedi Masud, M. S. Hossain, and Atif Alamri. 2012. Data interoperability and multimedia content management in e-health systems. IEEE Transactions on Information Technology in Biomedicine 16, 6 (Nov. 2012), 1015–1023. DOI:https://doi.org/10.1109/TITB.2012.2202244 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Yiming Miao, Yingying Jiang, Limei Peng, and M. Shamim Hossain. 2018. Telesurgery robot based on 5G Tactile Internets. Mobile Networks and Applications 23, 6 (Sept. 2018), 1645–1654. DOI:https://doi.org/10.1007/s11036-018-1110-3 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Ghulam Muhammad, M. Shamim Hossain, and A. Yasmine. 2020. Tree-based deep networks for edge device. IEEE Transactions on Industrial Informatics 16, 3 (March 2020), 2022–2028. DOI:https://doi.org/10.1109/TII.2019.2950326Google ScholarGoogle ScholarCross RefCross Ref
  22. C. Muñoz-Meza and Wilfrido Gómez. 2013. A feature selection methodology for breast ultrasound classification. In Proceedings of the 10th International Conference on Electrical Engineering, Computing Science, and Automatic Control (CCE’13). IEEE, Los Alamitos, CA. DOI:https://doi.org/10.1109/ICEEE.2013.6676056Google ScholarGoogle Scholar
  23. Wajahat Nawaz, Sagheer Ahmed, Ali Tahir, and Hassan Aqeel Khan. 2018. Classification of breast cancer histology images using AlexNet. In Proceedings of the 15th International Conference on Image Analysis and Recognition (ICIAR’18). IEEE, Los Alamitos, CA, 869–876. DOI:https://doi.org/10.1007/978-3-319-93000-8_99Google ScholarGoogle ScholarCross RefCross Ref
  24. Maithra Raghu, Chiyuan Zhang, Jon Kleinberg, and Samy Bengio. 2019. Transfusion: Understanding transfer learning with applications to medical imaging. arxiv:1902.07208.Google ScholarGoogle Scholar
  25. Alexander Rakhlin, Alexey Shvets, Vladimir Iglovikov, and Alexandr A. Kalinin. 2018. Deep convolutional neural networks for breast cancer histology image analysis. arxiv:1802.00752.Google ScholarGoogle Scholar
  26. Hariharan Ravishankar, Prasad Sudhakar, and Rahul Venkataramani. 2016. Understanding the mechanisms of deep transfer learning for medical images. arxiv:1704.06040.Google ScholarGoogle Scholar
  27. Waseem Rawat and Zenghui Wang. 2017. Deep convolutional neural networks for image classification: A comprehensive review. Neural Computing 29, 9 (Sept. 2017), 2352–2449. DOI:https://doi.org/10.1162/NECO_a_00990 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. R. G. Hagerty, P. N. Butow, P. M. Ellis, S. Dimitry, and M. H. N. Tattersall. 2006. Communicating prognosis in cancer care: A systematic review of the literature. Annals of Oncology 16, 7 (July 2006), 1005–1053. DOI:https://doi.org/10.1093/annonc/mdi211Google ScholarGoogle Scholar
  29. Paulo Sergio Rodrigues. 2017. Breast ultrasound image. Mendeley Data. Retrieved April 10, 2020 from http://dx.doi.org/10.17632/wmy84gzngw.1Google ScholarGoogle Scholar
  30. David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. 1986. Learning representations by back-propagating error. Nature 323 (Oct. 1986), 533–536.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Auxiliadora Sarmiento and Irene Fondón. 2018. Automatic breast cancer grading of histological images based on colour and texture descriptors. In Proceedings of the 15th International Conference on Image Analysis and Recognition (ICIAR’18). IEEE, Los Alamitos, CA, 869–876. DOI:https://doi.org/10.1007/978-3-319-93000-8_101Google ScholarGoogle ScholarCross RefCross Ref
  32. Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2019. Grad-CAM: Visual explanations from deep networks via gradient-based localization. arxiv:1610.02391.Google ScholarGoogle Scholar
  33. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. arxiv:1409.1556.Google ScholarGoogle Scholar
  34. U.S. Cancer Statistics. 2020. Cancer Facts and Figures 2020. Retrieved May 2, 2020 from https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2020.html.Google ScholarGoogle Scholar
  35. Eckehard Steinbach, Matti Strese, and Mohamad Samir A. Eid. 2018. Haptic codecs for the Tactile Internet. Proceedings of the IEEE 107, 2 (Sept. 2018), 447–470. DOI:https://doi.org/10.1109/JPROC.2018.2867835Google ScholarGoogle Scholar
  36. Sukhmani Sukhmani, Mohammad Sadeghi, Melike Erol-Kantarci, and Abdulmotaleb El Saddik. 2019. Edge caching and computing in 5G for mobile AR/VR and Tactile Internet. IEEE MultiMedia 26, 1 (Jan. 2019), 21–30. DOI:https://doi.org/10.1109/MMUL.2018.2879591Google ScholarGoogle ScholarCross RefCross Ref
  37. Yeeleng S. Vang, Zhen Chen, and Xiaohui Xie. 2018. Deep learning framework for multi-class breast cancer histology image classification. arxiv:1802.00931.Google ScholarGoogle Scholar
  38. Hongyu Wang, Jun Feng, Qirong Bu, Feihong Liu, Min Zhang, Yu Ren, and Yi Lv. 2018. Breast mass detection in digital mammogram based on gestalt psychology. Journal of Healthcare Engineering 2018 (2018), 4015613. DOI:https://doi.org/10.1155/2018/4015613Google ScholarGoogle ScholarCross RefCross Ref
  39. Ghulam Muhammad, M. Shamim Hossain and Neeraj Kumar. 2021. EEG-Based pathology detection for home health monitoring. IEEE Journal on Selected Areas in Communications 39, 2 (Feb. 2021), 603–610. https://doi.org/10.1109/JSAC.2020.3020654Google ScholarGoogle ScholarCross RefCross Ref
  40. Yi Wang, Eun Jung Choi, Younhee Choi, Hao Zhang, Gong Yong Jin, and Seok-Bum Ko. 2020. Breast cancer classification in automated breast ultrasound using multiview convolutional neural network with transfer learning. Ultrasound in Medicine and Biology 2020 (May 2020), 1119–1132. DOI:https://doi.org/10.1016/j.ultrasmedbio.2020.01.001Google ScholarGoogle Scholar
  41. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks?arxiv:1411.1792. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and understanding convolutional networks. arxiv:1311.2901.Google ScholarGoogle Scholar
  43. Xiao Zheng, Xie Faqiang, Shi Jianwei, and Niu Xiaolan Tang. 2020. Breast ultrasound image classification and segmentation using convolutional neural networks. Advances in Multimedia Information Processing 2018 (2020), 200–211. DOI:https://doi.org/10.1007/978-3-030-00764-5_19Google ScholarGoogle Scholar

Index Terms

  1. Pre-Trained Convolutional Neural Networks for Breast Cancer Detection Using Ultrasound Images

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Internet Technology
        ACM Transactions on Internet Technology  Volume 21, Issue 4
        November 2021
        520 pages
        ISSN:1533-5399
        EISSN:1557-6051
        DOI:10.1145/3472282
        • Editor:
        • Ling Lu
        Issue’s Table of Contents

        Copyright © 2021 Association for Computing Machinery.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 16 July 2021
        • Accepted: 1 August 2020
        • Revised: 1 July 2020
        • Received: 1 May 2020
        Published in toit Volume 21, Issue 4

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!