skip to main content
research-article

Cell Nuclei Classification in Histopathological Images using Hybrid OLConvNet

Authors Info & Claims
Published:12 March 2020Publication History
Skip Abstract Section

Abstract

Computer-aided histopathological image analysis for cancer detection is a major research challenge in the medical domain. Automatic detection and classification of nuclei for cancer diagnosis impose a lot of challenges in developing state-of-the-art algorithms due to the heterogeneity of cell nuclei and dataset variability. Recently, a multitude of classification algorithms have used complex deep learning models for their dataset. However, most of these methods are rigid, and their architectural arrangement suffers from inflexibility and non-interpretability. In this research article, we have proposed a hybrid and flexible deep learning architecture OLConvNet that integrates the interpretability of traditional object-level features and generalization of deep learning features by using a shallower Convolutional Neural Network (CNN) named as CNN3L. CNN3L reduces the training time by training fewer parameters and hence eliminating space constraints imposed by deeper algorithms. We used F1-score and multiclass Area Under the Curve (AUC) performance parameters to compare the results. To further strengthen the viability of our architectural approach, we tested our proposed methodology with state-of-the-art deep learning architectures AlexNet, VGG16, VGG19, ResNet50, InceptionV3, and DenseNet121 as backbone networks. After a comprehensive analysis of classification results from all four architectures, we observed that our proposed model works well and performs better than contemporary complex algorithms.

References

  1. Xiaowei Chen, Xiaobo Zhou, and Stephen T. C. Wong. 2006. Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy. IEEE Trans. Biomed. Eng. 53, 4 (2006), 762--766.Google ScholarGoogle ScholarCross RefCross Ref
  2. C. Câtoi and A. I. Baba. 2007. Comparative Oncology. The Publishing House of the Romanian Academy, Bucharest, Chapter 3. Retrieved from https://www.ncbi.nlm.nih.gov/books/NBK9553/.Google ScholarGoogle Scholar
  3. Cancer Research UK. 2017. Types of Cancer. Retrieved from https://www.cancerresearchuk.org/what-is-cancer/how-cancer-starts/types-of-cancer.Google ScholarGoogle Scholar
  4. Anant Madabhushi and George Lee. 2016. Image analysis and machine learning in digital pathology: Challenges and opportunities. Medical Image Analysis 33 (2016), 170--175. DOI:https://doi.org/10.1016/j.media.2016.06.037Google ScholarGoogle ScholarCross RefCross Ref
  5. Andrew H. Fischer, Kenneth A. Jacobson, Jack Rose, and Rolf Zeller. 2008. Hematoxylin and eosin staining of tissue and cell sections. Cold Spring Harb. Protoc. 5 (2008), pdb--prot4986.Google ScholarGoogle Scholar
  6. S. Tripathi, S. Mishra, and S. K. Singh. 2016. Routine colon cancer detection using local image descriptors. In Proceedings of the IEEE Region 10 Conference (TENCON’16). 2062--2065. DOI:http://dx.doi.org/10.1109/TENCON.2016.7848388Google ScholarGoogle Scholar
  7. Daniele Zink, Andrew H. Fischer, and Jeffrey A. Nickerson. 2004. Nuclear structure in cancer cells. Nat. Rev. Canc. 4, 9 (2004), 677.Google ScholarGoogle ScholarCross RefCross Ref
  8. Humayun Irshad, Antoine Veillard, Ludovic Roux, and Daniel Racoceanu. 2014. Methods for nuclei detection, segmentation, and classification in digital histopathology: A review—current status and future potential. IEEE Rev. Biomed. Eng. 7 (2014), 97--114.Google ScholarGoogle ScholarCross RefCross Ref
  9. H. Peter Rodemann and Hans-Oliver Rennekampff. 2011. Functional diversity of fibroblasts. In Tumor-Associated Fibroblasts and Their Matrix. Springer, 23--36.Google ScholarGoogle Scholar
  10. Pin Wang, Xianling Hu, Yongming Li, Qianqian Liu, and Xinjian Zhu. 2016. Automatic cell nuclei segmentation and classification of breast cancer histopathology images. Sig. Proc. 122 (2016), 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. James Diamond, Neil H. Anderson, Peter H. Bartels, Rodolfo Montironi, and Peter W. Hamilton. 2004. The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. Human Pathol. 35, 9 (2004), 1121--1131.Google ScholarGoogle ScholarCross RefCross Ref
  12. Scott Doyle, Mark Hwang, Kinsuk Shah, Anant Madabhushi, Michael Feldman, and John Tomaszeweski. 2007. Automated grading of prostate cancer using architectural and textural image features. In Proceedings of the 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro. IEEE, 1284--1287.Google ScholarGoogle ScholarCross RefCross Ref
  13. Metin N. Gurcan, Laura Boucheron, Ali Can, Anant Madabhushi, Nasir Rajpoot, and Bulent Yener. 2009. Histopathological image analysis: A review. IEEE Rev. Biomed. Eng. 2 (2009), 147.Google ScholarGoogle ScholarCross RefCross Ref
  14. Laura E. Boucheron. 2008. Object-and Spatial-level Quantitative Analysis of Multispectral Histopathology Images for Detection and Characterization of Cancer. University of California at Santa Barbara.Google ScholarGoogle Scholar
  15. Korsuk Sirinukunwattana, David R. J. Snead, and Nasir M. Rajpoot. 2015. A novel texture descriptor for detection of glandular structures in colon histology images. In Medical Imaging 2015: Digital Pathology, Vol. 9420. International Society for Optics and Photonics, 94200S.Google ScholarGoogle Scholar
  16. Jun Shi, Jinjie Wu, Yan Li, Qi Zhang, and Shihui Ying. 2017. Histopathological image classification with color pattern random binary hashing-based PCANet and matrix-form classifier. IEEE J. Biomed. Health Inf. 21, 5 (2017), 1327--1337.Google ScholarGoogle ScholarCross RefCross Ref
  17. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436.Google ScholarGoogle Scholar
  18. Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  19. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778.Google ScholarGoogle ScholarCross RefCross Ref
  20. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).Google ScholarGoogle Scholar
  21. Babak Ehteshami Bejnordi, Mitko Veta, Paul Johannes Van Diest, Bram Van Ginneken, Nico Karssemeijer, Geert Litjens, Jeroen A. W. M. Van Der Laak, Meyke Hermsen, Quirine F. Manson, Maschenka Balkenhol, et al. 2017. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318, 22 (2017), 2199--2210.Google ScholarGoogle ScholarCross RefCross Ref
  22. Jianpeng Zhang, Yong Xia, Yutong Xie, Michael Fulham, and David Dagan Feng. 2018. Classification of medical images in the biomedical literature by jointly using deep and handcrafted visual features. IEEE J. Biomed. Health Inf. 22, 5 (2018), 1521--1530.Google ScholarGoogle ScholarCross RefCross Ref
  23. Haibo Wang, Angel Cruz Roa, Ajay N. Basavanhally, Hannah L. Gilmore, Natalie Shih, Mike Feldman, John Tomaszewski, Fabio Gonzalez, and Anant Madabhushi. 2014. Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features. J. Med. Imag. 1, 3 (2014), 034003.Google ScholarGoogle ScholarCross RefCross Ref
  24. Dan C. Cireşan, Alessandro Giusti, Luca M. Gambardella, and Jürgen Schmidhuber. 2013. Mitosis detection in breast cancer histology images with deep neural networks. In Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, 411--418.Google ScholarGoogle ScholarCross RefCross Ref
  25. Sajjad Muhammad, Khan Salman, Khan Muhammad, Wanqing Wu, Amin Ullah, and Sung Wook Baik. 2019. Multi-grade brain tumor classification using deep CNN with extensive data augmentation. J. Computat. Sci. 30 (2019), 174--182.Google ScholarGoogle ScholarCross RefCross Ref
  26. Shui-Hua Wang, Khan Muhammad, Jin Hong, Arun Kumar Sangaiah, and Yu-Dong Zhang. 2018. Alcoholism identification via convolutional neural network based on parametric ReLU, dropout, and batch normalization. Neural Comput. Applic. (10 Dec 2018). DOI:http://dx.doi.org/10.1007/s00521-018-3924-0Google ScholarGoogle Scholar
  27. Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700--4708.Google ScholarGoogle Scholar
  28. Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the inception architecture for computer vision. arXiv preprint arXiv:1512.00567 1512 (2015).Google ScholarGoogle Scholar
  29. Daniele Ravì, Charence Wong, Fani Deligianni, Melissa Berthelot, Javier Andreu-Perez, Benny Lo, and Guang-Zhong Yang. 2017. Deep learning for health informatics. IEEE J. Biomed. Health Inf. 21, 1 (2017), 4--21.Google ScholarGoogle ScholarCross RefCross Ref
  30. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. In Proceedings of the 22nd ACM International Conference on Multimedia. ACM, 675--678.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Ken Chatfield, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Return of the devil in the details: Delving deep into convolutional nets. arXiv preprint arXiv:1405.3531 (2014).Google ScholarGoogle Scholar
  32. Korsuk Sirinukunwattana, Shan E. Ahmed Raza, Yee-Wah Tsang, David R. J. Snead, Ian A. Cree, and Nasir M. Rajpoot. 2016. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans. Med. Imaging 35, 5 (2016), 1196--1206.Google ScholarGoogle ScholarCross RefCross Ref
  33. Hang Chang, Leandro A. Loss, and Bahram Parvin. 2012. Nuclear segmentation in H8E sections via multi-reference graph cut (MRGC). In Proceedings of the International Symposium Biomedical Imaging.Google ScholarGoogle Scholar
  34. Robert M. Haralick, Karthikeyan Shanmugam et al. 1973. Textural features for image classification. IEEE Trans. Syst. Man Cyber. 6 (1973), 610--621.Google ScholarGoogle ScholarCross RefCross Ref
  35. Yann LeCun, Bernhard Boser, John S. Denker, Donnie Henderson, Richard E. Howard, Wayne Hubbard, and Lawrence D. Jackel. 1989. Backpropagation applied to handwritten zip code recognition. Neural Computat. 1, 4 (1989), 541--551.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Andrej Karpathy. 2018. Stanford University CS231n: Convolutional Neural Networks for Visual Recognition. Retrieved from http://cs231n. stanford. edu/syllabus. html.Google ScholarGoogle Scholar
  37. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014. DeCAF: A deep convolutional activation feature for generic visual recognition. In Proceedings of the International Conference on Machine Learning. 647--655.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Thomas P. Vogl, J. K. Mangis, A. K. Rigler, W. T. Zink, and D. L. Alkon. 1988. Accelerating the convergence of the back-propagation method. Biol. Cyber. 59, 4–5 (1988), 257--263.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. The MIT Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Mateusz Buda, Atsuto Maki, and Maciej A. Mazurowski. 2018. A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 106 (2018), 249--259.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Haibo He, Yang Bai, Edwardo A. Garcia, and Shutao Li. 2008. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328.Google ScholarGoogle Scholar
  43. Lisa Torrey, Jude Shavlik, and others. 2009. Transfer learning. Handbook of Research on Machine Learning Applications, Vol. 3. Information Science Reference. 22 pages.Google ScholarGoogle Scholar
  44. Yinyin Yuan, Henrik Failmezger, Oscar M. Rueda, H. Raza Ali, Stefan Gräf, Suet-Feung Chin, Roland F. Schwarz, Christina Curtis, Mark J. Dunning, Helen Bardwell et al. 2012. Quantitative image analysis of cellular heterogeneity in breast tumors complements genomic profiling. Sci. Translat. Med. 4, 157 (2012), 157ra143--157ra143.Google ScholarGoogle Scholar

Index Terms

  1. Cell Nuclei Classification in Histopathological Images using Hybrid OLConvNet

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader

              HTML Format

              View this article in HTML Format .

              View HTML Format
              About Cookies On This Site

              We use cookies to ensure that we give you the best experience on our website.

              Learn more

              Got it!