Abstract
Computer-aided histopathological image analysis for cancer detection is a major research challenge in the medical domain. Automatic detection and classification of nuclei for cancer diagnosis impose a lot of challenges in developing state-of-the-art algorithms due to the heterogeneity of cell nuclei and dataset variability. Recently, a multitude of classification algorithms have used complex deep learning models for their dataset. However, most of these methods are rigid, and their architectural arrangement suffers from inflexibility and non-interpretability. In this research article, we have proposed a hybrid and flexible deep learning architecture OLConvNet that integrates the interpretability of traditional object-level features and generalization of deep learning features by using a shallower Convolutional Neural Network (CNN) named as CNN3L. CNN3L reduces the training time by training fewer parameters and hence eliminating space constraints imposed by deeper algorithms. We used F1-score and multiclass Area Under the Curve (AUC) performance parameters to compare the results. To further strengthen the viability of our architectural approach, we tested our proposed methodology with state-of-the-art deep learning architectures AlexNet, VGG16, VGG19, ResNet50, InceptionV3, and DenseNet121 as backbone networks. After a comprehensive analysis of classification results from all four architectures, we observed that our proposed model works well and performs better than contemporary complex algorithms.
- Xiaowei Chen, Xiaobo Zhou, and Stephen T. C. Wong. 2006. Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy. IEEE Trans. Biomed. Eng. 53, 4 (2006), 762--766.Google Scholar
Cross Ref
- C. Câtoi and A. I. Baba. 2007. Comparative Oncology. The Publishing House of the Romanian Academy, Bucharest, Chapter 3. Retrieved from https://www.ncbi.nlm.nih.gov/books/NBK9553/.Google Scholar
- Cancer Research UK. 2017. Types of Cancer. Retrieved from https://www.cancerresearchuk.org/what-is-cancer/how-cancer-starts/types-of-cancer.Google Scholar
- Anant Madabhushi and George Lee. 2016. Image analysis and machine learning in digital pathology: Challenges and opportunities. Medical Image Analysis 33 (2016), 170--175. DOI:https://doi.org/10.1016/j.media.2016.06.037Google Scholar
Cross Ref
- Andrew H. Fischer, Kenneth A. Jacobson, Jack Rose, and Rolf Zeller. 2008. Hematoxylin and eosin staining of tissue and cell sections. Cold Spring Harb. Protoc. 5 (2008), pdb--prot4986.Google Scholar
- S. Tripathi, S. Mishra, and S. K. Singh. 2016. Routine colon cancer detection using local image descriptors. In Proceedings of the IEEE Region 10 Conference (TENCON’16). 2062--2065. DOI:http://dx.doi.org/10.1109/TENCON.2016.7848388Google Scholar
- Daniele Zink, Andrew H. Fischer, and Jeffrey A. Nickerson. 2004. Nuclear structure in cancer cells. Nat. Rev. Canc. 4, 9 (2004), 677.Google Scholar
Cross Ref
- Humayun Irshad, Antoine Veillard, Ludovic Roux, and Daniel Racoceanu. 2014. Methods for nuclei detection, segmentation, and classification in digital histopathology: A review—current status and future potential. IEEE Rev. Biomed. Eng. 7 (2014), 97--114.Google Scholar
Cross Ref
- H. Peter Rodemann and Hans-Oliver Rennekampff. 2011. Functional diversity of fibroblasts. In Tumor-Associated Fibroblasts and Their Matrix. Springer, 23--36.Google Scholar
- Pin Wang, Xianling Hu, Yongming Li, Qianqian Liu, and Xinjian Zhu. 2016. Automatic cell nuclei segmentation and classification of breast cancer histopathology images. Sig. Proc. 122 (2016), 1--13.Google Scholar
Digital Library
- James Diamond, Neil H. Anderson, Peter H. Bartels, Rodolfo Montironi, and Peter W. Hamilton. 2004. The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. Human Pathol. 35, 9 (2004), 1121--1131.Google Scholar
Cross Ref
- Scott Doyle, Mark Hwang, Kinsuk Shah, Anant Madabhushi, Michael Feldman, and John Tomaszeweski. 2007. Automated grading of prostate cancer using architectural and textural image features. In Proceedings of the 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro. IEEE, 1284--1287.Google Scholar
Cross Ref
- Metin N. Gurcan, Laura Boucheron, Ali Can, Anant Madabhushi, Nasir Rajpoot, and Bulent Yener. 2009. Histopathological image analysis: A review. IEEE Rev. Biomed. Eng. 2 (2009), 147.Google Scholar
Cross Ref
- Laura E. Boucheron. 2008. Object-and Spatial-level Quantitative Analysis of Multispectral Histopathology Images for Detection and Characterization of Cancer. University of California at Santa Barbara.Google Scholar
- Korsuk Sirinukunwattana, David R. J. Snead, and Nasir M. Rajpoot. 2015. A novel texture descriptor for detection of glandular structures in colon histology images. In Medical Imaging 2015: Digital Pathology, Vol. 9420. International Society for Optics and Photonics, 94200S.Google Scholar
- Jun Shi, Jinjie Wu, Yan Li, Qi Zhang, and Shihui Ying. 2017. Histopathological image classification with color pattern random binary hashing-based PCANet and matrix-form classifier. IEEE J. Biomed. Health Inf. 21, 5 (2017), 1327--1337.Google Scholar
Cross Ref
- Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436.Google Scholar
- Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--9.Google Scholar
Cross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778.Google Scholar
Cross Ref
- Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).Google Scholar
- Babak Ehteshami Bejnordi, Mitko Veta, Paul Johannes Van Diest, Bram Van Ginneken, Nico Karssemeijer, Geert Litjens, Jeroen A. W. M. Van Der Laak, Meyke Hermsen, Quirine F. Manson, Maschenka Balkenhol, et al. 2017. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318, 22 (2017), 2199--2210.Google Scholar
Cross Ref
- Jianpeng Zhang, Yong Xia, Yutong Xie, Michael Fulham, and David Dagan Feng. 2018. Classification of medical images in the biomedical literature by jointly using deep and handcrafted visual features. IEEE J. Biomed. Health Inf. 22, 5 (2018), 1521--1530.Google Scholar
Cross Ref
- Haibo Wang, Angel Cruz Roa, Ajay N. Basavanhally, Hannah L. Gilmore, Natalie Shih, Mike Feldman, John Tomaszewski, Fabio Gonzalez, and Anant Madabhushi. 2014. Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features. J. Med. Imag. 1, 3 (2014), 034003.Google Scholar
Cross Ref
- Dan C. Cireşan, Alessandro Giusti, Luca M. Gambardella, and Jürgen Schmidhuber. 2013. Mitosis detection in breast cancer histology images with deep neural networks. In Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, 411--418.Google Scholar
Cross Ref
- Sajjad Muhammad, Khan Salman, Khan Muhammad, Wanqing Wu, Amin Ullah, and Sung Wook Baik. 2019. Multi-grade brain tumor classification using deep CNN with extensive data augmentation. J. Computat. Sci. 30 (2019), 174--182.Google Scholar
Cross Ref
- Shui-Hua Wang, Khan Muhammad, Jin Hong, Arun Kumar Sangaiah, and Yu-Dong Zhang. 2018. Alcoholism identification via convolutional neural network based on parametric ReLU, dropout, and batch normalization. Neural Comput. Applic. (10 Dec 2018). DOI:http://dx.doi.org/10.1007/s00521-018-3924-0Google Scholar
- Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700--4708.Google Scholar
- Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the inception architecture for computer vision. arXiv preprint arXiv:1512.00567 1512 (2015).Google Scholar
- Daniele Ravì, Charence Wong, Fani Deligianni, Melissa Berthelot, Javier Andreu-Perez, Benny Lo, and Guang-Zhong Yang. 2017. Deep learning for health informatics. IEEE J. Biomed. Health Inf. 21, 1 (2017), 4--21.Google Scholar
Cross Ref
- Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. In Proceedings of the 22nd ACM International Conference on Multimedia. ACM, 675--678.Google Scholar
Digital Library
- Ken Chatfield, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Return of the devil in the details: Delving deep into convolutional nets. arXiv preprint arXiv:1405.3531 (2014).Google Scholar
- Korsuk Sirinukunwattana, Shan E. Ahmed Raza, Yee-Wah Tsang, David R. J. Snead, Ian A. Cree, and Nasir M. Rajpoot. 2016. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans. Med. Imaging 35, 5 (2016), 1196--1206.Google Scholar
Cross Ref
- Hang Chang, Leandro A. Loss, and Bahram Parvin. 2012. Nuclear segmentation in H8E sections via multi-reference graph cut (MRGC). In Proceedings of the International Symposium Biomedical Imaging.Google Scholar
- Robert M. Haralick, Karthikeyan Shanmugam et al. 1973. Textural features for image classification. IEEE Trans. Syst. Man Cyber. 6 (1973), 610--621.Google Scholar
Cross Ref
- Yann LeCun, Bernhard Boser, John S. Denker, Donnie Henderson, Richard E. Howard, Wayne Hubbard, and Lawrence D. Jackel. 1989. Backpropagation applied to handwritten zip code recognition. Neural Computat. 1, 4 (1989), 541--551.Google Scholar
Digital Library
- Andrej Karpathy. 2018. Stanford University CS231n: Convolutional Neural Networks for Visual Recognition. Retrieved from http://cs231n. stanford. edu/syllabus. html.Google Scholar
- Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014. DeCAF: A deep convolutional activation feature for generic visual recognition. In Proceedings of the International Conference on Machine Learning. 647--655.Google Scholar
Digital Library
- Thomas P. Vogl, J. K. Mangis, A. K. Rigler, W. T. Zink, and D. L. Alkon. 1988. Accelerating the convergence of the back-propagation method. Biol. Cyber. 59, 4–5 (1988), 257--263.Google Scholar
Digital Library
- Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.Google Scholar
Digital Library
- Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. The MIT Press.Google Scholar
Digital Library
- Mateusz Buda, Atsuto Maki, and Maciej A. Mazurowski. 2018. A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 106 (2018), 249--259.Google Scholar
Digital Library
- Haibo He, Yang Bai, Edwardo A. Garcia, and Shutao Li. 2008. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328.Google Scholar
- Lisa Torrey, Jude Shavlik, and others. 2009. Transfer learning. Handbook of Research on Machine Learning Applications, Vol. 3. Information Science Reference. 22 pages.Google Scholar
- Yinyin Yuan, Henrik Failmezger, Oscar M. Rueda, H. Raza Ali, Stefan Gräf, Suet-Feung Chin, Roland F. Schwarz, Christina Curtis, Mark J. Dunning, Helen Bardwell et al. 2012. Quantitative image analysis of cellular heterogeneity in breast tumors complements genomic profiling. Sci. Translat. Med. 4, 157 (2012), 157ra143--157ra143.Google Scholar
Index Terms
Cell Nuclei Classification in Histopathological Images using Hybrid OLConvNet
Recommendations
Classification of histopathological biopsy images using ensemble of deep learning networks
CASCON '19: Proceedings of the 29th Annual International Conference on Computer Science and Software EngineeringBreast cancer is one of the leading causes of death across the world in women. Early diagnosis of this type of cancer is critical for treatment and patient care. Computer-aided detection (CAD) systems using convolutional neural networks (CNN) could ...
Multiclass wound image classification using an ensemble deep CNN-based classifier
AbstractAcute and chronic wounds are a challenge to healthcare systems around the world and affect many people's lives annually. Wound classification is a key step in wound diagnosis that would help clinicians to identify an optimal treatment ...
Highlights- Deep Learning-based methods can be used for wound analysis.
- DCNN-based ...
Transfer learning-assisted multi-resolution breast cancer histopathological images classification
AbstractBreast cancer is one of the leading death cause among women nowadays. Several methods have been proposed for the detection of breast cancer. Various machine learning-based automatic diagnosis systems have been developed known as Computer Aided ...






Comments