skip to main content
research-article

No-reference Quality Assessment for Contrast-distorted Images Based on Gray and Color-gray-difference Space

Published:06 February 2023Publication History
Skip Abstract Section

Abstract

No-reference image quality assessment is a basic and challenging problem in the field of image processing. Among them, contrast distortion has a great impact on the perception of image quality. However, there are relatively few studies on no-reference quality assessment of contrast-distorted images. This article proposes a no-reference quality assessment algorithm for contrast-distorted images based on gray and color-gray-difference (CGD) space. In terms of gray space, we consider the local and global aspects, and use the distribution characteristics of the grayscale histogram to represent global features, while local features are described by the fusion of Local Binary Pattern (LBP) operator and gradient. In terms of CGD space, we first randomly extract patches from the entire image and then extract appropriate quality perception features in the patch’s CGD histogram. Finally, the AdaBoosting back propagation (BP) neural network is used to train the prediction model to predict the quality of the contrast-distorted image. Extensive analysis and cross-validation are carried out on five contrast-related image databases, and the experimental results have proved the superiority of this method compared with recent related algorithms.

REFERENCES

  1. [1] Gulliver Stephen R. and Ghinea Gheorghita. 2006. Defining user perception of distributed multimedia quality. ACM Transactions on Multimedia Computing Communications and Applications 2, 4 (2006), 241257.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Cheng X., An M., Ruan Y., and Chen Q.. 2013. A novel image definition assessment index for image restoration. Acta Automatica Sinica 39, 4 (2013), 418423.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Zhou F., Yao R., Liu B., and Qiu G.. 2019. Visual quality assessment for super-resolved images: Database and method. IEEE Transactions on Image Processing 28, 7 (2019), 35280–3541.Google ScholarGoogle Scholar
  4. [4] Mahmoudpour Saeed and Schelkens Peter. 2019. A multi-attribute blind quality evaluator for tone-mapped images. IEEE Transactions on Multimedia PP, 99 (2019), 11.Google ScholarGoogle Scholar
  5. [5] Zhu Yi, Guntuku Sharath Chandra, Lin Weisi, Ghinea Gheorghita, and Redi Judith A.. 2018. Measuring individual video QoE: A survey, and proposal for future directions using social media. ACM Transactions on Multimedia Computing, Communications and Applications 14, 2s (2018), 124.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Wang Z., Simoncelli E., and Bovik A.. 2002. Multi-scale structural similarity for image quality assessment. In ASILOMAR Conference on Signals Systems and Computers.Google ScholarGoogle Scholar
  7. [7] Zhang L., Zhang L., Mou X., and Zhang D.. 2011. FSIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing 20, 8 (2011), 23782386. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Liu A., Lin W., and Narwaria M.. 2012. Image quality assessment based on gradient similarity. IEEE Transactions on Image Processing 21, 4 (2012), 15001512. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Sheikh H. R. and Bovik A. C.. 2006. Image information and visual quality. IEEE Transactions on Image Processing 15, 2 (2006), 430444. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] Soundararajan Rajiv and Bovik Alan C.. 2011. RRED indices: Reduced reference entropic differencing framework for image quality assessment. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’11). 11491152. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  11. [11] Gu K., Zhai G., Yang X., and Zhang W.. 2013. A new reduced-reference image quality assessment using structural degradation model. In 2013 IEEE International Symposium on Circuits and Systems (ISCAS’13). 10951098. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] Simone G., Pedersen M., and Hardeberg J. Y.. 2012. Measuring perceptual contrast in digital images. Journal of Visual Communication and Image Representation 23, 3 (2012), 491506.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Zhang L., Zhang L., and Bovik A.. 2015. A feature-enriched completely blind image quality evaluator. IEEE Transactions on Image Processing 24, 8 (2015), 25792591. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. [14] Gu K., Zhai G., Yang X., and Zhang W.. 2015. Using free energy principle for blind image quality assessment. IEEE Transactions on Multimedia 17, 1 (2015), 5063. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Liu Y., Gu K., Li X., and Zhang Y.. 2020. Blind image quality assessment by natural scene statistics and perceptual characteristics. ACM Transactions on Multimedia Computing Communications and Applications 16, 3 (2020), 191.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Wang S., Ma K., Yeganeh H., Wang Z., and Lin W.. 2015. A patch-structure representation method for quality assessment of contrast changed images. IEEE Signal Processing Letters 22, 12 (2015), 23872390. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Gvozden G., Grgic S., and Grgic M.. 2018. Blind image sharpness assessment based on local contrast map statistics. Journal of Visual Communication and Image Representation 30 (2018), 145158.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Cai H., Wang M., Mao W., and Gong M.. 2020. No-reference image sharpness assessment based on discrepancy measures of structural degradation. Journal of Visual Communication and Image Representation 71 (2020), 102861. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Li L., Zhou Y., Wu J., Lin W., and Li H.. 2015. GridSAR: Grid strength and regularity for robust evaluation of blocking artifacts in JPEG images. Journal of Visual Communication and Image Representation 30 (2015), 153163.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] Golestaneh S. Alireza and Chandler Damon M.. 2014. No-reference quality assessment of JPEG images via a quality relevance map. IEEE Signal Processing Letters 21, 2 (2014), 155158.Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Deng C., Wang S., Bovik A., Huang G., and Zhao B.. 2020. Blind noisy image quality assessment using sub-band Kurtosis. IEEE Transactions on Cybernetics 50, 3 (2020), 11461156. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  22. [22] Oszust M.. 2019. No-reference quality assessment of noisy images with local features and visual saliency models. Information Sciences 482 (2019), 334349.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Gu K., Zhai G., Yang X., Zhang W., and Chen C.. 2015. Automatic contrast enhancement technology with saliency preservation. IEEE Transactions on Circuits and Systems for Video Technology 25, 9 (2015), 14801494. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Sun W., Yang W., Zhou F., and Liao Q.. 2018. Full-reference quality assessment of contrast changed images based on local linear model. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’18). 12281232. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. [25] Shokrollahi A., Maybodi M. N., and Mahmoudi-Aznaveh A.. 2020. Histogram modification based enhancement along with contrast-changed image quality assessment. Multimedia Tools and Applications 79, 27 (2020), 1919319214.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Gu K., Zhai G., Lin W., and Liu M.. 2016. The analysis of image contrast: From quality assessment to automatic enhancement. IEEE Transactions on Cybernetics 46, 1 (2016), 284297. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Gu K., Zhai G., Yang X., Zhang W., and Liu M.. 2013. Subjective and objective quality assessment for images with contrast change. In 2013 IEEE International Conference on Image Processing. 383387. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Gu H., Zhai G., Liu M., and Gu K.. 2015. Exploiting global and local information for image quality assessment with contrast change. In 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting. 15. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  29. [29] Liu M., Gu K., Zhai G., Callet P. L., and Zhang W.. 2017. Perceptual reduced-reference visual quality assessment for contrast alteration. IEEE Transactions on Broadcasting 63, 1 (2017), 7181.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Fang Y., Ma K., Wang Z., Lin W., Fang Z., and Zhai G.. 2015. No-reference quality assessment of contrast-distorted images based on natural scene statistics. IEEE Signal Processing Letters 22, 7 (2015), 838842. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Wu Y., Zhu Y., Yang Y., Zhang W., and Yu N.. 2019. A no-reference quality assessment for contrast-distorted image based on improved learning method. Multimedia Tools and Applications 78, 8 (2019), 10057–10076.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Gu K., Lin W., Zhai G., Yang X., Zhang W., and Chen C. W.. 2017. No-reference quality metric of contrast-distorted images based on information maximization. IEEE Transactions on Cybernetics 47, 12 (2017), 45594565. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Gu K., Tao D., Qiao J., and Lin W.. 2018. Learning a no-reference quality assessment model of enhanced images with big data. IEEE Transactions on Neural Networks and Learning Systems 29, 4 (2018), 13011313. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Khosravi M. H. and Hassanpour H.. 2020. Blind quality metric for contrast-distorted images based on eigendecomposition of color histograms. IEEE Transactions on Circuits and Systems for Video Technology 30, 1 (2020), 4858.Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] He L., Gao X., Lu W., Li X., and Tao D.. 2011. Image quality assessment based on S-CIELAB model. Signal Image Video Processing 5, 3 (2011), 283290.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Q. Wu, H. Li, F. Meng, K. N. Ngan, B. Luo, C. Huang, and B. Zeng. 2016. Blind image quality assessment based on multichannel feature fusion and label transfer. IEEE Transactions on Circuits and Systems for Video Technology 26, 3 (2016), 425–440.Google ScholarGoogle Scholar
  37. [37] D. Ghadiyaram and A. C. Bovik. 2015. Scene statistics of authentically distorted images in perceptually relevant color spaces for blind image quality assessment. IEEE International Conference on Image Processing (2015), 3851–3855.Google ScholarGoogle Scholar
  38. [38] Liu L., Hua Y., Zhao Q., Huang H., and Bovik A. C.. 2016. Blind image quality assessment by relative gradient statistics and AdaBoosting neural network. Signal Processing Image Communication 40, C (2016), 115.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. [39] Li Q., Lin W., and Fang Y.. 2016. No-reference quality assessment for multiply-distorted images in gradient domain. IEEE Signal Processing Letters 23, 4 (2016), 541545.Google ScholarGoogle ScholarCross RefCross Ref
  40. [40] Ahissar Ehud, Arieli Amos, Fried Moshe, and Bonneh Yoram. 2016. On the possible roles of microsaccades and drifts in visual perception. Vision Research 118 (2016), 2530.Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Hotelling. H. 1933. Analysis of a complex of statistical variables in principal components. Journal of Educational Psychology 24, 7 (1933), 498520.Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] J. Shlens. 2014. A tutorial on principal component analysis. International Journal of Remote Sensing 51, 2 (2014), 1593–1684.Google ScholarGoogle Scholar
  43. [43] Gomez-Verdejo V., Arenas-Garcia J., and Figueiras-Vidal A. R.. 2008. A dynamically adjusted mixed emphasis method for building boosting ensembles. IEEE Transactions on Neural Networks 19, 1 (2008), 317. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. [44] Larson E. C. and Chandler D. M.. 2010. Most apparent distortion: Full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging 19, 1 (2010), 121.Google ScholarGoogle Scholar
  45. [45] Ponomarenko N., Lukin V., Zelensky A., Egiazarian K., Carli M., and Battisti F.. 2009. TID2008- A database for evaluation of full-reference visual quality assessment metrics. In Advances of Modern Radioelectronics, Vol. 10. 3045.Google ScholarGoogle Scholar
  46. [46] Ponomarenko N., Jin L., Leremeiev O., Lukin V., and Egiazarian K.. 2015. Image database TID2013: Peculiarities, results and perspectives. Signal Processing: Image Communication 30 (2015), 5777.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. [47] Group Video Quality Experts. 2003. Final report from the video quality experts group on the validation of objective models of video quality assessment.Google ScholarGoogle Scholar
  48. [48] Min X., Ma K., Gu K., Zhai G., Wang Z., and Lin W.. 2017. Unified blind quality assessment of compressed natural, graphic, and screen content images. IEEE Transactions on Image Processing 26, 11 (2017), 54625474. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Schölkopf B.. 2003. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press.Google ScholarGoogle Scholar
  50. [50] A. Om, A. Fh, and B. Zas. 2020. AdaBoost neural network and cyclopean view for no-reference stereoscopic image quality assessment. Signal Processing: Image Communication 82, 0923-5965 (2020), 115772.Google ScholarGoogle Scholar
  51. [51] Yan J., Li J., and Fu X.. 2019. No-reference quality assessment of contrast-distorted images using contrast enhancement. arXiv (2019).Google ScholarGoogle Scholar
  52. [52] Zhu Y., Chen X., and Dai S.. 2021. No-reference image quality assessment for contrast distorted images. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12890 LNCS (2021), 241252.Google ScholarGoogle Scholar
  53. [53] Q. Wu, H. Li, F. Meng, and K. Ngan. 2018. A perceptually weighted rank correlation indicator for objective image quality assessment. IEEE Transactions on Image Processing 27, 5 (2018), 2499–2513.Google ScholarGoogle Scholar

Index Terms

  1. No-reference Quality Assessment for Contrast-distorted Images Based on Gray and Color-gray-difference Space

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 19, Issue 2
      March 2023
      540 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/3572860
      • Editor:
      • Abdulmotaleb El Saddik
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 February 2023
      • Online AM: 8 August 2022
      • Accepted: 27 June 2022
      • Revised: 7 May 2022
      • Received: 3 November 2021
      Published in tomm Volume 19, Issue 2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Refereed
    • Article Metrics

      • Downloads (Last 12 months)140
      • Downloads (Last 6 weeks)11

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!