skip to main content
research-article

Detection of Recolored Image by Texture Features in Chrominance Components

Published:25 February 2023Publication History
Skip Abstract Section

Abstract

Image recoloring is an emerging editing technique that can change the color style of an image by modifying pixel values without altering the original image content. With the rapid proliferation of social network and image editing techniques, recolored images (RIs) have raised new security issues in society. Existing detection methods have good performance in detecting RIs for certain categories of recoloring techniques. However, the performance on the handcrafted recoloring scenario is still poor due to the influence of human prior knowledge. To deal with this problem, we explore a solution from the perspective of chrominance texture artifacts to improve the generalization ability. The results of the analysis show that natural images (NIs) and RIs have textural disparities in different color components, especially in the chrominance components (i.e., Cb, Cr, and H). Based on such new prior knowledge of statistical discriminability, we propose a feature set to capture texture features in chrominance components for identifying RIs. Extensive experimental results show that the proposed method can accurately identify RIs with certain categories of recoloring techniques, and outperforms existing methods in the scenario of handcrafted recoloring.

REFERENCES

  1. [1] Verdoliva Luisa. 2020. Media forensics and deepfakes: An overview. IEEE J. Sel. Topics Signal Process. 14, 5 (2020), 910932.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Yu Yang, Ni Rongrong, Li Wenjie, and Zhao Yao. 2022. Detection of AI-manipulated fake faces via mining generalized features. ACM Trans. Multimedia Comput. Commun. Appl. 18, 4 (Mar.2022), Article 94, 23 pages. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Chen Beijing, Tan Weijin, Coatrieux Gouenou, Zheng Yuhui, and Shi Yun-Qing. 2020. A serial image copy-move forgery localization scheme with source/target distinguishment. IEEE Trans. Multimedia 23 (2020), 35063517.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Wu Haiwei, Zhou Jiantao, and Li Yuanman. 2021. Deep generative model for image inpainting with local binary pattern learning and spatial attention. IEEE Trans. Multimedia 24 (2021), 4016–4027.Google ScholarGoogle Scholar
  5. [5] Sun Hongyi, Li Wanhua, Duan Yueqi, Zhou Jie, and Lu Jiwen. 2022. Learning adaptive patch generators for mask-robust image inpainting. IEEE Trans. Multimedia (2022).Google ScholarGoogle Scholar
  6. [6] Swaminathan Ashwin, Wu Min, and Liu K. J. Ray. 2008. Digital image forensics via intrinsic fingerprints. IEEE Trans. Inf. Forensics Secur. 3, 1 (2008), 101117.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. [7] Wen Longyin, Qi Honggang, and Lyu Siwei. 2018. Contrast enhancement estimation for digital image forensics. ACM Trans. Multimedia Comput. Commun. Appl. 14, 2 (May2018), Article 49, 21 pages. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Ren Ruyong, Niu Shaozhang, Ren Hua, Zhang Shubin, Han Tengyue, and Tong Xiaohai. 2022. ESRNet: Efficient search and recognition network for image manipulation detection. ACM Trans. Multimedia Comput. Commun. Appl. 18, 4 (Mar.2022), Article 111, 23 pages. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Yerushalmy Ido and Hel-Or Hagit. 2011. Digital image forgery detection based on lens and sensor aberration. Int. J. Comput. Vision 92, 1 (2011), 7191.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] Fan Zhigang and Queiroz Ricardo L. De. 2003. Identification of bitmap compression history: JPEG detection and quantizer estimation. IEEE Trans. Image Process. 12, 2 (2003), 230235.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Luo Weiqi, Qu Zhenhua, Huang Jiwu, and Qiu Guoping. 2007. A novel method for detecting cropped and recompressed image block. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 2. II–217.Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] Yan Yanyang, Ren Wenqi, and Cao Xiaochun. 2018. Recolored image detection via a deep discriminative model. IEEE Trans. Inf. Forensics Secur. 14, 1 (2018), 517.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Reinhard Erik, Adhikhmin Michael, Gooch Bruce, and Shirley Peter. 2001. Color transfer between images. IEEE Comput. Graph. Appl. 21, 5 (2001), 3441.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. [14] Pitie Francois, Kokaram Anil C., and Dahyot Rozenn. 2005. N-dimensional probability density function transfer and its application to color transfer. In 10th IEEE International Conference on Computer Vision (ICCV’05), Vol. 2. 14341439.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] He Mingming, Liao Jing, Chen Dongdong, Yuan Lu, and Sander Pedro V.. 2019. Progressive color transfer with dense semantic correspondences. ACM Trans. Graph. (TOG) 38, 2 (2019), 118.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Lee Junyong, Son Hyeongseok, Lee Gunhee, Lee Jonghyeop, Cho Sunghyun, and Lee Seungyong. 2020. Deep color transfer using histogram analogy. The Visual Comput. 36, 10 (2020), 21292143.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. [17] Tai Yu-Wing, Jia Jiaya, and Tang Chi-Keung. 2005. Local color transfer via probabilistic segmentation by expectation-maximization. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), Vol. 1. 747754.Google ScholarGoogle Scholar
  18. [18] Levin Anat, Lischinski Dani, and Weiss Yair. 2004. Colorization using optimization. ACM Trans. Graph. (TOG) 23, 3 (2004), 689694.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Qu Yingge, Wong Tien-Tsin, and Heng Pheng-Ann. 2006. Manga colorization. ACM Trans. Graph. (TOG) 25, 3 (2006), 12141220.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] An Xiaobo and Pellacini Fabio. 2008. AppProp: All-pairs appearance-space edit propagation. ACM Trans. Graph. (TOG) 27, 3 (2008), 19.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Xu Kun, Li Yong, Ju Tao, Hu Shi-Min, and Liu Tian-Qiang. 2009. Efficient affinity-based edit propagation using kd tree. ACM Trans. Graph. (TOG) 28, 5 (2009), 16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. [22] Chen Xiaowu, Zou Dongqing, Li Jianwei, Cao Xiaochun, Zhao Qinping, and Zhang Hao. 2014. Sparse dictionary learning for edit propagation of high-resolution images. In Proceedings of the IEEE Conference on Computer Vision Pattern Recognition. (CVPR’14). 28542861.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Endo Yuki, Iizuka Satoshi, Kanamori Yoshihiro, and Mitani Jun. 2016. DeepProp: Extracting deep features from a single image for edit propagation. In Comput. Graph. Forum. 189201.Google ScholarGoogle Scholar
  24. [24] Zhang Richard, Zhu Jun-Yan, Isola Phillip, Geng Xinyang, Lin Angela S., Yu Tianhe, and Efros Alexei A.. 2017. Real-time user-guided image colorization with learned deep priors. arXiv:1705.02999. https://arxiv.org/abs/1705.02999.Google ScholarGoogle Scholar
  25. [25] O’Donovan Peter, Agarwala Aseem, and Hertzmann Aaron. 2011. Color compatibility from large datasets. ACM Trans. Graph. (TOG) 30, 4 (2011), 112.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Lin Sharon, Ritchie Daniel, Fisher Matthew, and Hanrahan Pat. 2013. Probabilistic color-by-numbers: Suggesting pattern colorizations using factor graphs. ACM Trans. Graph. (TOG) 32, 4 (2013), 112.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Chang Huiwen, Fried Ohad, Liu Yiming, DiVerdi Stephen, and Finkelstein Adam. 2015. Palette-based photo recoloring. ACM Trans. Graph. (TOG) 34, 4 (2015), 139–1.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Cho Junho, Yun Sangdoo, Lee Kyoung Mu, and Choi Jin Young. 2017. Palettenet: Image recolorization with given color palette. In Proceedings of the IEEE Conference on Computer Vision Pattern Recognition (CVPR’17) Workshops. 6270.Google ScholarGoogle ScholarCross RefCross Ref
  29. [29] Afifi Mahmoud, Price Brian L., Cohen Scott, and Brown Michael S.. 2019. Image recoloring based on object color distributions. In Eurographics (Short Papers). 3336.Google ScholarGoogle Scholar
  30. [30] Luan Fujun, Paris Sylvain, Shechtman Eli, and Bala Kavita. 2017. Deep photo style transfer. In Proceedings of the IEEE Conference on Computer Vision Pattern Recognition (CVPR’17). 49904998.Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Li Yijun, Liu Ming-Yu, Li Xueting, Yang Ming-Hsuan, and Kautz Jan. 2018. A closed-form solution to photorealistic image stylization. In Proceedings of the European Conference on Computer Vision (ECCV’18). 453468.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Yoo Jaejun, Uh Youngjung, Chun Sanghyuk, Kang Byeongkyu, and Ha Jung-Woo. 2019. Photorealistic style transfer via wavelet transforms. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV’19). 90369045.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Gatys Leon A., Ecker Alexander S., and Bethge Matthias. 2016. Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16).Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Li Yijun, Fang Chen, Yang Jimei, Wang Zhaowen, Lu Xin, and Yang Ming-Hsuan. 2017. Universal style transfer via feature transforms. arXiv:1705.08086. https://arxiv.org/abs/1705.08086.Google ScholarGoogle Scholar
  35. [35] Weijer Joost Van De, Gevers Theo, and Gijsenij Arjan. 2007. Edge-based color constancy. IEEE Trans. Image Process. 16, 9 (2007), 22072214.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. [36] Carvalho Tiago, Faria Fabio A., Pedrini Helio, Torres Ricardo da S., and Rocha Anderson. 2015. Illuminant-based transformed spaces for image forensics. IEEE Trans. Inf. Forensics Secur. 11, 4 (2015), 720733.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Ho John S., Au Oscar C., Zhou Jiantao, and Guo Yuanfang. 2010. Inter-channel demosaicking traces for digital image forensics. In Proceedings of the IEEE International Conference on Multimedia and Expo. 14751480.Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Simonyan Karen and Zisserman Andrew. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. https://arxiv.org/abs/1409.1556.Google ScholarGoogle Scholar
  39. [39] Welsh Tomihisa, Ashikhmin Michael, and Mueller Klaus. 2002. Transferring color to greyscale images. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques. 277280.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Ironi Revital, Cohen-Or Daniel, and Lischinski Dani. 2005. Colorization by example. InProceedings of the 16th Eurographics Conference on Rendering Techniques (EGSR’05). 201210.Google ScholarGoogle Scholar
  41. [41] Gupta Raj Kumar, Chia Alex Yong-Sang, Rajan Deepu, Ng Ee Sin, and Zhiyong Huang. 2012. Image colorization using similar images. In Proceedings of the 20th ACM International Conference on Multimedia. 369378.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. [42] Cheng Zezhou, Yang Qingxiong, and Sheng Bin. 2015. Deep colorization. In Proceedings of the IEEE International Conference on Computer Vision. 415423.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. [43] Larsson Gustav, Maire Michael, and Shakhnarovich Gregory. 2016. Learning representations for automatic colorization. In European Conference on Computer Vision. Springer, 577593.Google ScholarGoogle ScholarCross RefCross Ref
  44. [44] Iizuka Satoshi, Simo-Serra Edgar, and Ishikawa Hiroshi. 2016. Let there be color! Joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans. Graphics (ToG) 35, 4 (2016), 111.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. [45] Guo Yuanfang, Cao Xiaochun, Zhang Wei, and Wang Rui. 2018. Fake colorized image detection. IEEE Trans. Inf. Forensics Secur. 13, 8 (2018), 19321944.Google ScholarGoogle ScholarCross RefCross Ref
  46. [46] Zhuo Long, Tan Shunquan, Zeng Jishen, and Lit Bin. 2018. Fake colorized image detection with channel-wise convolution based deep-learning framework. In Proceedings of the 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC’18). IEEE, 733736.Google ScholarGoogle ScholarCross RefCross Ref
  47. [47] Quan Weize, Yan Dong-Ming, Wang Kai, Zhang Xiaopeng, and Pellerin Denis. 2019. Detecting colorized images via convolutional neural networks: Toward high accuracy and good generalization. arXiv:1902.06222. https://arxiv.org/abs/1902.06222.Google ScholarGoogle Scholar
  48. [48] Yu Yangxin, Zheng Ning, Qiao Tong, Xu Ming, and Wu Jiasheng. 2021. Distinguishing between natural and recolored images via lateral chromatic aberration. J. Vis. Commun. Image Rep. 80 (2021), 103295.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Ojala Timo, Pietikainen Matti, and Maenpaa Topi. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24, 7 (2002), 971987.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. [50] Zhang Jianguo, Marszałek Marcin, Lazebnik Svetlana, and Schmid Cordelia. 2007. Local features and kernels for classification of texture and object categories: A comprehensive study. Int. J. Comput. Vis. 73, 2 (2007), 213238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. [51] Chang Chih-Chung and Lin Chih-Jen. 2011. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 3 (2011), 127.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. [52] Pitié François, Kokaram Anil C., and Dahyot Rozenn. 2007. Automated colour grading using colour distribution transfer. Comput. Vis. Image Understand. 107, 1–2 (2007), 123137.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. [53] Russakovsky Olga, Deng Jia, Su Hao, Krause Jonathan, Satheesh Sanjeev, Ma Sean, Huang Zhiheng, Karpathy Andrej, Khosla Aditya, Bernstein Michael, et al. 2015. Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115, 3 (2015), 211252.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. [54] Lin Tsung-Yi, Maire Michael, Belongie Serge, Hays James, Perona Pietro, Ramanan Deva, Dollár Piotr, and Zitnick C. Lawrence. 2014. Microsoft COCO: Common objects in context. In Proceedings of the Eurpean Conference on Computer Vision (ECCV’14). 740755.Google ScholarGoogle ScholarCross RefCross Ref
  55. [55] Li Haodong, Li Bin, Tan Shunquan, and Huang Jiwu. 2020. Identification of deep network generated images using disparities in color components. Signal Process. 174 (2020), 107616.Google ScholarGoogle ScholarCross RefCross Ref
  56. [56] Cozzolino Davide and Verdoliva Luisa. 2019. Noiseprint: A CNN-based camera model fingerprint. IEEE Trans. Inf. Forensics Secur. 15 (2019), 144159.Google ScholarGoogle ScholarCross RefCross Ref
  57. [57] Goljan Miroslav, Fridrich Jessica, and Cogranne Rémi. 2014. Rich model for steganalysis of color images. In IEEE International Workshop on Information Forensics and Security (WIFS’14). 185190.Google ScholarGoogle Scholar
  58. [58] Beigpour Shida and Weijer Joost Van De. 2012. Object recoloring based on intrinsic image estimation. In International Conference on Computer Vision (ICCV’12). 327334.Google ScholarGoogle Scholar
  59. [59] Pitié François and Kokaram Anil. 2007. The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer. In Proceedings of IET CVMP. 19.Google ScholarGoogle ScholarCross RefCross Ref
  60. [60] Grogan Mairéad, Prasad Mukta, and Dahyot Rozenn. 2015. L2 registration for colour transfer. In Proceedings of the European Signal Processing Conference. 15.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Detection of Recolored Image by Texture Features in Chrominance Components

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Multimedia Computing, Communications, and Applications
        ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 19, Issue 3
        May 2023
        514 pages
        ISSN:1551-6857
        EISSN:1551-6865
        DOI:10.1145/3582886
        • Editor:
        • Abdulmotaleb El Saddik
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 February 2023
        • Online AM: 9 November 2022
        • Accepted: 6 November 2022
        • Revised: 21 October 2022
        • Received: 15 July 2022
        Published in tomm Volume 19, Issue 3

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
      • Article Metrics

        • Downloads (Last 12 months)218
        • Downloads (Last 6 weeks)20

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!