skip to main content
research-article

360-Degree VR Video Watermarking Based on Spherical Wavelet Transform

Authors Info & Claims
Published:16 April 2021Publication History
Skip Abstract Section

Abstract

Similar to conventional video, the increasingly popular 360\(\) virtual reality (VR) video requires copyright protection mechanisms. The classic approach for copyright protection is the introduction of a digital watermark into the video sequence. Due to the nature of spherical panorama, traditional watermarking schemes that are dedicated to planar media cannot work efficiently for 360\(\) VR video. In this article, we propose a spherical wavelet watermarking scheme to accommodate 360\(\) VR video. With our scheme, the watermark is first embedded into the spherical wavelet transform domain of the 360\(\) VR video. The spherical geometry of the 360\(\) VR video is used as the host space for the watermark so that the proposed watermarking scheme is compatible with the multiple projection formats of 360\(\) VR video. Second, the just noticeable difference model, suitable for head-mounted displays (HMDs), is used to control the imperceptibility of the watermark on the viewport. Third, besides detecting the watermark from the spherical projection, the proposed watermarking scheme also supports detecting watermarks robustly from the viewport projection. The watermark in the spherical domain can protect not only the 360\(\) VR video but also its corresponding viewports. The experimental results show that the embedded watermarks are reliably extracted both from the spherical and the viewport projections of the 360\(\) VR video, and the robustness of the proposed scheme to various copyright attacks is significantly better than that of the competing planar-domain approaches when detecting the watermark from viewport projection.

References

  1. MPEG Experts. 2016. Summary of survey on virtual reality. ISO/IECJTC 1/SC 29/WG 11, m16542.Google ScholarGoogle Scholar
  2. Huawei-iLab. 2018. Cloud VR Network Solution White Paper. Retrieved from http://www.huawei.com/.Google ScholarGoogle Scholar
  3. L. E. Beausoleil. 2017. Copyright Issues and Implications of Emerging Virtual Reality Technologies. Boston College Intellectual Property and Technology Forum. Retrieved from http:// http://bciptf.org/.Google ScholarGoogle Scholar
  4. N. P. Sheppard, R. Safavi-Naini, and P. Ogunbona. 2002. Digital watermarks for copyright protection. Journal of Law and Information Science 12, 1 (2002), 110–130.Google ScholarGoogle Scholar
  5. I. J. Cox, M. L. Miller, J. A. Bloom, J. Fridrich, and T. Kalker. 2008. Digital Watermarking and Steganography. Morgan Kaufmann Publisher.Google ScholarGoogle Scholar
  6. K. Liu, Y. Liu, J. Liu, A. Argyriou, and X. Yang. 2017. Joint source encoding and networking optimization for panoramic streaming over LTE-A downlink. In Proc. IEEE Global Communications Conference (GLOBECOM'17). 1--7.Google ScholarGoogle Scholar
  7. Y. Liu, J. Liu, A. Argyriou, and S. Ci. 2019. MEC-assisted panoramic VR video streaming over millimeter wave mobile networks. IEEE Transactions on Multimedia 21, 5 (2019), 1302–1316.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Y. He, B. Vishwanath, X. Xiu, and Y. Ye. 2016. AHG8: InterDigitals projection format conversion tool. Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET, D0021.Google ScholarGoogle Scholar
  9. P. Schröder and W. Sweldens. 1995. Spherical wavelets: Efficiently representing functions on the sphere. In Proc. SIGGRAPH. 161-172.Google ScholarGoogle Scholar
  10. F. Simons, I. Loris, G. Nolet, I. C. Daubechies, S. Voronin, et al. 2011. Solving or resolving global tomographic models with spherical wavelets, and the scale and sparsity of seismic heterogeneity. Geophysical Journal International 187 (2011), 969–988.Google ScholarGoogle ScholarCross RefCross Ref
  11. Z. Wang, C. Leung, Y. Zhu, and T. Wong. 2004. Data compression with spherical wavelets and wavelets for the image-based relighting. Computer Vision and Image Understanding 96, 3 (2004), 327–344.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. D. McEwen, P. Vandergheynst, and Y. Wiaux. 2013. On the computation of directional scale-discretized wavelet transforms on the sphere. In Proc. SPIE Wavelets and Sparsity XV. 8858.Google ScholarGoogle Scholar
  13. P. W. Wong and N. Memon. 2001. Secret and public key image watermarking schemes for image authentication and ownership verification. IEEE Transactions on Image Processing 10, 10 (2001), 1593–1601.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. J. S. Tsai, W. B. Huang, and Y. H. Kuo. 2011. On the selection of optimal feature region set for robust digital image watermarking. IEEE Transactions on Image Processing 20, 3 (2011), 735–743.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. I. J. Cox, J. Kilian, F. T. Leighton, and T. Shamoon. 1997. Secure spread spectrum watermarking for multimedia. IEEE Transactions on Image Processing 6, 12 (1997), 1673–1687.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Amini, M. Ahmad, and M. Swamy. 2018. A robust multibit multiplicative watermark decoder using vector-based hidden Markov model in wavelet domain. IEEE Transactions on Circuits and Systems for Video Technology 28, 2 (2018), 402–413.Google ScholarGoogle ScholarCross RefCross Ref
  17. Y.-S. Lee, Y.-H. Seo, and D.-W. Kim. 2019. Blind image watermarking based on adaptive data spreading in n-level DWT subbands. Security and Communication Networks 2019, Article 8357251 (2019), 1–11.Google ScholarGoogle Scholar
  18. D. Xu, R. Wang, and Y. Q. Shi. 2014. Data hiding in encrypted H.264/AVC video streams by codeword substitution. IEEE Transactions on Information Forensics and Security 9, 4 (2014), 596–606.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. T. Dutta and H. P. Gupta. 2016. A robust watermarking framework for high efficiency video coding (HEVC) encoded video with blind extraction process. Journal of Visual Communication and Image Representation 38 (2016), 29–44.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. G. Hua, J. Goh, and V. L. L. Thing. 2015. Time-spread echo-based audio watermarking with optimized imperceptibility and robustness. IEEE/ACM Transactions on Audio, Speech, and Language Processing 23, 2 (2015), 227–239.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. C. H. Chou and K. C. Liu. 2010. A perceptually tuned watermarking scheme for color images. IEEE Transactions on Image Processing 19, 11 (2010), 2966–2982.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. M. Urvoy, D. Goudia, and F. Autrusseau. 2014. Perceptual DFT watermarking with improved detection and robustness to geometrical distortions. IEEE Transactions on Information Forensics and Security 9, 7 (2014), 1108–1119.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. E. Halici and A. A. Alatan. 2009. Watermarking for depth-image-based rendering. In Proc. IEEE Int. Conf. Image Process. (ICIP'09). 4217–4220.Google ScholarGoogle Scholar
  24. Y. Lin and J. Wu. 2011. A digital blind watermarking for depth-image-based rendering 3D images. IEEE Transactions on Broadcasting 57, 2 (2011), 602–611.Google ScholarGoogle ScholarCross RefCross Ref
  25. H. D. Kim, J. W. Lee, T. W. Oh, and H. K. Lee. 2012. Robust DT-CWT watermarking for DIBR 3D images. IEEE Transactions on Broadcasting 58, 4 (2012), 533–543.Google ScholarGoogle ScholarCross RefCross Ref
  26. A. Koz, C. Cigla, and A. A. Alatan. 2010. Watermarking of free-view video. IEEE Transactions on Image Processing 19, 7 (2010), 1785–1797.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Y. Miura, X. Li, S. Kang, and Y. Sakamoto. 2018. Data hiding technique for omnidirectional JPEG images displayed on VR spaces. In Proc. International Workshop on Advanced Image Technology. 1–4.Google ScholarGoogle Scholar
  28. J. Kang, S. Ji, and H. Lee. 2019. Spherical panorama image watermarking using viewpoint detection. In Proc. Digital Forensics and Watermarking. Cham: Springer International Publishing, 95–109.Google ScholarGoogle Scholar
  29. J. D. McEwen, M. P. Hobson, D. J. Mortlock, and A. N. Lasenby. 2007. Fast directional continuous spherical wavelet transform algorithms. IEEE Transactions on Signal Processing 55, 2 (2007), 520–529.Google ScholarGoogle ScholarCross RefCross Ref
  30. E. Eade. 2017. Lie groups for 2D and 3D transformations. Retrieved from http://www.ethaneade.com/lie.pdf.Google ScholarGoogle Scholar
  31. J. D. McEwen, C. Durastanti, and Y. Wiaux. 2018. Localisation of directional scale-discretised wavelets on the sphere. Applied and Computational Harmonic Analysis 44 (2018), 59–88.Google ScholarGoogle ScholarCross RefCross Ref
  32. S. Mallat. 1996. Wavelets for vision. Proceedings of the IEEE 84 (1996), 604–614.Google ScholarGoogle ScholarCross RefCross Ref
  33. A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor. 1997. Visibility of wavelet quantization noise. IEEE Transactions on Image Processing 6, 8 (1997), 1164–1175.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. A. P. Bradley. 1999. A wavelet visible difference predictor. IEEE Transactions on Image Processing 5, 8 (1999), 717–730.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. L. Sorgi and K. Daniilidis. 2004. Normalized cross-correlation for spherical images. In Proc. European Conference on Computer Vision (ECCV ’04).Google ScholarGoogle Scholar
  36. M. L. Miller and J. A. Bloom. 1999. Computing the probability of false watermark detection. In Proc. 3rd Int. Workshop Inf. Hiding, 146–158.Google ScholarGoogle Scholar
  37. J. Cruz-Mota, I. Bogdanova, B. Paquier, M. Bierlaire, and J.-P. Thiran. 2012. Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision 98 (2012), 217–241.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. E. Alshina, J. Boyce, A. Abbas, and Y. Ye. 2017. JVET common test conditions and evaluation procedures for 360\(\) video. JVET, H1030.Google ScholarGoogle Scholar
  39. A. Singla, W. Robitza, and A. Raake. 2018. Comparison of subjective quality evaluation methods for omnidirectional videos with DSIS and modified ACR. In Proc. Human Vision and Electronic Imaging (HVEI’18).Google ScholarGoogle Scholar
  40. ITU-R Recommendation BT.500-13. 2012. Methodology for the subjective assessment of the quality of television pictures. Geneva, Switzerland: International Telecommunication Union.Google ScholarGoogle Scholar
  41. High Efficiency Video Coding (HEVC). Jan. 2013. Rec. ITU-T H.265 and ISO/IEC 23008-2.Google ScholarGoogle Scholar
  42. C. Burini, S. Baudry, and G. Doërr. 2014. Blind detection for disparity-coherent stereo video watermarking. In Proc. SPIE 9028, Media Watermarking, Security, and Forensics. 90280B.Google ScholarGoogle Scholar
  43. E. Garcia and J. Dugelay. 2003. Texture-based watermarking of 3D video objects. IEEE Transactions on Circuits and Systems for Video Technology 13 (2003), 853–866.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. S. Baldoni, M. Brizzi, M. Carli, and A. Neri. 2019. A watermarking model for omni-directional digital images. In 11th International Symposium on Image and Signal Processing and Analysis (ISPA’19). 240–245.Google ScholarGoogle Scholar
  45. J. Jin, M. Dai, H. Bao, and Q. Peng. 2004. Watermarking on 3D mesh based on spherical wavelet transform. Journal of Zhejiang University-SCIENCE A 5, 3 (2004), 251–258.Google ScholarGoogle ScholarCross RefCross Ref
  46. S. Voloshynovskiy, S. Pereira, A. Herrigel, N. Baumgartner, and T. Pun. 2000. Generalized watermarking attack based on watermark estimation and perceptual remodulation. In Proc. SPIE, vol. 3971. The International Society for Optical Engineering, 358–370.Google ScholarGoogle Scholar
  47. G. Doërr and J. Dugelay. 2004. Security pitfalls of frame-by-frame approaches to video watermarking. IEEE Transactions on Signal Processing 52, 10 (2004), 2955–2964.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. J. Kang, J. Hou, S. Ji, and H. Lee. 2020. Robust spherical panorama image watermarking against viewpoint desynchronization. IEEE Access 8 (2020), 127477–127490.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. 360-Degree VR Video Watermarking Based on Spherical Wavelet Transform

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 17, Issue 1
      February 2021
      392 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/3453992
      Issue’s Table of Contents

      Copyright © 2021 Association for Computing Machinery.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 16 April 2021
      • Accepted: 1 September 2020
      • Revised: 1 August 2020
      • Received: 1 March 2020
      Published in tomm Volume 17, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!