Abstract
Similar to conventional video, the increasingly popular 360\(\) virtual reality (VR) video requires copyright protection mechanisms. The classic approach for copyright protection is the introduction of a digital watermark into the video sequence. Due to the nature of spherical panorama, traditional watermarking schemes that are dedicated to planar media cannot work efficiently for 360\(\) VR video. In this article, we propose a spherical wavelet watermarking scheme to accommodate 360\(\) VR video. With our scheme, the watermark is first embedded into the spherical wavelet transform domain of the 360\(\) VR video. The spherical geometry of the 360\(\) VR video is used as the host space for the watermark so that the proposed watermarking scheme is compatible with the multiple projection formats of 360\(\) VR video. Second, the just noticeable difference model, suitable for head-mounted displays (HMDs), is used to control the imperceptibility of the watermark on the viewport. Third, besides detecting the watermark from the spherical projection, the proposed watermarking scheme also supports detecting watermarks robustly from the viewport projection. The watermark in the spherical domain can protect not only the 360\(\) VR video but also its corresponding viewports. The experimental results show that the embedded watermarks are reliably extracted both from the spherical and the viewport projections of the 360\(\) VR video, and the robustness of the proposed scheme to various copyright attacks is significantly better than that of the competing planar-domain approaches when detecting the watermark from viewport projection.
- MPEG Experts. 2016. Summary of survey on virtual reality. ISO/IECJTC 1/SC 29/WG 11, m16542.Google Scholar
- Huawei-iLab. 2018. Cloud VR Network Solution White Paper. Retrieved from http://www.huawei.com/.Google Scholar
- L. E. Beausoleil. 2017. Copyright Issues and Implications of Emerging Virtual Reality Technologies. Boston College Intellectual Property and Technology Forum. Retrieved from http:// http://bciptf.org/.Google Scholar
- N. P. Sheppard, R. Safavi-Naini, and P. Ogunbona. 2002. Digital watermarks for copyright protection. Journal of Law and Information Science 12, 1 (2002), 110–130.Google Scholar
- I. J. Cox, M. L. Miller, J. A. Bloom, J. Fridrich, and T. Kalker. 2008. Digital Watermarking and Steganography. Morgan Kaufmann Publisher.Google Scholar
- K. Liu, Y. Liu, J. Liu, A. Argyriou, and X. Yang. 2017. Joint source encoding and networking optimization for panoramic streaming over LTE-A downlink. In Proc. IEEE Global Communications Conference (GLOBECOM'17). 1--7.Google Scholar
- Y. Liu, J. Liu, A. Argyriou, and S. Ci. 2019. MEC-assisted panoramic VR video streaming over millimeter wave mobile networks. IEEE Transactions on Multimedia 21, 5 (2019), 1302–1316.Google Scholar
Digital Library
- Y. He, B. Vishwanath, X. Xiu, and Y. Ye. 2016. AHG8: InterDigitals projection format conversion tool. Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET, D0021.Google Scholar
- P. Schröder and W. Sweldens. 1995. Spherical wavelets: Efficiently representing functions on the sphere. In Proc. SIGGRAPH. 161-172.Google Scholar
- F. Simons, I. Loris, G. Nolet, I. C. Daubechies, S. Voronin, et al. 2011. Solving or resolving global tomographic models with spherical wavelets, and the scale and sparsity of seismic heterogeneity. Geophysical Journal International 187 (2011), 969–988.Google Scholar
Cross Ref
- Z. Wang, C. Leung, Y. Zhu, and T. Wong. 2004. Data compression with spherical wavelets and wavelets for the image-based relighting. Computer Vision and Image Understanding 96, 3 (2004), 327–344.Google Scholar
Digital Library
- J. D. McEwen, P. Vandergheynst, and Y. Wiaux. 2013. On the computation of directional scale-discretized wavelet transforms on the sphere. In Proc. SPIE Wavelets and Sparsity XV. 8858.Google Scholar
- P. W. Wong and N. Memon. 2001. Secret and public key image watermarking schemes for image authentication and ownership verification. IEEE Transactions on Image Processing 10, 10 (2001), 1593–1601.Google Scholar
Digital Library
- J. S. Tsai, W. B. Huang, and Y. H. Kuo. 2011. On the selection of optimal feature region set for robust digital image watermarking. IEEE Transactions on Image Processing 20, 3 (2011), 735–743.Google Scholar
Digital Library
- I. J. Cox, J. Kilian, F. T. Leighton, and T. Shamoon. 1997. Secure spread spectrum watermarking for multimedia. IEEE Transactions on Image Processing 6, 12 (1997), 1673–1687.Google Scholar
Digital Library
- M. Amini, M. Ahmad, and M. Swamy. 2018. A robust multibit multiplicative watermark decoder using vector-based hidden Markov model in wavelet domain. IEEE Transactions on Circuits and Systems for Video Technology 28, 2 (2018), 402–413.Google Scholar
Cross Ref
- Y.-S. Lee, Y.-H. Seo, and D.-W. Kim. 2019. Blind image watermarking based on adaptive data spreading in n-level DWT subbands. Security and Communication Networks 2019, Article 8357251 (2019), 1–11.Google Scholar
- D. Xu, R. Wang, and Y. Q. Shi. 2014. Data hiding in encrypted H.264/AVC video streams by codeword substitution. IEEE Transactions on Information Forensics and Security 9, 4 (2014), 596–606.Google Scholar
Digital Library
- T. Dutta and H. P. Gupta. 2016. A robust watermarking framework for high efficiency video coding (HEVC) encoded video with blind extraction process. Journal of Visual Communication and Image Representation 38 (2016), 29–44.Google Scholar
Digital Library
- G. Hua, J. Goh, and V. L. L. Thing. 2015. Time-spread echo-based audio watermarking with optimized imperceptibility and robustness. IEEE/ACM Transactions on Audio, Speech, and Language Processing 23, 2 (2015), 227–239.Google Scholar
Digital Library
- C. H. Chou and K. C. Liu. 2010. A perceptually tuned watermarking scheme for color images. IEEE Transactions on Image Processing 19, 11 (2010), 2966–2982.Google Scholar
Digital Library
- M. Urvoy, D. Goudia, and F. Autrusseau. 2014. Perceptual DFT watermarking with improved detection and robustness to geometrical distortions. IEEE Transactions on Information Forensics and Security 9, 7 (2014), 1108–1119.Google Scholar
Digital Library
- E. Halici and A. A. Alatan. 2009. Watermarking for depth-image-based rendering. In Proc. IEEE Int. Conf. Image Process. (ICIP'09). 4217–4220.Google Scholar
- Y. Lin and J. Wu. 2011. A digital blind watermarking for depth-image-based rendering 3D images. IEEE Transactions on Broadcasting 57, 2 (2011), 602–611.Google Scholar
Cross Ref
- H. D. Kim, J. W. Lee, T. W. Oh, and H. K. Lee. 2012. Robust DT-CWT watermarking for DIBR 3D images. IEEE Transactions on Broadcasting 58, 4 (2012), 533–543.Google Scholar
Cross Ref
- A. Koz, C. Cigla, and A. A. Alatan. 2010. Watermarking of free-view video. IEEE Transactions on Image Processing 19, 7 (2010), 1785–1797.Google Scholar
Digital Library
- Y. Miura, X. Li, S. Kang, and Y. Sakamoto. 2018. Data hiding technique for omnidirectional JPEG images displayed on VR spaces. In Proc. International Workshop on Advanced Image Technology. 1–4.Google Scholar
- J. Kang, S. Ji, and H. Lee. 2019. Spherical panorama image watermarking using viewpoint detection. In Proc. Digital Forensics and Watermarking. Cham: Springer International Publishing, 95–109.Google Scholar
- J. D. McEwen, M. P. Hobson, D. J. Mortlock, and A. N. Lasenby. 2007. Fast directional continuous spherical wavelet transform algorithms. IEEE Transactions on Signal Processing 55, 2 (2007), 520–529.Google Scholar
Cross Ref
- E. Eade. 2017. Lie groups for 2D and 3D transformations. Retrieved from http://www.ethaneade.com/lie.pdf.Google Scholar
- J. D. McEwen, C. Durastanti, and Y. Wiaux. 2018. Localisation of directional scale-discretised wavelets on the sphere. Applied and Computational Harmonic Analysis 44 (2018), 59–88.Google Scholar
Cross Ref
- S. Mallat. 1996. Wavelets for vision. Proceedings of the IEEE 84 (1996), 604–614.Google Scholar
Cross Ref
- A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor. 1997. Visibility of wavelet quantization noise. IEEE Transactions on Image Processing 6, 8 (1997), 1164–1175.Google Scholar
Digital Library
- A. P. Bradley. 1999. A wavelet visible difference predictor. IEEE Transactions on Image Processing 5, 8 (1999), 717–730.Google Scholar
Digital Library
- L. Sorgi and K. Daniilidis. 2004. Normalized cross-correlation for spherical images. In Proc. European Conference on Computer Vision (ECCV ’04).Google Scholar
- M. L. Miller and J. A. Bloom. 1999. Computing the probability of false watermark detection. In Proc. 3rd Int. Workshop Inf. Hiding, 146–158.Google Scholar
- J. Cruz-Mota, I. Bogdanova, B. Paquier, M. Bierlaire, and J.-P. Thiran. 2012. Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision 98 (2012), 217–241.Google Scholar
Digital Library
- E. Alshina, J. Boyce, A. Abbas, and Y. Ye. 2017. JVET common test conditions and evaluation procedures for 360\(\) video. JVET, H1030.Google Scholar
- A. Singla, W. Robitza, and A. Raake. 2018. Comparison of subjective quality evaluation methods for omnidirectional videos with DSIS and modified ACR. In Proc. Human Vision and Electronic Imaging (HVEI’18).Google Scholar
- ITU-R Recommendation BT.500-13. 2012. Methodology for the subjective assessment of the quality of television pictures. Geneva, Switzerland: International Telecommunication Union.Google Scholar
- High Efficiency Video Coding (HEVC). Jan. 2013. Rec. ITU-T H.265 and ISO/IEC 23008-2.Google Scholar
- C. Burini, S. Baudry, and G. Doërr. 2014. Blind detection for disparity-coherent stereo video watermarking. In Proc. SPIE 9028, Media Watermarking, Security, and Forensics. 90280B.Google Scholar
- E. Garcia and J. Dugelay. 2003. Texture-based watermarking of 3D video objects. IEEE Transactions on Circuits and Systems for Video Technology 13 (2003), 853–866.Google Scholar
Digital Library
- S. Baldoni, M. Brizzi, M. Carli, and A. Neri. 2019. A watermarking model for omni-directional digital images. In 11th International Symposium on Image and Signal Processing and Analysis (ISPA’19). 240–245.Google Scholar
- J. Jin, M. Dai, H. Bao, and Q. Peng. 2004. Watermarking on 3D mesh based on spherical wavelet transform. Journal of Zhejiang University-SCIENCE A 5, 3 (2004), 251–258.Google Scholar
Cross Ref
- S. Voloshynovskiy, S. Pereira, A. Herrigel, N. Baumgartner, and T. Pun. 2000. Generalized watermarking attack based on watermark estimation and perceptual remodulation. In Proc. SPIE, vol. 3971. The International Society for Optical Engineering, 358–370.Google Scholar
- G. Doërr and J. Dugelay. 2004. Security pitfalls of frame-by-frame approaches to video watermarking. IEEE Transactions on Signal Processing 52, 10 (2004), 2955–2964.Google Scholar
Digital Library
- J. Kang, J. Hou, S. Ji, and H. Lee. 2020. Robust spherical panorama image watermarking against viewpoint desynchronization. IEEE Access 8 (2020), 127477–127490.Google Scholar
Cross Ref
Index Terms
360-Degree VR Video Watermarking Based on Spherical Wavelet Transform
Recommendations
Blind Wavelet Based Logo Watermarking Resisting to Cropping
ICPR '10: Proceedings of the 2010 20th International Conference on Pattern RecognitionIn this paper we propose a blind wavelet-based logo watermarking scheme focusing on resisting to cropping. The binary logo is embedded in the LL2 sub-band of host image, using quantization technique. For increasing robustness of proposed algorithm two ...
A Wavelet-Based Image Watermarking Scheme for Stereoscopic Video Frames
IIH-MSP '13: Proceedings of the 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal ProcessingIn this paper, we propose a digital watermarking method for stereoscopic video frames. A stereoscopic video frame is stored as two images and combined by software while displayed. These two stored images are with high similarity. On the other hand, a ...
Wavelet Based Robust Video Watermarking Using Spread Spectrum Technique
CICN '12: Proceedings of the 2012 Fourth International Conference on Computational Intelligence and Communication NetworksThe ease of copying digital data with the power of P2P file sharing and internet has made piracy of digital content a major problem in today's world. The digital watermarking has evolved as a solution to such problems. This paper proposes a wavelet ...






Comments