skip to main content
research-article

Modified 2D-Ghost-Free Stereoscopic Display with Depth-of-Field Effects

Authors Info & Claims
Published:23 January 2023Publication History
Skip Abstract Section

Abstract

Backward-compatible stereoscopic display, a novel display technique that can simultaneously present satisfying 3D effects to viewers with stereo glasses and clear 2D contents to viewers without, aims at helping the people who are unsuitable for watching 3D movies for a long time. In this article, we introduce two versions of backward-compatible stereoscopic display: the simpler version is far simpler than Hidden Stereo (the state-of-the-art method) while preserving competitive 2D–3D effects; the advanced version, which we call 2D-Ghost-Free Stereoscopic Display, overcomes the limitation that Hidden Stereo and the simpler version are both confined to small absolute disparity. 2D-Ghost-Free Stereoscopic Display improves tolerable disparity range by adding depth-of-field in the regions with large disparity, so that it can be applied to more scenes of 3D movies. User experiments and theoretical analysis both demonstrate the superiority of the 2D-Ghost-Free Stereoscopic Display over the state-of-the-art method and our simpler version. In addition, to make the user experiments double-blind and automatic, we developed a user study system that can automatically present 3D images and videos in NVIDIA 3D Vision 2 and collect corresponding votes of subjects on stimuli, whereas the previous researchers did not state that their user experiments were double-blind.

REFERENCES

  1. [1] Didyk Piotr, Ritschel Tobias, Eisemann Elmar, Myszkowski Karol, and Seidel Hans-Peter. 2011. A perceptual model for disparity. ACM Transactions on Graphics30, 4 (2011), 110. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Didyk Piotr, Ritschel Tobias, Eisemann Elmar, Myszkowski Karol, and Seidel Hans-Peter. 2012. Apparent stereo: The cornsweet illusion can enhance perceived depth. In Proceedings of the IS&T/SPIE Symposium on Electronic Imaging Human Vision and Electronic Imaging XVII. 112.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Didyk Piotr, Sitthi-Amorn Pitchaya, Freeman William, Durand Frédo, and Matusik Wojciech. 2013. Joint view expansion and filtering for automultiscopic 3D displays. ACM Transactions on Graphics 32, 6 (2013), 18.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Duchowski Andrew T., House Donald H., Gestring Jordan, Wang Rui I., Krejtz Krzysztof, Krejtz Izabela, Mantiuk Radosław, and Bazyluk Bartosz. 2014. Reducing visual discomfort of 3D stereoscopic displays with gaze-contingent depth-of-field. In Proceedings of the ACM Symposium on Applied Perception. 3946.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Fujimura Wataru, Koide Yukua, Songer Robert, Hayakawa Takahiro, Shirai Akihiko, and Yanaka Kazuhisa. 2012. 2x3D: Real time shader for simultaneous 2D/3D hybrid theater. In Proceedings of the SIGGRAPH Asia 2012 Emerging Technologies. 1. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Fukiage Taiki, Kawabe Takahiro, and Nishida Shin’ya. 2017. Hiding of phase-based stereo disparity for ghost-free viewing without glasses.ACM Transactions on Graphics 36, 4 (2017), 116. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. [7] Gonzalez Rafael C. and Woods Richard E.. 2018. Digital Image Processing, 4th Edition. Pearson.Google ScholarGoogle Scholar
  8. [8] Henriksen Sid and Read Jenny C. A.. 2016. Visual perception: A novel difference channel in binocular vision. Current Biology 26, 12 (2016), R500–R503. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Hoffman David M., Girshick Ahna R., Akeley Kurt, and Banks Martin S.. 2008. Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (2008), 130.Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Hosni Asmaa, Rhemann Christoph, Bleyer Michael, Rother Carsten, and Gelautz Margrit. 2012. Fast cost-volume filtering for visual correspondence and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 2 (2012), 504511.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Ishihara Shinobu. 1987. Test for Colour-blindness. Kanehara Tokyo, Japan.Google ScholarGoogle Scholar
  12. [12] Jo Youngjin, Lee Seungjae, Yoo Dongheon, Choi Suyeon, Kim Dongyeon, and Lee Byoungho. 2019. Tomographic projector: Large scale volumetric display with uniform viewing experiences. ACM Transactions on Graphics38, 6 (2019), 113.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Kellnhofer Petr, Didyk Piotr, Myszkowski Karol, Hefeeda Mohamed M., Seidel Hans-Peter, and Matusik Wojciech. 2016. GazeStereo3D: Seamless disparity manipulations. ACM Transactions on Graphics 35, 4 (2016), 113. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. [14] Kellnhofer Petr, Didyk Piotr, Wang Szu-Po, Sitthi-Amorn Pitchaya, Freeman William, Durand Fredo, and Matusik Wojciech. 2017. 3DTV at home: Eulerian-lagrangian stereo-to-multiview conversion. ACM Transactions on Graphics 36, 4 (2017), 113. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Kingdom Frederick A. A.. 2012. Binocular vision: The eyes add and subtract. Current Biology 22, 1 (2012), R22–R24. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Lambooij Marc, Fortuin Marten, Heynderickx Ingrid, and IJsselsteijn Wijnand. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology 53, 3 (2009), 30201–1–30201–14. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Lang Manuel, Hornung Alexander, Wang Oliver, Poulakos Steven, Smolic Aljoscha, and Gross Markus. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM Transactions on Graphics 29, 4 (2010), 110. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Li Zhaoping and Atick Joseph J.. 1994. Efficient stereo coding in the multiscale representation. Network: Computation in Neural Systems 5, 2 (1994), 157174. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] May Keith A. and Zhaoping Li. 2016. Efficient coding theory predicts a tilt aftereffect from viewing untilted patterns. Current Biology 26, 12 (2016), 15711576. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Meyer Simone, Wang Oliver, Zimmer Henning, Grosse Max, and Sorkine-Hornung Alexander. 2015. Phase-based frame interpolation for video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 14101418.Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Oskam Thomas, Hornung Alexander, Bowles Huw, Mitchell Kenny, and Gross Markus H.. 2011. OSCAM-optimized stereoscopic camera control for interactive 3D.ACM Transactions on Graphics 30, 6 (2011), 189.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. [22] Palmer Stephen E.. 1999. Vision Science: Photons to Phenomenology. MIT press.Google ScholarGoogle Scholar
  23. [23] Park Soon-gi, Yeom Jiwoon, Jeong Youngmo, Chen Ni, Hong Jong-Young, and Lee Byoungho. 2014. Recent issues on integral imaging and its applications. Journal of Information Display 15, 1 (2014), 3746.Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Portilla Javier and Simoncelli Eero P.. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 1 (2000), 4970.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. [25] Ranftl René, Lasinger Katrin, Hafner David, Schindler Konrad, and Koltun Vladlen. 2020. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020).Google ScholarGoogle Scholar
  26. [26] Richards Whitman. 1971. Anomalous stereoscopic depth perception. Journal of the Optical Society of America 61, 3 (1971), 410414.Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Scher Steven, Liu Jing, Vaish Rajan, Gunawardane Prabath, and Davis James. 2013. 3D+2DTV: 3D displays with no ghosting for viewers without glasses. ACM Transactions on Graphics32, 3 (2013), 110. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Simoncelli Eero P. and Freeman William T.. 1995. The steerable pyramid: A flexible architecture for multi-scale derivative computation. In Proceedings of the International Conference on Image Processing. 444447.Google ScholarGoogle ScholarCross RefCross Ref
  29. [29] Wadhwa Neal, Rubinstein Michael, Durand Frédo, and Freeman William T.. 2013. Phase-based video motion processing. ACM Transactions on Graphics 32, 4 (2013), 110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. [30] Wakunami Koki, Hsieh Po-Yuan, Oi Ryutaro, Senoh Takanori, Sasaki Hisayuki, Ichihashi Yasuyuki, Okui Makoto, Huang Yi-Pai, and Yamamoto Kenji. 2016. Projection-type see-through holographic three-dimensional display. Nature Communications 7, 1 (2016), 17.Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Wizadwongsa Suttisak, Phongthawee Pakkapon, Yenphraphai Jiraphon, and Suwajanakorn Supasorn. 2021. NeX: Real-time view synthesis with neural basis expansion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Wu Xiaolin and Zhai Guangtao. 2012. Backward compatible stereoscopic displays via temporal psychovisual modulation. In Proceedings of the SIGGRAPH Asia 2012 Emerging Technologies. 4. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. [33] Xiao Lei, Kaplanyan Anton, Fix Alexander, Chapman Matt, and Lanman Douglas. 2018. Deepfocus: Learned image synthesis for computational display. In Proceedings of the ACM SIGGRAPH 2018 Talks. 12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Zaroff Charles M., Knutelska Magosha, and Frumkes Thomas E.. 2003. Variation in stereoacuity: Normative description, fixation disparity, and the roles of aging and gender. Investigative Ophthalmology & Visual Science 44, 2 (2003), 891900. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Zhang Zhoutong, Liu Yebin, and Dai Qionghai. 2015. Light field from micro-baseline image pair. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 38003809.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Zhou Tinghui, Tucker Richard, Flynn John, Fyffe Graham, and Snavely Noah. 2018. Stereo magnification: Learning view synthesis using multiplane images. ACM Transactions on Graphics 37, 65 (2018), 112. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Modified 2D-Ghost-Free Stereoscopic Display with Depth-of-Field Effects

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Multimedia Computing, Communications, and Applications
        ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 19, Issue 1s
        February 2023
        504 pages
        ISSN:1551-6857
        EISSN:1551-6865
        DOI:10.1145/3572859
        • Editor:
        • Abdulmotaleb El Saddik
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 23 January 2023
        • Online AM: 12 May 2022
        • Accepted: 1 May 2022
        • Received: 15 September 2021
        Published in tomm Volume 19, Issue 1s

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Refereed
      • Article Metrics

        • Downloads (Last 12 months)85
        • Downloads (Last 6 weeks)7

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!