A Hybrid 2D-3D Tangible Interface for Virtual Reality

ABSTRACT

Virtual Reality (VR) controllers are widely used for easy object selection and manipulation as a primary 3D input method in the virtual environment. Mobile devices with touchscreens like smartphones or tablets provide precise 2D tangible inputs. This research combines a VR controller and a touch-based smartphone to create a novel hybrid 2D-3D interface for enhanced VR interaction. We present the interface design and its implementation and also demonstrate four featured scenarios with the hybrid interface.

References

1. Ghassem Alaee, Amit P Deasi, Lourdes Pena-Castillo, Edward Brown, and Oscar Meruvia-Pastor. 2018. A user study on augmented virtuality using depth sensing cameras for near-range awareness in immersive vr. In IEEE VR’s 4th Workshop on Everyday Virtual Reality (WEVR 2018), Vol. 10.
2. Huidong Bai, Li Zhang, Jing Yang, and Mark Billinghurst. 2021. Bringing full-featured mobile phone interaction into virtual reality. Computers & Graphics 97(2021), 42–53. https://doi.org/10.1016/j.cag.2021.04.004
3. Amit P Desai, Lourdes Pena-Castillo, and Oscar Meruvia-Pastor. 2017. A Window to Your Smartphone: Exploring Interaction and Communication in Immersive VR with Augmented Virtuality. In 2017 14th Conference on Computer and Robot Vision (CRV). 217–224. https://doi.org/10.1109/CRV.2017.16
4. Tomomi Takashina, Mika Ikeya, Tsutomu Tamura, Makoto Nakazumi, Tatsushi Nomura, and Yuji Kokumai. 2018. Real-Virtual Bridge: Operating Real Smartphones from the Virtual World(ISS ’18). 449–452. https://doi.org/10.1145/3279778.3279921
5. Li Zhang, Huidong Bai, Mark Billinghurst, and Weiping He. 2020. Is This My Phone? Operating a Physical Smartphone in Virtual Reality. In SIGGRAPH Asia 2020 XR(SA ’20). Article 12, 2 pages. https://doi.org/10.1145/3415256.3421499

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Virtual reality