BoYu Gao
ABSTRACT
Most Virtual Reality1(VR) applications are dedicated to providing a realistic response to users. Prior works have argued that the importance of credibility or believability to evoke realistic responses. However, there are few empirical works focused on the concept of believability itself. This work further explores the evoke-condition of believability from the views of sensory and perceptual aspects. Sensory believability refers to the actions supported by the Virtual Environment (VE) match with common sense, whereas perceptual believability refers to the behaviors supported by the VE are consistent with the expectation formed during interactions or from prior experiences. Towards the end, an experiment that examines the sensory (rock appearance, environmental visual scene, environmental sound) and perceptual (dynamic behavior) factors of consistency on believable response in a virtual rock climbing environment was conducted. The results showed that the consistency of dynamics features contributed the most to perceptual believability, followed by a higher level of rock appearance along with climbing actions, even with the medium level of the environmental visual scene. In contrast, the medium and higher level of environmental visual scene contributed the most to sensory believability. This study suggests the sensory and perceptual consistency together could evoke the believable response in action feedback loop for VR.
- HTC Vive, https://www.vive.com/eu/, Retrieved on Nov, 06, 2017.Google Scholar
- Cummings, J. J., and Bailenson, J. N., 2016. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology, 19:2, 272--309.Google ScholarCross Ref
- Slater, M. 2009. Place illusion and plausibility can lead to realistic behavior in immersive virtual environments. Phi. Trans. R. Soc. B, 364, 3549--3557.Google ScholarCross Ref
- Rovira, A., Swapp, D., Spanlang, B., and Slater, M., 2009. The use of virtual reality in the study of people's responses to violent incidents. Frontiers in Behavioral Neuroscience, Vol. 3, Article 59.Google Scholar
- Skarbez, R., Neyret, S., Brooks, F. P., Slater, M., and Whitton, M. C., 2017. A psychophysical experiment regarding components of the plausibility illusion." IEEE Trans. on Visualization and Computer Graphics, Vol. 23, No. 4, 1322--1331. Google ScholarDigital Library
- BergstrÖm, I., Azevedo, S., Papiotis, P., Saldanha, N., and Slater, M., 2017. The plausibility of a string quartet performance in virtual reality. IEEE Trans. on Visualization and Computer Graphics, Vol. 23, No. 4, 1332--1339. Google ScholarDigital Library
- Avradinis, N., Panayiotopoulos, T., and Anastassakis, G., 2013. Behavior believability in virtual worlds: agents acting when they need to. SpringerPlus, 2:246.Google ScholarCross Ref
- Magnenat-Thalmann, N., Kim, H., Egges, A., and Garchery, S., 2005. Believability and Interaction in Virtual Worlds." Proc. of the 11th International Multimedia Modelling Conference (MMM 05). Google ScholarDigital Library
- Slater, M., Khanna, P., Mortensen, J., and Yu, I., 2009. Visual realism enhances realistic response in an immersive virtual environment. IEEE Computer Graphics and Applications, Vol. 29, Issue 3, 76--84.Google Scholar
- Mania, K., Wooldridge, D., Coxon, M., and Robinson, A., 2006. The effect of visual and interaction fidelity on spatial cognition in immersive virtual environments, IEEE Trans. on Visualization and Computer Graphics, Vol. 12, No. 3, pp. 396--404. Google ScholarDigital Library
- Schubert, T. W., & Crusius, J., 2002. Five theses on the book problem." Presence in books, film, and VR. In F. R. Gouveia & F. Biocca (Eds.), PRESENCE 2002 -- Proceedings of the fifth international workshop on Presence, Porto, Portugal: Universidad Fernando Pessoa, 53--59.Google Scholar
- Bennett, A., Coxon, M., and Mania, K., 2010. The effect of stereo and context on memory and awareness states in immersive virtual environments. APGV '10 (Proc. of 7th Symposium on Applied Perception in Graphics and Visualization), Los Angeles, USA, 135--140. Google ScholarDigital Library
- Lindeman, R. W., and Beckhaus, S., 2009. Crafting memorable VR experiences using experiential fidelity. Proc. of ACM Symposium on Virtual Reality Software Techology (VRST 09). Kyoto, Japan, 187--190. Google ScholarDigital Library
- Gao, B., 2018. Believability of spatial user interactions in virtual environments. Ph.D. Dissertation, Konkuk University, Seoul, South Korea.Google Scholar
- Kajastila, R., Holsti, L., and Hámáláinen, P., 2016. The augmented climbing wall: high-exertion proximity interaction on a wall-sized interactive surface. ACM CHI 16, San Jose, CA. USA, 758--769. Google ScholarDigital Library
- The Climb Game, http://www.theclimbgame.com/, Retrieved on Nov. 14, 2017.Google Scholar
- Kosmalla, F., Zenner, A., Speicher, M., Daiber, F., Herbig, N., and Krüger, A., 2017. Exploring rock climbing in mixed reality environments. ACM CHI 17, Denver, CO, USA, 1787--1793. Google ScholarDigital Library
- Slater, M., Usoh, M., and Steed, A., 1995. Taking steps: the influence of a walking technique on presence in virtual reality. TOCHI (ACM Transactions on Computer-Human Interaction), Vol. 2, No. 3, 201--219. Google ScholarDigital Library
- Slater, M., Linakis, V., Usoh, M., Kooper, R., and Street, G., 1996. Immersion, presence, and performance in virtual environments: an experiment with tri-dimensional chess. Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST 1996), 163--172.Google ScholarDigital Library
- Biocca, F., 1997. The cyborg's dilemma: progressive embodiment in virtual environments. Journal of Computer-Mediated Communication, Vol. 3, Issue 2.Google Scholar
- Slater, M., and Wilbur, S., 1997. A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence: Teleoperators and Virtual Environments, Vol. 6, Issue 6, 603--616. Google ScholarDigital Library
- Witmer, B. G., and Singer, M. J., 1998. Measuring presence in virtual environments: a presence questionnaire. Presence: Teleoperators and Virtual Environments, Vol. 7, Issue 3, 225-- 240. Google ScholarDigital Library
- Sheridan, T. B., 1992. Musings on Telepresence and Virtual Presence. Presence: Teleoperators and Virtual Environments, Vol. 1, Issue 1, 120--126.Google Scholar
- Lee, K. M. 2004. Presence, Explicated. Communication Theory, Vol. 14, Issue 1, 27--50.Google Scholar
- Wirth, W., Hartmann, T., BÖcking, S., Vorderer, P., Klimmt, P., Schramm, H., Saari, T., Laarni, J., Ravaja, N., Gouveia, F. R., Biocca, F., Sacau, A., Jäncke, L., Baumgartner, T., and Jäncke, P., 2007. A Process Model of the Formation of Spatial Presence Experiences. Media Psychology, 9:3, 493--525.Google ScholarCross Ref
- Wang, N., and Doube, W., 2011. How real is reality? A perceptually motivated system for quantifying visual realism in digital images. Proc. of International Conference on Multimedia and Signal Processing, 141--149. Google ScholarDigital Library
- Meijer, F., Geudeke, B. L., and Broek, E. L. V. D., 2009. Navigating through virtual environments: visual realism improves spatial cognition. CyberPsychology & Behav., 12(5), 517--521.Google ScholarCross Ref
- Greeno, J. G., 1994. Gibson's affordances, Psychological review, Vol. 101, No. 2, 336--342.Google Scholar
- Warren, WH Jr., 1984. Perceiving affordances: visual guidance of stair climbing. J Exp Psychol Hum Percept Perform, 10(5): 683--703.Google Scholar
- Kim, H., Giacomo, T. D., Egges, A., Lyard, E., Garchery, S., Magnenat-Thalmann, N., 2004. Believable Virtual Environment: Sensory and Perceptual Believability." Workshop on Believability in Virtual Environment.Google Scholar
- Slater, M., Spanlang, B., and Corominas, D., 2010. Simulating virtual environments within virtual environments as the basis for a psychophysics of presence, ACM Transactions on Graphics, vol. 29, p. Paper: 92. Google ScholarDigital Library
- Hendrix, C. and Barfield, W., 1996. The sense of presence within auditory virtual environments, Presence: Teleoperators and Virtual Environments, vol. 5, 290--301. Google ScholarDigital Library
- Bormann, K., 2005. Presence and the utility of audio spatialization, Presence: Teleoperators and Virtual Environments, vol. 14, 278--297. Google ScholarDigital Library
- Poeschl, S., Wall, K. and Doering, N., 2013. Integration of spatial sound in immersive virtual environments an experimental study on effects of spatial sound on presence. Proc. of IEEE Virtual Reality 2013, 129--130.Google Scholar
- Slater, M., Usoh, M., and Chrysanthou, Y., 1995. The Influence of Dynamic Shadows on Presence in Immersive Virtual Environments, Eurographics Workshops Virtual Environments 1995. Springer. 8--21. Google ScholarDigital Library
- VRTK, https://vrtoolkit.readme.io/docs, Retrieved on Nov, 13, 2017.Google Scholar
- Usoh, M., Catena, E., Arman, S., and Slater, M., 2000. Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments, Vol. 9, Issue. 5, 497--503. Google ScholarDigital Library
- Warren, W. H., 2006. The dynamics of perception and action. Psychological Review, Vol. 113, No. 2, 358--389.Google ScholarCross Ref
- Rock and Boulders 2, https://assetstore.unity.com/packages/3d/props/exterior/rock-and-boulders-2-6947, retrieved in Nov, 2017.Google Scholar
- Tree pack 2, https://assetstore.unity.com/packages/3d/vegetation/trees/tree-pack-2-67117, retrieved in Nov, 2017.Google Scholar
- Windy sound, https://freesound.org/, retrieved in Nov, 2017.Google Scholar
Index Terms
Sensory and Perceptual Consistency for Believable Response in Action Feedback Loop
Recommendations
Toward Believable Acting for Autonomous Animated Characters
MIG '22: Proceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and GamesThis paper describes design principles and a system, based on reinforcement learning and procedural animation, to create an autonomous character capable of believable acting—exhibiting a responsive and expressive illusion of interactive life, grounded ...
A comparison of two cost-differentiated virtual reality systems for perception and action tasks
SAP '14: Proceedings of the ACM Symposium on Applied PerceptionRecent advances in technology and the opportunity to obtain commodity-level components have made the development and use of three-dimensional virtual environments more available than ever before. How well such components work to generate realistic ...
Influence of tactile feedback and presence on egocentric distance perception in virtual environments
VR '10: Proceedings of the 2010 IEEE Virtual Reality ConferenceA number of studies have reported that distance judgments are underestimated in virtual environments (VE) when compared to those made in the real world. Studies have also reported that providing users with visual feedback in the VE improves their ...
Comments