Abstract
Haptic-based Virtual Reality (VR) applications have many merits. What is still obscure, from the designer's perspective of these applications, is the experience the users will undergo when they use the VR system. Quality of Experience (QoE) is an evaluation metric from the user's perspective that unfortunately has received limited attention from the research community. Assessing the QoE of VR applications reflects the amount of overall satisfaction and benefits gained from the application in addition to laying the foundation for ideal user-centric design in the future. In this article, we propose a taxonomy for the evaluation of QoE for multimedia applications and in particular VR applications. We model this taxonomy using a Fuzzy logic Inference System (FIS) to quantitatively measure the QoE of haptic virtual environments. We build and test our FIS by conducting a users' study analysis to evaluate the QoE of a haptic game application. Our results demonstrate that the proposed FIS model reflects the user's estimation of the application's quality significantly with low error and hence is suited for QoE evaluation.
- H. Al Osman, M. Eid, and A. El Saddik. 2008. Evaluating ALPHAN: A network protocol for haptic interaction. In Proceedings of the 16th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems. Google Scholar
Digital Library
- A. Alamri, M. Eid, and A. El Saddik. 2008. A quality of performance model for evaluating post-stroke patients. In Proceedings of the IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA'08). 14--18.Google Scholar
- C. Basdogan, C. H. Ho, M. A. Srinivasan, and M. Slater. 2000. An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 443--460. Google Scholar
Digital Library
- K. Behr, A. Nosper, C. Klimmt, and T. Hartmann. 2005. Some practical considerations of ethical issues in VR research. Presence: Teleoperators Virtual Environ. 14, 668--676. Google Scholar
Digital Library
- A. Bhattacharya, W. Wu, and Z. Yang. 2011. Quality of experience evaluation of voice communication systems using affect-based approach. In Proceedings of the 19th ACM International Conference on Multimedia. 929--932. Google Scholar
Digital Library
- K. Black. 2004. Business Statistics: For Contemporary Decision Making. Leyh Publishing.Google Scholar
- R. A. Cribbie, J. A. Gruman, and C. A. Arpin-Cribbie. 2004. Recommendations for applying tests of equivalence. J. Clinical Psych. 60, 1--10.Google Scholar
Cross Ref
- F. Danieau, J. Fleureau, A. Cabec, P. Kerbiriou, P. Guillotel, N. Mollet, M. Christie, and A. L'Ecuyer. 2012. Framework for enhancing video viewing experience with haptic effects of motion. In Proceedings of the Haptics Symposium. 541--546.Google Scholar
Cross Ref
- L. De Marez and K. De Moor. 2007. The challenge of user- and QoE-centric research and product development in today's ICT-environment. Observatorio (OBS*) 1, 1--22.Google Scholar
- C. De Vleeschouwer, T. Delmot, X. Marichal, and B. Macq. 1997. A fuzzy logic system for content-based bit-rate allocation. Signal Proces. Image Commun. 10, 115--141.Google Scholar
Cross Ref
- T. Ebrahimi. 2009. Quality of multimedia experience: past, present and future. In Proceedings of the 17th ACM International Conference on Multimedia. 3--4. Google Scholar
Digital Library
- A. El Saddik. 2007. The potential of haptic technologies. IEEE Instrum. Meas. Mag. 10, 1, 10--17.Google Scholar
Cross Ref
- A. Gaggioli, M. Bassi, and A. Fave. 2003. Quality of experience in virtual environments. Emerging Commun. 5, 121--136.Google Scholar
- A. Guerraz, C. Loscos, and R. Widenfeld. 2003. How to use physical parameters coming from the haptic device itself to enhance the evaluation of haptic benefits in user interface? In Proceedings of the Eurohaptics Conference. 137--145.Google Scholar
- F. Gutierrez, J. Pierce, V. M. Vergara, R. Coulter, L. Saland, T. P. Caudell, T. E. Goldsmith, and D. C. Alverson. 2007. The effect of degree of immersion upon learning performance in virtual reality simulations for medical education. Stud. Health Tech. Informatics 125, 155--160.Google Scholar
- I. Hajshirmohammadi and S. Payandeh. 2007. Fuzzy set theory for performance evaluation in a surgical simulator. Presence: Teleoperators Virtual Environ. 16, 603--622. Google Scholar
Digital Library
- A. Hamam, M. Eid, A. E. Saddik, and N. D. Georganas. 2008a. A quality of experience model for haptic user interfaces. In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08). 1--6. Google Scholar
Digital Library
- A. Hamam, M. Eid, A. E. Saddik, and N. D. Georganas. 2008b. A fuzzy logic system for evaluating quality of experience of haptic-based applications. In Proceedings of the Eurohaptics Conference. Springer, 129--138. Google Scholar
Digital Library
- A. Hamam, M. Eid, and A. E. Saddik. 2013. A. Effect of kinesthetic and tactile haptic feedback on the quality of experience of edutainment applications. Multimedia Tools Appl. 67, 2, 455--472. Google Scholar
Digital Library
- A. Hamam and El Saddik, 2013. Towards a mathematical model for quality of experience evaluation of haptic applications. IEEE Trans. Instrum. Meas. 62, 12. DOI: 10.1109/TIM.2013.2272859.Google Scholar
Cross Ref
- P. Huang, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2012. QoE assessment of olfactory media in remote ikebana with haptic media. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.Google Scholar
- Y. Ida, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment of interactivity and fairness in First Person Shooting with group synchronization control. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2. Google Scholar
Digital Library
- W. Ijsselsteijn, Y. De Kort, K. Poels, A. Jurgelionis, and F. Bellotti. 2007. Characterising and measuring user experiences in digital games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology.Google Scholar
- K. Iwata, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound, and video transmission: Effect of playout buffering control. Comput. Entertain. 8, 12:1--12:14. Google Scholar
Digital Library
- R. Jain. 2004. Quality of experience. IEEE Multimedia 11, 96--95. Google Scholar
Digital Library
- L. A. Jones and H. Ho. 2008. Warm or Cool, Large or Small? The Challenge of Thermal Displays. IEEE Trans. Haptics 1, 53--70. Google Scholar
Digital Library
- M. Karam, F. A. Russo, and D. I. Fels. 2009. Designing the Model Human Cochlea: An Ambient Crossmodal Audio-Tactile Display. IEEE Trans. Haptics 2, 160--169. Google Scholar
Digital Library
- Y. Kusunose, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in networked air hockey game with haptic media. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2. Google Scholar
Digital Library
- K. S. Park and R. V. Kenyon. 1999. Effects of network characteristics on human performance in a collaborative virtual environment. In Proceedings of the IEEE Conference on Virtual Reality. Google Scholar
Digital Library
- E. H. Mamdani and S. Assilian. 1999. An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Human-Computer Studies 51, 135--147. Google Scholar
Digital Library
- MATLAB Documentation, Fuzzy logic toolbox for use with MATLAB. Math Works Inc., 2001.Google Scholar
- V. G. Miller. 1993. Measurement of self-perception of intuitiveness. Western J. Nursing Res. 15, 595.Google Scholar
Cross Ref
- C. C. Preston and A. M. Colman. 2000. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychologica 104.Google Scholar
- L. Nacke and C. A. Lindley. 2008. Flow and immersion in first-person shooters: measuring the player's gameplay experience. In Proceedings of the Conference on Future Play: Research, Play, Share. ACM, 81--88. Google Scholar
Digital Library
- L. E. Nacke and C. A. Lindley. 2010. Affective ludology, flow and immersion in a first-person shooter: Measurement of player experience. Loading 3, 5.Google Scholar
- A. Ramsey. 1997. Investigation of physiological measures relative to self-report of virtual reality induced sickness and effects (VRISE). In Proceedings of the International Workshop on Motion Sickness: Medical and Human Factors. 26--28.Google Scholar
- G. H. Roid. 2004. Quality of performance and change-sensitive assessment of cognitive ability. In Proceedings of the International Test Users Conference. Austrahan Conference for Educational Research.Google Scholar
- L. A. Rowe and R. Jain. 2005. ACM SIGMM retreat report on future directions in multimedia research. ACM Trans. Multimedia Comput. Commun. Appl. 1, 3--13. Google Scholar
Digital Library
- R. Seroussi, M. H. Krag, P. Wilder, and M. H. Pope. 1989. The design and use of a microcomputerized real-time muscle fatigue monitor based on the medical frequency shift in the electromyographic signal. IEEE Trans. Biomed. Eng. 36, 284--286.Google Scholar
Cross Ref
- M. A. Srinivasan and C. Basdogan. 1997. Haptics in virtual environments: Taxonomy, research status, and challenges. Computers Graphics 21, 393--404.Google Scholar
Cross Ref
- D. L. Streiner. 2003. Unicorns do exist: a tutorial on “proving” the null hypothesis. Canadian J. Psych. 48, 756--761.Google Scholar
Cross Ref
- D. Strickland, L. Hodges, M. North, and S. Weghorst. 1997. Overcoming phobias by virtual exposure. Commun. ACM 40, 34--39. Google Scholar
Digital Library
- P. Sweetser and P. Wyeth. 2005. GameFlow: a model for evaluating player enjoyment in games. Computers Entertain. 3, 3--3. Google Scholar
Digital Library
- A. Tatematsu, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound and video transmission: Influences of network latency. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.Google Scholar
- L. X. Wang and J. M. Mendel. 1992. Generating fuzzy rules by learning from examples. IEEE Trans Syst. Man Cyber. 22, 1414--1427.Google Scholar
Cross Ref
- T. E. Whalen, S. Noel, and J. Stewart. 2003. Measuring the human side of virtual reality. In Proceedings of the IEEE International Symposium on Virtual Environments, Human- Computer Interfaces and Measurement Systems (VECIMS'03). 8--12.Google Scholar
- W. Wu, A. Arefin, R. Rivas, K. Nahrstedt, R. Sheppard, and Z. Yang. 2009. Quality of experience in distributed interactive multimedia environments: toward a theoretical framework. In Proceedings of the 17th ACM International Conference on Multimedia. 481--490. Google Scholar
Digital Library
- W. Wu, A. Arefin, Z. Huang, P. Agarwal, S. Shi, R. Rivas, and K. Nahrstedt. 2010. “I'm the Jedi!” - A case study of user experience in 3D tele-immersive gaming. In Proceedings of the IEEE International Symposium on Multimedia. 220--227. Google Scholar
Digital Library
Index Terms
A Quality of Experience Model for Haptic Virtual Environments
Recommendations
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Envisioning Haptic Design for Immersive Virtual Environments
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems ConferenceCurrent techniques for haptics in immersive virtual environments (IVEs) allow users to perceive materials while exploring virtual surfaces. However, these experiences are usually restricted to the properties defined during the design phase of the IVE. ...
Subjective Evaluation of an Olfaction Enhanced Immersive Virtual Reality Environment
AltMM '17: Proceedings of the 2nd International Workshop on Multimedia Alternate RealitiesRecent research efforts have reported findings on user Quality of Experience (QoE) of immersive virtual reality (VR) experiences. Truly immersive multimedia experiences also include multisensory components such as factional, tactile etc., in addition to ...






Comments