Abstract
User Quality of Experience (QoE) is of fundamental importance in multimedia applications and has been extensively studied for decades. However, user QoE in the context of the emerging multiple-sensorial media (mulsemedia) services, which involve different media components than the traditional multimedia applications, have not been comprehensively studied. This article presents the results of subjective tests which have investigated user perception of mulsemedia content. In particular, the impact of intensity of certain mulsemedia components including haptic and airflow on user-perceived experience are studied. Results demonstrate that by making use of mulsemedia the overall user enjoyment levels increased by up to 77%.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, User Quality of Experience of Mulsemedia Applications
- J. G. Apostolopoulos, P. A. Chou, B. Culbertson, T. Kalker, M. D. Trott, and S. Wee. 2012. The road to immersive communication. Proc. IEEE 100, 4, 974--990.Google Scholar
Cross Ref
- G. Blakowski and R. Steinmetz. 1996. A media synchronisation survey: Reference model, specification, and case studies. IEEE J. Select. Areas Commun. 14, 1, 5--35. Google Scholar
Digital Library
- A. Bodnar, R. Corbeth, and D. Netrasorski. 2014, AROMA: Ambient awareness through olfaction in a messaging application - Does olfactory notification make “scents”? In Proceedings of the ACM International Conference on Multimodal Interfaces. Google Scholar
Digital Library
- C. C. Carbon and H. Leder. 2005. The repeated evaluation technique (RET). A method to capture dynamic effects of innovativeness and attractiveness. Appl. Cogn. Psychol. 19, 5, 587--601.Google Scholar
Cross Ref
- J. P. Cater. 1992. The nose have it! Letters to the editor. Presence 1, 4, 493--494.Google Scholar
- H. Q. Dinh, N. Walker, L. F. Hodges, C. Song, and A. Kobayashi. 1999. Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. In Proceedings of the Virtual Reality Annual International Symposium. 222--228. Google Scholar
Digital Library
- S. I. Donaldson and E. J. Grant-Vallone. 2002. Understanding self-report bias in organizational behavior research. J. Bus. Psychol. 17, 2, 245--260.Google Scholar
Cross Ref
- ETSI. 2009. ETSI TR 102 643 V1.0.1: Human factors (HF): Quality of experience (QoE) requirements for real-time communication services. Tech. rep. ETSI.Google Scholar
- G. Ghinea, S. R. Gulliver, and F. Andres. 2011 Multiple sensorial media advances and applications: New developments in MulSeMedia. IGI Global.Google Scholar
- G. Ghinea and O. A. Ademoye. 2010a. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man Cybernet. Part A: Systems and Humans 40, 4, 657--663. Google Scholar
Digital Library
- G. Ghinea and O. A. Ademoye. 2010b. A user perspective of olfaction-enhanced mulsemedia. In Proceedings of the International Conference on Management of Emergent Digital EcoSystems. 277--280. Google Scholar
Digital Library
- G. Ghinea and O. A. Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1, Article 2. Google Scholar
Digital Library
- G. Ghinea and J. P. Thomas. 2005. Quality of perception: User quality of service in multimedia presentations. IEEE Trans. Multimedia 7, 4, 786--789. Google Scholar
Digital Library
- M. L. Heilig. 1962, Sensorama simulator. U.S. Patent 3,050,870. Filed January 10, 1961. Accepted August 28, 1962.Google Scholar
- ITu. 1998. P.911: Subjective audiovisual quality assessment methods for multimedia applications. International Telecommunications Union.Google Scholar
- Y. Ishibashi, T. Kanbara, and S. Tasaka. 2004. Inter-stream synchronization between haptic media and voice in collaborative virtual environments. In Proceedings of the 12th Annual ACM International Conference on Multimedia. 604--611. Google Scholar
Digital Library
- M. Jakesch, M. Zachhuber, H. Leder, M. Spingler, and C. C. Carbon. 2011. Scenario-based touching: On the influence of top-down processes on tactile and visual appreciation. Res. Eng. Des. 22, 3, 143--152.Google Scholar
Cross Ref
- K. Kahol, P. Tripathi, T. Mcdaniel, T. Bratton, and S. Panchanathan. 2006. Modeling context in haptic perception, rendering, and visualization. ACM Trans. Multimedia Comput. Commun. Appl. 2, 3, 219--240. Google Scholar
Digital Library
- J. N. Kaye. 2001. Symbolic olfactory display. M.S. Thesis, Massachusetts Institute of Technology. http://alumni.media.mit.edu/∼jofish/thesis/. (Last accessed March 2014).Google Scholar
- N. Murray, Y. Qiao, A. K. Karunakar, B. Lee, and G.-M. Muntean. 2013. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the ACM Multimedia Systems Conference. 162--171. Google Scholar
Digital Library
- N. Murray, Y. Qiao, B. Lee, and G. M. Muntean. 2014. User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimedia Comput. Commun. Appl. 10, 1, Article 11. Google Scholar
Digital Library
- H. T. Nagle, R. Gutierrez-Osuna, and S. S. Schiffman. 1998. The how and why of electronic noses. IEEE Spectrum, 35, 9, 22--31. Google Scholar
Digital Library
- NTT Com. 2006. Movie enhanced with internet-based fragrance system. NIT Communications. http://www.in70mm.com/news/2006/new_world/index.htm (Last accessed March 2014).Google Scholar
- J. Nunnaly. 1978. Psychometric Theory. McGraw-Hill, New York.Google Scholar
- E. Steinbach, S. Hirche, M. Ernst, F. Brandi, R. Chaudhari, J. Kammerl, and I. Vittorias. 2012. Haptic communications. Proc. IEEE 100, 4, 937--956.Google Scholar
Cross Ref
- D. A. Washburn, L. M. Jones, R. V. Satya, C. A. Bowers, and A. Cortes. 2003. Olfactory use in virtual environment training. Model. Simul. Mag. 2, 3.Google Scholar
- Z. Yuan, G. Ghinea, and G.-M. Muntean. 2014. Quality of experience study for multiple sensorial media delivery. In Proceedings of the IEEE International Wireless Communications and Mobile Computing Conference (IWCMC).Google Scholar
Cross Ref
Index Terms
User Quality of Experience of Mulsemedia Applications
Recommendations
Mulsemedia: State of the Art, Perspectives, and Challenges
Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and ApplicationsMulsemedia—multiple sensorial media—captures a wide variety of research efforts and applications. This article presents a historic perspective on mulsemedia work and reviews current developments in the area. These take place across the traditional ...
A user perspective of olfaction-enhanced mulsemedia
MEDES '10: Proceedings of the International Conference on Management of Emergent Digital EcoSystemsThe focus of this paper is on olfaction-enhanced multimedia applications, that is, combining computer generated smell with other media to enrich the users' experience and perception of a multimedia application. Within the general context of mulsemedia --...
Mulsemedia - what's new?
WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the WebImagine a chemistry experiment being streamed online to school kids wearing VR headsets. The chemistry teacher carefully measures the desired quantity of substances, one a yellowish liquid, the other blue, with a pipette and combines them in a glass ...






Comments