Abstract
Current QoE research is mainly focusing on single modalities (audio, visual) or combinations thereof. In our research, we propose annotating traditional multimedia content with additional sensory effects, such as ambient light, vibration, wind, and olfaction, which could potentially stimulate all human senses. Investigating the influence of individual sensory effects and combinations thereof is important in order to understand how these individual sensory effects influence the Quality of Experience (QoE) as a whole. In this article, we describe the results of such a subjective quality assessment of audio-visual sequences which are annotated with additional sensory effects such as ambient light, wind, and vibration using the MPEG-V standard. The results of this assessment allow us to derive a utility model representing the Quality of Sensory Experience (QuaSE) complementary to existing QoE models described in terms of Quality of Service (QoS) parameters. For validating our proposed utility model, we provide an example instantiation and validate it against results of subjective quality assessments.
- Markus Fiedler, Tobias Hossfeld, and Phuoc Tran-Gia. 2010. A generic quantitative relationship between quality of experience and quality of service. IEEE Network 24, 2 (2010), 36--41. DOI: http://dx.doi.org/10.1109/MNET.2010.5430142 Google Scholar
Digital Library
- Georghita Ghinea and Oluwakemi Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1 (2012), Article 2, 17 pages. DOI: http://dx.doi.org/10.1145/2071396.2071398 Google Scholar
Digital Library
- David S. Hands. 2004. A basic multimedia quality model. IEEE Trans. Multimedia 6, 6 (2004), 806--816. DOI: http://dx.doi.org/10.1109/TMM.2004.837233 Google Scholar
Digital Library
- T. Hossfeld, D. Hock, P. Tran-Gia, K. Tutschku, and M. Fiedler. 2008. Testing the IQX hypothesis for exponential interdependency between QoS and QoE of voice codecs iLBC and G.711. In Proceedings of the 18th ITC Specialist Seminar on Quality of Experience.Google Scholar
- Yutaka Ishibashi, Sosuke Hoshino, Qi Zeng, Norishige Fukushima, and Shinji Sugawara. 2012. QoE assessment of fairness between players in networked game with olfaction. In Proceedings of the 11th Annual Workshop on Network and Systems Support for Games (NetGames'12). IEEE Press, Article 12, 2 pages. http://dl.acm.org/citation.cfm?id=2501560.2501577. Google Scholar
Digital Library
- ISO. 2000. ISO/IEC 13818-1. Information technology - Generic coding of moving pictures and associated audio information: Systems. ISO.Google Scholar
- ISO. 2011. ISO/IEC 23005. Information technology - Media context and control - Sensory information. ISO.Google Scholar
- ITU. 2011. Rec. ITU-R BT.500-11. Technical Report. ITU.Google Scholar
- Timothy Keith. 2006. Multiple Regression and Beyond. Pearson College Division. http://books.google.at/books?id=CKprQgAACAAJ.Google Scholar
- Ingo Kofler and Hermann Hellwagner. 2006. MPEG-21-based cross-resource adaptation decision-taking. In Proceedings of the 2nd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS), Ng Kia, Atta Badii, and Pierfrancesco Bellini (Eds.). Firenze University Press, 207--214.Google Scholar
- Patrick Le Callet, Sebastian Möller, and Andrew Perkis. 2012. Qualinet white paper on definitions of quality of experience. In Proceedings of the European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003). http://www.qualinet.eu/.Google Scholar
- Niall Murray, Yuansong Qiao, Brian Lee, Kotegar Karunakar, and Gabriel-Miro Muntean. 2013. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). ACM, New York, NY, 162--171. DOI: http://dx.doi.org/10.1145/2483977.2483999 Google Scholar
Digital Library
- Fernando Pereira. 2005. A triple user characterization model for video adaptation and quality of experience evaluation. In Proceedings of the IEEE 7th Workshop on Multimedia Signal Processing, 1--4. DOI: http://dx.doi.org/10.1109/MMSP.2005.248674Google Scholar
- Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, and Hermann Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional respone in Web videos. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, 278--283. http://www.qomex2012.org.Google Scholar
- Peter Reichl, Sebastian Egger, Raimund Schatz, and Alessandro D'Alconzo. 2010. The logarithmic nature of QoE and the role of the Weber-Fechner law in QoE assessment. In Proceedings of the IEEE International Conference on Communications (ICC). 1--5. DOI: http://dx.doi.org/10.1109/ICC.2010.5501894Google Scholar
Cross Ref
- John A. Rice. 2007. Mathematical Statistics and Data Analysis. Thomson/Brooks/Cole. http://books.google.nl/books?id=EKA-yeX2GVgC.Google Scholar
- Sensory Experience Lab. 2014. http://selab.itec.aau.at. (2014).Google Scholar
- Choi Bum Suk, Joo Sang Hyun, and Lee Hea Yong. 2009. Sensory effect metadata for SMMD media service. In Proceedings of the 4th International Conference on Internet and Web Applications and Services (ICIW'09). 649--654. DOI: http://dx.doi.org/10.1109/ICIW.2009.104 Google Scholar
Digital Library
- Christian Timmerer, Markus Waltl, Benjamin Rainer, and Hermann Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process.: Image Commun. 27, 8 (September 2012), 909--916. DOI: http://dx.doi.org/10.1016/j.image.2012.01.016 Google Scholar
Digital Library
- Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010a. Improving the quality of multimedia experience through sensory effects. In Proceedings of the 2nd International Workshop on Quality of Multimedia Experience (QoMEX'10), Andrew Perkis, Sebastian Möller, Peter Svensson, and Amy Reibman (Eds.). IEEE, Los Alamitos, CA, 124--129.Google Scholar
- Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010b. Increasing the user experience of multimedia presentations with sensory effects. In Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'10), Riccardo Leonardi, Pierangelo Migliorati, and Andrea Cavallaro (Eds.). IEEE, Los Alamitos, CA, 1--4.Google Scholar
- Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012a. Sensory effect dataset and test setups. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, Los Alamitos, CA, 115--120. http://www.qomex2012.org.Google Scholar
Cross Ref
- Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012b. Sensory effects for ambient experiences in the World Wide Web. Multimedia Tools Appl. 70, 2 (May 2012), 1--20. DOI: http://dx.doi.org/10.1007/s11042-012-1099-8 Google Scholar
Digital Library
- Markus Waltl, Benjamin Rainer, Christian Timmerer, and Hermann Hellwagner. 2012c. A toolset for the authoring, simulation, and rendering of sensory experiences. In Proceedings of the 20th ACM Multimedia (MM'12), Noboru Babaguchi, Kiyoharu Aizawa, and John Smith (Eds.). ACM, 1469--1472. http://www.acmm2012.org. Google Scholar
Digital Library
- Kyoungro Yoon, Bumsuk Choi, Eun-Seo Lee, and Tae-Beom Lim. 2010. 4-D broadcasting with MPEG-V. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP). 257--262. DOI: http://dx.doi.org/10.1109/MMSP.2010.5662029Google Scholar
Cross Ref
Index Terms
A Generic Utility Model Representing the Quality of Sensory Experience
Recommendations
Assessing the quality of sensory experience for multimedia presentations
This paper introduces the concept of sensory experience by utilizing sensory effects such as wind or lighting as another dimension which contributes to the quality of the user experience. In particular, we utilize a representation format for sensory ...
An end-to-end tool chain for Sensory Experience based on MPEG-V
This paper provides an overview of our research conducted in the area of Sensory Experience including our implementations using MPEG-V Part 3 entitled ''Sensory Information''. MPEG-V Part 3 introduces Sensory Experience as a tool to increase the Quality ...
Enhancing the user experience with the sensory effect media player and ambientlib
MMM'12: Proceedings of the 18th international conference on Advances in Multimedia ModelingMultimedia content is increasingly used in every area of our life. Still, each type of content only stimulates the visual and/or the hearing system. Thus, the user experience depends only on those two stimuli. In this paper we introduce a standard which ...






Comments