skip to main content
research-article

A Generic Utility Model Representing the Quality of Sensory Experience

Published:01 October 2014Publication History
Skip Abstract Section

Abstract

Current QoE research is mainly focusing on single modalities (audio, visual) or combinations thereof. In our research, we propose annotating traditional multimedia content with additional sensory effects, such as ambient light, vibration, wind, and olfaction, which could potentially stimulate all human senses. Investigating the influence of individual sensory effects and combinations thereof is important in order to understand how these individual sensory effects influence the Quality of Experience (QoE) as a whole. In this article, we describe the results of such a subjective quality assessment of audio-visual sequences which are annotated with additional sensory effects such as ambient light, wind, and vibration using the MPEG-V standard. The results of this assessment allow us to derive a utility model representing the Quality of Sensory Experience (QuaSE) complementary to existing QoE models described in terms of Quality of Service (QoS) parameters. For validating our proposed utility model, we provide an example instantiation and validate it against results of subjective quality assessments.

References

  1. Markus Fiedler, Tobias Hossfeld, and Phuoc Tran-Gia. 2010. A generic quantitative relationship between quality of experience and quality of service. IEEE Network 24, 2 (2010), 36--41. DOI: http://dx.doi.org/10.1109/MNET.2010.5430142 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Georghita Ghinea and Oluwakemi Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1 (2012), Article 2, 17 pages. DOI: http://dx.doi.org/10.1145/2071396.2071398 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. David S. Hands. 2004. A basic multimedia quality model. IEEE Trans. Multimedia 6, 6 (2004), 806--816. DOI: http://dx.doi.org/10.1109/TMM.2004.837233 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. T. Hossfeld, D. Hock, P. Tran-Gia, K. Tutschku, and M. Fiedler. 2008. Testing the IQX hypothesis for exponential interdependency between QoS and QoE of voice codecs iLBC and G.711. In Proceedings of the 18th ITC Specialist Seminar on Quality of Experience.Google ScholarGoogle Scholar
  5. Yutaka Ishibashi, Sosuke Hoshino, Qi Zeng, Norishige Fukushima, and Shinji Sugawara. 2012. QoE assessment of fairness between players in networked game with olfaction. In Proceedings of the 11th Annual Workshop on Network and Systems Support for Games (NetGames'12). IEEE Press, Article 12, 2 pages. http://dl.acm.org/citation.cfm?id=2501560.2501577. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. ISO. 2000. ISO/IEC 13818-1. Information technology - Generic coding of moving pictures and associated audio information: Systems. ISO.Google ScholarGoogle Scholar
  7. ISO. 2011. ISO/IEC 23005. Information technology - Media context and control - Sensory information. ISO.Google ScholarGoogle Scholar
  8. ITU. 2011. Rec. ITU-R BT.500-11. Technical Report. ITU.Google ScholarGoogle Scholar
  9. Timothy Keith. 2006. Multiple Regression and Beyond. Pearson College Division. http://books.google.at/books?id=CKprQgAACAAJ.Google ScholarGoogle Scholar
  10. Ingo Kofler and Hermann Hellwagner. 2006. MPEG-21-based cross-resource adaptation decision-taking. In Proceedings of the 2nd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS), Ng Kia, Atta Badii, and Pierfrancesco Bellini (Eds.). Firenze University Press, 207--214.Google ScholarGoogle Scholar
  11. Patrick Le Callet, Sebastian Möller, and Andrew Perkis. 2012. Qualinet white paper on definitions of quality of experience. In Proceedings of the European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003). http://www.qualinet.eu/.Google ScholarGoogle Scholar
  12. Niall Murray, Yuansong Qiao, Brian Lee, Kotegar Karunakar, and Gabriel-Miro Muntean. 2013. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). ACM, New York, NY, 162--171. DOI: http://dx.doi.org/10.1145/2483977.2483999 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Fernando Pereira. 2005. A triple user characterization model for video adaptation and quality of experience evaluation. In Proceedings of the IEEE 7th Workshop on Multimedia Signal Processing, 1--4. DOI: http://dx.doi.org/10.1109/MMSP.2005.248674Google ScholarGoogle Scholar
  14. Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, and Hermann Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional respone in Web videos. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, 278--283. http://www.qomex2012.org.Google ScholarGoogle Scholar
  15. Peter Reichl, Sebastian Egger, Raimund Schatz, and Alessandro D'Alconzo. 2010. The logarithmic nature of QoE and the role of the Weber-Fechner law in QoE assessment. In Proceedings of the IEEE International Conference on Communications (ICC). 1--5. DOI: http://dx.doi.org/10.1109/ICC.2010.5501894Google ScholarGoogle ScholarCross RefCross Ref
  16. John A. Rice. 2007. Mathematical Statistics and Data Analysis. Thomson/Brooks/Cole. http://books.google.nl/books?id=EKA-yeX2GVgC.Google ScholarGoogle Scholar
  17. Sensory Experience Lab. 2014. http://selab.itec.aau.at. (2014).Google ScholarGoogle Scholar
  18. Choi Bum Suk, Joo Sang Hyun, and Lee Hea Yong. 2009. Sensory effect metadata for SMMD media service. In Proceedings of the 4th International Conference on Internet and Web Applications and Services (ICIW'09). 649--654. DOI: http://dx.doi.org/10.1109/ICIW.2009.104 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Christian Timmerer, Markus Waltl, Benjamin Rainer, and Hermann Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process.: Image Commun. 27, 8 (September 2012), 909--916. DOI: http://dx.doi.org/10.1016/j.image.2012.01.016 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010a. Improving the quality of multimedia experience through sensory effects. In Proceedings of the 2nd International Workshop on Quality of Multimedia Experience (QoMEX'10), Andrew Perkis, Sebastian Möller, Peter Svensson, and Amy Reibman (Eds.). IEEE, Los Alamitos, CA, 124--129.Google ScholarGoogle Scholar
  21. Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010b. Increasing the user experience of multimedia presentations with sensory effects. In Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'10), Riccardo Leonardi, Pierangelo Migliorati, and Andrea Cavallaro (Eds.). IEEE, Los Alamitos, CA, 1--4.Google ScholarGoogle Scholar
  22. Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012a. Sensory effect dataset and test setups. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, Los Alamitos, CA, 115--120. http://www.qomex2012.org.Google ScholarGoogle ScholarCross RefCross Ref
  23. Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012b. Sensory effects for ambient experiences in the World Wide Web. Multimedia Tools Appl. 70, 2 (May 2012), 1--20. DOI: http://dx.doi.org/10.1007/s11042-012-1099-8 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Markus Waltl, Benjamin Rainer, Christian Timmerer, and Hermann Hellwagner. 2012c. A toolset for the authoring, simulation, and rendering of sensory experiences. In Proceedings of the 20th ACM Multimedia (MM'12), Noboru Babaguchi, Kiyoharu Aizawa, and John Smith (Eds.). ACM, 1469--1472. http://www.acmm2012.org. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Kyoungro Yoon, Bumsuk Choi, Eun-Seo Lee, and Tae-Beom Lim. 2010. 4-D broadcasting with MPEG-V. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP). 257--262. DOI: http://dx.doi.org/10.1109/MMSP.2010.5662029Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Generic Utility Model Representing the Quality of Sensory Experience

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!