Abstract
This study looked at users' perception of interstream synchronization between audiovisual media and two olfactory streams. The ability to detect skews and the perception and impact of skews on user Quality of Experience (QoE) is analyzed. The olfactory streams are presented with the same skews (i.e., delay) and with variable skews (i.e., jitter and mix of scents). This article reports the limits beyond which desynchronization reduces user-perceived quality levels. Also, a minimum gap between the presentations of consecutive scents is identified, necessary to ensuring enhanced user-perceived quality. There is no evidence (not considering scent type) that overlapping or mixing of scents increases user QoE levels for olfaction-enhanced multimedia.
- Y. Ariyakul and T. Nakamoto. 2011. Olfactory display using a miniaturized pump and a SAW atomizer for presenting low-volatile scents. In Proceedings of the IEEE Virtual Reality Conference. 193--194. Google Scholar
Digital Library
- L. R. Blackwell. 1997. The role of olfactory cues and their effects on food choice and acceptability. Ph.D. Dissertation, Bournemouth University, Poole. http://eprints.bournemouth.ac.uk/407/.Google Scholar
- S. Borromeo, J. A. Hernandez-Tamames, G. Luna, F. Machado, N. Malpica, and A. Toledano. 2010. Objective assessment of olfactory function using functional magnetic resonance imaging (fMRI). IEEE Trans. Instrum. Meas. 59, 10, 2602--2608.Google Scholar
Cross Ref
- S. Brewster, D. Mcgookin, and C. Miller. 2006. Olfoto: Designing a smell-based interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 653--662. Google Scholar
Digital Library
- J. Cha, M. Eid, A. Barghout, A. S. M. Mahfujur Rahman, and A. El Saddik. 2009. HugMe: Synchronous haptic teleconferencing. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). 1135--1136. Google Scholar
Digital Library
- J.-C. Chebat and R. Michon. 2003. Impact of ambient odors on mall shoppers' emotions, cognition, and spending: A test of competitive causal theories. J. Bus. Res. 56, 7, 529--539.Google Scholar
Cross Ref
- G. Dann and J. K. S. Jacobsen. 2003. Tourism smellscapes. Tour. Geograph. 5, 1, 3--25.Google Scholar
Cross Ref
- M. H. Depledge, R. J. Stone, and W. J. Bird. 2011. Can natural and virtual environments be used to promote improved human health and wellbeing? Environ. Sci. Technol. 45, 11, 4660--4665.Google Scholar
Cross Ref
- M. Eid, J. Cha, and A. El Saddik. 2011. Admux: An adaptive multiplexer for haptic-audio-visual-data communication. IEEE Trans. Instrum. Meas. 60, 1, 21--31.Google Scholar
Cross Ref
- B. Emsenhuber. 2011. The olfactory medium: Smell in human-computer interaction. Sci. Technol. Innov. Stud. 7, 1.Google Scholar
- Exhalia. 2013. www.exhalia.com (Last accessed March 2013.)Google Scholar
- M. Gerardi, B. O. Rothbaum, K. Ressler, M. Heekin, and A. Rizzo. 2008. Virtual reality exposure therapy using a virtual Iraq: Case report. J. Trauma Stress 21, 2, 209--213.Google Scholar
Cross Ref
- G. Ghinea and O. A. Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1, Article 2. Google Scholar
Digital Library
- G. Ghinea and O. A. Ademoye. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man Cybernet. Part A: Systems and Humans 40, 4, 657--663. Google Scholar
Digital Library
- G. Ghinea and O. A. Ademoye. 2011. Olfaction-enhanced multimedia: Perspectives and challenges. Multimedia Tools Appl. 55, 3, 601--626. Google Scholar
Digital Library
- N. Guéguen and C. Petr. 2006. Odors and consumer behavior in a restaurant. Int. J. Hospitality Manag. 25, 2, 335--339.Google Scholar
Cross Ref
- A. Haehner, T. Hummel, and H. Reichmann. 2009. Olfactory dysfunction as a diagnostic marker for Parkinson's disease. Expert Rev. Neurother. 9, 12, 1773--1779.Google Scholar
Cross Ref
- A. R. Hirsch. 2006. Effects of ambient odors on slot-machine usage in a Las Vegas casino. Psychol. Market. 12, 7, 585--594.Google Scholar
Cross Ref
- S. Hoshino, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2011. QoE assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.Google Scholar
- Z. Huang, A. Arefin, P. Agarwal, K. Nahrstedt, and W. Wu. 2012. Towards the understanding of human perceptual quality in tele-immersive shared activity. In Proceedings of the 3rd ACM Multimedia Systems Conference (MMSys'12). 29--34. Google Scholar
Digital Library
- ISO. 2010. ISO/IEC FDIS 23005-3 Information Technology -- Media context and control- Part 3: Sensory information. International Standards Organization (ISO).Google Scholar
- ISO. 2007. ISO/IEC 8589 Sensory analysis—General guidance for the design of test rooms. International Standards Organization (ISO).Google Scholar
- ISO. 2008. ISO 5492:2008 Sensory analysis—Vocabulary. International Standards Organization (ISO).Google Scholar
- ISO. 2006. ISO 5496:2006 Sensory analysis—Methodology—Initiation and training of assessors in the detection and recognition of odours. International Standards Organization (ISO).Google Scholar
- ITU. 2002. ITU-T BT.500. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union (ITU).Google Scholar
- ITU. 2008. ITU-T P.910. Subjective video quality assessment methods for multimedia applications. International Telecommunication Union (ITU).Google Scholar
- J. N. Kaye. 2001. Symbolic olfactory display. M. S. Thesis, Massachusetts Institute of Technology, Cambridge, MA.Google Scholar
- J.-S. Lee, L. Goldmann, and T. Ebrahimi. 2011. A new analysis method for paired comparison and its application to 3D quality assessment. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11). 1281--1284. Google Scholar
Digital Library
- B. Longino. 1999. A century in the arts. Atlanta J. Constitut.Google Scholar
- N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013a. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). 162--171. Google Scholar
Digital Library
- N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013b. Age and gender influence on perceived olfactory and visual media synchronization. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'13). 1--6.Google Scholar
Cross Ref
- N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014a. Olfaction enhanced multimedia: A survey of application domains, displays and research challenges. ACM Comput. Surv. (To appear)Google Scholar
- N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014b. User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimedia Comput. Commun. Appl. 10, 1s, Article 11. Google Scholar
Digital Library
- N. Murray. 2013. Questionnaire for special sssue on MulseMedia (TOMCCAP). http://www.niallmurray.info/Research/appendix.Google Scholar
- T. Nakamoto, S. Otaguro, M. Kinoshita, M. Nagahama, K. Ohinishi, and T. Ishida. 2008. Cooking up an interactive olfactory game display. IEEE Comput. Graph. Appl. 28, 1, 75--78. Google Scholar
Digital Library
- T. Nakamoto and H. P. D. Minh. 2007. Improvement of olfactory display using solenoid valves. In Proceedings of the IEEE Virtual Reality Conference (VR'07). 179--186.Google Scholar
Cross Ref
- T. Nakamoto and K. Yoshikawa. 2006. Movie with scents generated by olfactory display using solenoid valves. IEICE Trans. Fund. Electr. Commun. Comput. Sci. E89-A, 11, 3327--3332. Google Scholar
Digital Library
- T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, and M. Hirose. 2011. Augmented reality flavors: Gustatory display based on edible marker and cross-modal interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 93--102. Google Scholar
Digital Library
- D. Noguchi, S. Sugimoto, Y. Bannai, and K. Okada. 2011. Time characteristics of olfaction in a single breath. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 83--92. Google Scholar
Digital Library
- J. Pair, B. Allen, M. Dautricourt, A. Treskunov, M. Liewer, K. Graap, and G. Reger. 2006. A virtual reality exposure therapy application for Iraq war post traumatic stress disorder. In Proceedings of the IEEE Virtual Reality Conference. 67--72. Google Scholar
Digital Library
- L. Shams and A. R. Seitz. 2008. Benefits of multisensory learning. Trends Cogn. Sci. 12, 11, 411--417.Google Scholar
Cross Ref
- B. S. Spencer. 2006. Incorporating the sense of smell into patient and haptic surgical simulators. IEEE Trans. Inf. Technol. Biomed. 10, 1, 168--173. Google Scholar
Digital Library
- R. Steinmetz. 1996. Human perception of jitter and media synchronization. IEEE J. Select. Areas Commun. 14, 1, 61--72. Google Scholar
Digital Library
- S. Sugimoto, D. Noguchi, Y. Bannai, and K. Okada. 2010. Ink jet olfactory display enabling instantaneous switches of scents. In Proceedings of the ACM International Conference on Multimedia (MM'10). 301--310. Google Scholar
Digital Library
- J. Tillotson. 2008. Scentsory Design®: Scent whisper and fashion fluidics. In Transdisciplinary Digital Art. Sound, Vision and the New Screen, Communication in Computer and Information Science, Vol. 7, Springer-Verlag, Berlin Heidelberg, 403--417.Google Scholar
- C. Timmerer, M. Waltl, B. Rainer, and H. Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process. Image Commun. 27, 8, 909--916. Google Scholar
Digital Library
- A. Tomono, S. Yamamoto, M. Utsunomiya, D. Ikei, Y. Yanagida, and K. Hosaka. 2004. Effect that the image media with scent gives to contents understanding. In Proceedings of the Human Interface Symposium. 249--254.Google Scholar
- D. Warnock. 2011. A subjective evaluation of multimodal notifications. In Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'11). 461--468.Google Scholar
Cross Ref
- D. A. Washburn and L. M. Jones. 2004. Could olfactory displays improve data visualization? Comput. Sci. Eng. 6, 6, 80--83. doi:10.1109/MCSE.2004.66 Google Scholar
Digital Library
- D. A. Washburn. 2003. Olfactory use in virtual environment training. Model. Simul. 2, 3, 19--25.Google Scholar
Index Terms
Multiple-Scent Enhanced Multimedia Synchronization
Recommendations
User-profile-based perceived olfactory and visual media synchronization
Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013As a step towards enhancing users' perceived multimedia quality levels, this article presents the results of a study which looked at user's perception of inter-stream synchronization between scent and video. The ability to detect and the perception of ...
Subjective evaluation of olfactory and visual media synchronization
MMSys '13: Proceedings of the 4th ACM Multimedia Systems ConferenceAs a step towards enhancing users' perceived multimedia quality levels beyond the level offered by the classic audiovisual systems, the authors present the results of an experimental study which looked at user's perception of inter-stream ...
Audio Masking Effect on Inter-Component Skews in Olfaction-Enhanced Multimedia Presentations
Media-rich content plays a vital role in consumer applications today, as these applications try to find new and interesting ways to engage their users. Video, audio, and the more traditional forms of media content continue to dominate with respect to ...






Comments