skip to main content
research-article

Multiple-Scent Enhanced Multimedia Synchronization

Published:01 October 2014Publication History
Skip Abstract Section

Abstract

This study looked at users' perception of interstream synchronization between audiovisual media and two olfactory streams. The ability to detect skews and the perception and impact of skews on user Quality of Experience (QoE) is analyzed. The olfactory streams are presented with the same skews (i.e., delay) and with variable skews (i.e., jitter and mix of scents). This article reports the limits beyond which desynchronization reduces user-perceived quality levels. Also, a minimum gap between the presentations of consecutive scents is identified, necessary to ensuring enhanced user-perceived quality. There is no evidence (not considering scent type) that overlapping or mixing of scents increases user QoE levels for olfaction-enhanced multimedia.

References

  1. Y. Ariyakul and T. Nakamoto. 2011. Olfactory display using a miniaturized pump and a SAW atomizer for presenting low-volatile scents. In Proceedings of the IEEE Virtual Reality Conference. 193--194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. L. R. Blackwell. 1997. The role of olfactory cues and their effects on food choice and acceptability. Ph.D. Dissertation, Bournemouth University, Poole. http://eprints.bournemouth.ac.uk/407/.Google ScholarGoogle Scholar
  3. S. Borromeo, J. A. Hernandez-Tamames, G. Luna, F. Machado, N. Malpica, and A. Toledano. 2010. Objective assessment of olfactory function using functional magnetic resonance imaging (fMRI). IEEE Trans. Instrum. Meas. 59, 10, 2602--2608.Google ScholarGoogle ScholarCross RefCross Ref
  4. S. Brewster, D. Mcgookin, and C. Miller. 2006. Olfoto: Designing a smell-based interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 653--662. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. J. Cha, M. Eid, A. Barghout, A. S. M. Mahfujur Rahman, and A. El Saddik. 2009. HugMe: Synchronous haptic teleconferencing. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). 1135--1136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J.-C. Chebat and R. Michon. 2003. Impact of ambient odors on mall shoppers' emotions, cognition, and spending: A test of competitive causal theories. J. Bus. Res. 56, 7, 529--539.Google ScholarGoogle ScholarCross RefCross Ref
  7. G. Dann and J. K. S. Jacobsen. 2003. Tourism smellscapes. Tour. Geograph. 5, 1, 3--25.Google ScholarGoogle ScholarCross RefCross Ref
  8. M. H. Depledge, R. J. Stone, and W. J. Bird. 2011. Can natural and virtual environments be used to promote improved human health and wellbeing? Environ. Sci. Technol. 45, 11, 4660--4665.Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Eid, J. Cha, and A. El Saddik. 2011. Admux: An adaptive multiplexer for haptic-audio-visual-data communication. IEEE Trans. Instrum. Meas. 60, 1, 21--31.Google ScholarGoogle ScholarCross RefCross Ref
  10. B. Emsenhuber. 2011. The olfactory medium: Smell in human-computer interaction. Sci. Technol. Innov. Stud. 7, 1.Google ScholarGoogle Scholar
  11. Exhalia. 2013. www.exhalia.com (Last accessed March 2013.)Google ScholarGoogle Scholar
  12. M. Gerardi, B. O. Rothbaum, K. Ressler, M. Heekin, and A. Rizzo. 2008. Virtual reality exposure therapy using a virtual Iraq: Case report. J. Trauma Stress 21, 2, 209--213.Google ScholarGoogle ScholarCross RefCross Ref
  13. G. Ghinea and O. A. Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1, Article 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. G. Ghinea and O. A. Ademoye. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man Cybernet. Part A: Systems and Humans 40, 4, 657--663. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. G. Ghinea and O. A. Ademoye. 2011. Olfaction-enhanced multimedia: Perspectives and challenges. Multimedia Tools Appl. 55, 3, 601--626. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. N. Guéguen and C. Petr. 2006. Odors and consumer behavior in a restaurant. Int. J. Hospitality Manag. 25, 2, 335--339.Google ScholarGoogle ScholarCross RefCross Ref
  17. A. Haehner, T. Hummel, and H. Reichmann. 2009. Olfactory dysfunction as a diagnostic marker for Parkinson's disease. Expert Rev. Neurother. 9, 12, 1773--1779.Google ScholarGoogle ScholarCross RefCross Ref
  18. A. R. Hirsch. 2006. Effects of ambient odors on slot-machine usage in a Las Vegas casino. Psychol. Market. 12, 7, 585--594.Google ScholarGoogle ScholarCross RefCross Ref
  19. S. Hoshino, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2011. QoE assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.Google ScholarGoogle Scholar
  20. Z. Huang, A. Arefin, P. Agarwal, K. Nahrstedt, and W. Wu. 2012. Towards the understanding of human perceptual quality in tele-immersive shared activity. In Proceedings of the 3rd ACM Multimedia Systems Conference (MMSys'12). 29--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. ISO. 2010. ISO/IEC FDIS 23005-3 Information Technology -- Media context and control- Part 3: Sensory information. International Standards Organization (ISO).Google ScholarGoogle Scholar
  22. ISO. 2007. ISO/IEC 8589 Sensory analysis—General guidance for the design of test rooms. International Standards Organization (ISO).Google ScholarGoogle Scholar
  23. ISO. 2008. ISO 5492:2008 Sensory analysis—Vocabulary. International Standards Organization (ISO).Google ScholarGoogle Scholar
  24. ISO. 2006. ISO 5496:2006 Sensory analysis—Methodology—Initiation and training of assessors in the detection and recognition of odours. International Standards Organization (ISO).Google ScholarGoogle Scholar
  25. ITU. 2002. ITU-T BT.500. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union (ITU).Google ScholarGoogle Scholar
  26. ITU. 2008. ITU-T P.910. Subjective video quality assessment methods for multimedia applications. International Telecommunication Union (ITU).Google ScholarGoogle Scholar
  27. J. N. Kaye. 2001. Symbolic olfactory display. M. S. Thesis, Massachusetts Institute of Technology, Cambridge, MA.Google ScholarGoogle Scholar
  28. J.-S. Lee, L. Goldmann, and T. Ebrahimi. 2011. A new analysis method for paired comparison and its application to 3D quality assessment. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11). 1281--1284. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. B. Longino. 1999. A century in the arts. Atlanta J. Constitut.Google ScholarGoogle Scholar
  30. N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013a. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). 162--171. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013b. Age and gender influence on perceived olfactory and visual media synchronization. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'13). 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  32. N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014a. Olfaction enhanced multimedia: A survey of application domains, displays and research challenges. ACM Comput. Surv. (To appear)Google ScholarGoogle Scholar
  33. N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014b. User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimedia Comput. Commun. Appl. 10, 1s, Article 11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. N. Murray. 2013. Questionnaire for special sssue on MulseMedia (TOMCCAP). http://www.niallmurray.info/Research/appendix.Google ScholarGoogle Scholar
  35. T. Nakamoto, S. Otaguro, M. Kinoshita, M. Nagahama, K. Ohinishi, and T. Ishida. 2008. Cooking up an interactive olfactory game display. IEEE Comput. Graph. Appl. 28, 1, 75--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. T. Nakamoto and H. P. D. Minh. 2007. Improvement of olfactory display using solenoid valves. In Proceedings of the IEEE Virtual Reality Conference (VR'07). 179--186.Google ScholarGoogle ScholarCross RefCross Ref
  37. T. Nakamoto and K. Yoshikawa. 2006. Movie with scents generated by olfactory display using solenoid valves. IEICE Trans. Fund. Electr. Commun. Comput. Sci. E89-A, 11, 3327--3332. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, and M. Hirose. 2011. Augmented reality flavors: Gustatory display based on edible marker and cross-modal interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 93--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. D. Noguchi, S. Sugimoto, Y. Bannai, and K. Okada. 2011. Time characteristics of olfaction in a single breath. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 83--92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. J. Pair, B. Allen, M. Dautricourt, A. Treskunov, M. Liewer, K. Graap, and G. Reger. 2006. A virtual reality exposure therapy application for Iraq war post traumatic stress disorder. In Proceedings of the IEEE Virtual Reality Conference. 67--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. L. Shams and A. R. Seitz. 2008. Benefits of multisensory learning. Trends Cogn. Sci. 12, 11, 411--417.Google ScholarGoogle ScholarCross RefCross Ref
  42. B. S. Spencer. 2006. Incorporating the sense of smell into patient and haptic surgical simulators. IEEE Trans. Inf. Technol. Biomed. 10, 1, 168--173. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. R. Steinmetz. 1996. Human perception of jitter and media synchronization. IEEE J. Select. Areas Commun. 14, 1, 61--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. S. Sugimoto, D. Noguchi, Y. Bannai, and K. Okada. 2010. Ink jet olfactory display enabling instantaneous switches of scents. In Proceedings of the ACM International Conference on Multimedia (MM'10). 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. J. Tillotson. 2008. Scentsory Design®: Scent whisper and fashion fluidics. In Transdisciplinary Digital Art. Sound, Vision and the New Screen, Communication in Computer and Information Science, Vol. 7, Springer-Verlag, Berlin Heidelberg, 403--417.Google ScholarGoogle Scholar
  46. C. Timmerer, M. Waltl, B. Rainer, and H. Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process. Image Commun. 27, 8, 909--916. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. A. Tomono, S. Yamamoto, M. Utsunomiya, D. Ikei, Y. Yanagida, and K. Hosaka. 2004. Effect that the image media with scent gives to contents understanding. In Proceedings of the Human Interface Symposium. 249--254.Google ScholarGoogle Scholar
  48. D. Warnock. 2011. A subjective evaluation of multimodal notifications. In Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'11). 461--468.Google ScholarGoogle ScholarCross RefCross Ref
  49. D. A. Washburn and L. M. Jones. 2004. Could olfactory displays improve data visualization? Comput. Sci. Eng. 6, 6, 80--83. doi:10.1109/MCSE.2004.66 Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. D. A. Washburn. 2003. Olfactory use in virtual environment training. Model. Simul. 2, 3, 19--25.Google ScholarGoogle Scholar

Index Terms

  1. Multiple-Scent Enhanced Multimedia Synchronization

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!