Teresa Chambel
ABSTRACT
In this paper we present Synesthetic Video, an interactive video that allows to experience video in cross-sensorial ways, to hear its colors and to influence its visual properties with sound and music, through user interaction or ambient influence. Our main motivations include accessibility, enriching users experiences, stimulating and supporting users creativity, and to learn more about synesthesia and how videos can influence and be influenced by users and the ambient, at the crossroads of art, science and technology.
References
- Antunes, J. 1982. A Correspondência entre os Sons e as Cores. Brasília, Ed. Thesaurus.Google Scholar
- Campen, C. van. 2008. The Hidden Sense: Synesthesia in Art and Science. Cambridge: The MIT Press.Google Scholar
- Chambel, T., Correia, L., Manzolli, J., Miguel, G. D., Henriques, N. A. C., and Correia, N. 2007. Creating Video Art with Evolutionary Algorithms. Special Issue on "Technology and Digital Art", Computer & Graphics Journal, vol 31, issue 6, pp. 837--847, Elsevier, Dec. Google ScholarDigital Library
- Chambel, T., Antunes, P., Duarte, C., Carriço, L., Guimarães, N. 2009. Reflections on Teaching Human Computer Interaction to Blind Students. In: IFIP Volume 289; Creativity and HCI: From Experience to Design in Education, edited by Paula Kotzé. William Wong, Joaquim Jorge, Alan Dix and Paula Alexandra Silva, Boston: Springer, ISBN: 978-0-387-89021-0, pp. 123--142.Google Scholar
- Cytowic, R. E. 1993. The Man who Tasted Shapes. New York: The Putnam.Google Scholar
- Cytowic, R. E., and Eagleman, D. M. 2009. Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. Cambridge: The MIT Press.Google Scholar
- Galeyev, B. M., and Vanechkina, I. L. 2001. Was Scriabin a Synesthete?. Leonardo, Vol. 34, Issue 4, pp. 357--362.Google ScholarCross Ref
- Gonçalves, A., Lopes, E., and Paiva, A. 2009. The music of paintings: a rhythmic perspective. The 12th Generative Art International Conference.Google Scholar
- Hertz, P. 1999. Synesthetic Art, an Imaginary Number? Leonardo, Vol. 32, No. 5, The MIT Press. pp. 399--404.Google Scholar
- Kandinski, W. 1977. Concerning the Spiritual in Art. Dover Publications.Google Scholar
- Kildal, J., and Brewster, S. 2006. Non-Visual Overviews of Complex Data Sets. In Proc. of ACM CHI' 2006, Montréal, Québec, Canada, April 22--27. Google ScholarDigital Library
- Levin, G. 2000. Painterly Interfaces for Audiovisual Performance. Massachusetts Institute of Technology.Google Scholar
- Lugmayr, A. 2009. Ambient Media, Ambient Media Computation, and Media Technology Beyond the Current State. In Proc. of ACM MM'2009, Beijing, China. Tutorial, pp. 923--924. Google ScholarDigital Library
- Macedo, A. R. 2010. Visible and Audible Spectrums - A proposal of Correspondence. In Proc. of Artech' 2010, 5th International Conference on Digital Arts, April 22--23, Guimarães, Portugal, pp. 168--171.Google Scholar
- Margounakis, D., and Politis, D. 2006. Converting Images to Music Using their Color Properties. In Proc. of the 12th Int. Conf. on Auditory Display, London, UK, Jun.Google Scholar
- Martinho, J., and Chambel, T. 2009. ColorsInMotion: Interactive Visualization and Exploration of Video Spaces. In Proc. of ACM Academic MindTrek'2009: Everyday Life in the Ubiquitous Era, Tampere, Finland, Sep-Oct. Google ScholarDigital Library
- MetaSynth 5: Electronic music studio and sound designer's dream tool for Mac OS X, http://www.uisoftware.com/MetaSynth/Google Scholar
- Moritz, W. 1997. The Dream of Color Music, And Machines That Made it Possible. Animation World Magazine 2 (1).Google Scholar
- Moroni, A., J. Manzolli, and F. von Zuben. 2006. ArTbitrating JaVox: Evolution applied to Visual and Sound Composition. In Proc. of SIACG'2006, Santiago de Compostela, Spain, 5--7 Jul.Google Scholar
- Mulvenna, C. M. 2007. Synaesthesia, the arts and creativity: A neurological connection. In Neurological Disorders in Famous Artists - Part 2, Chapter 13. Karger.Google Scholar
- Peacock, K. 1988. Instruments to Perform Color-Music: Two Centuries of Technological Exploration. Leonardo, Journal of the International Society for The Arts, Sciences and Technology, 21(4): 397--406.Google Scholar
- Ramachandran, V., and Hubbard, E. 2003. Hearing Colors, Tasting Shapes. Scientific American, Apr.Google Scholar
- Rocha, T., and Chambel, T. 2008. VideoSpace: a 3D Video Experience. Installation, in Proc. of Artech'2008, 4th International Conference on Digital Arts, pp. 305--310, Portuguese Catholic University, Porto, Portugal, Nov.Google Scholar
- Saenz, M., and Koch, C. 2008. The sound of change: visually-induced auditory synesthesia. Current Biology, 18(15):650--651, Aug.Google ScholarCross Ref
- Synesthesia ArtForum, http://synesthesia-artforum.blogspot.com/Google Scholar
- The vOICe: Augmented Reality for the Totally Blind, http://www.seeingwithsound.com/Google Scholar
Index Terms
Synesthetic video
Comments