Xin Wei Sha
ABSTRACT
No matter what how the image is computationally produced, screen-based graphics are still typically presented on a two-dimensional surface like a screen, wall, or electronic paper. The limit of manipulating objects in a two-dimensional graphical display is where each pixel is an independent object. These two observations motivate the development of calligraphic video, textures that can be manipulated by the user using intuitions about physical material such as water, ink, or smoke. We argue for a phenomenological approach to complex visual interaction based on corporeal kinesthetic intuition, and provide an effective way to provide such texture-based interaction using computational physics. A motivating application is to create palpable, highly textured video that can be projected as structured light fields in responsive environments.
- L. Adams, M. Montanaro, and X. W. Sha, "Frankenstein's Ghosts (Blue Riders and Topological Media Lab).Google Scholar
- K. M. Barad, Meeting the universe halfway: quantum physics and the entanglement of matter and meaning. Durham: Duke University Press, 2007. {Online}. Available: http://www.loc.gov/catdir/toc/ecip0619/2006027826.htmlGoogle Scholar
- A. J. Chorin and J. E. Marsden, A Mathematical Introduction to Fluid Mechanics, 3rd ed., ser. Texts in Applied Mathematics. Springer, 1998.Google Scholar
- J. Cohen, M. Olano, and D. Manocha, "Appearance-preserving simplification," in SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques. New York, NY, USA: ACM, 1998, pp. 115--122. Available: http://www.cs.unc.edu/ geom/APS/APS.pdf Google ScholarDigital Library
- K. Crane, I. Llamas, and S. Tariq, GPU Gems 3, 1st ed. Addison-Wesley, 2007, ch. Real-Time Simulation and Rendering of 3D Fluids, pp. 633--675.Google Scholar
- jit.repos Reference, Cycling '74. {Online}. Available: http://www.cycling74.com/docs/max5/refpages/jitref/ jit.repos.htmlGoogle Scholar
- P. Dourish, Where the action is: the foundations of embodied interaction. Cambridge, Mass.: MIT Press, 2001. {Online}. Available: http://www.loc.gov/catdir/toc/fy036/2001030443.htmlGoogle Scholar
- R. Fedkiw, J. Stam, and H. W. Jensen, "Visual simulation of smoke," in Proceedings of ACM SIGGRAPH 2001, ser. Computer Graphics Proceedings, Annual Conference Series, Aug. 2001, pp. 15--22. Google ScholarDigital Library
- E. T. Gendlin, Experiencing and the Creation of Meaning: A Philosophical and Psychological Approach to the Subjective. Northwestern University Press, 1997.Google Scholar
- R. Gerber, A. J. Bik, K. B. Smith, and X. Tian, The Software Optimization Cookbook, 2nd ed., D. B. Spencer, Ed. Intel Press, 2006. Google ScholarDigital Library
- M. J. Harris, GPU Gems - Programming Techniques, Tips, and Tricks for Real-Time Graphics. Addison-Wesley, 2004, ch. Fast Fluid Dynamics Simulation on the GPU. {Online}. Available: http://http.developer.nvidia.com/GPUGems/gpugems_ch38.htmlGoogle Scholar
- E. Husserl, Ideas pertaining to a pure phenomenology and to a phenomenological philosophy, ser. Collected works / Edmund Husserl. The Hague: M. Nijhoff, 1982, vol. 1 2.Google Scholar
- G. Irving, E. Guendelman, F. Losasso, and R. Fedkiw, "Efficient simulation of large bodies of water by coupling two and three dimensional techniques," ACM Trans. Graph., vol. 25, no. 3, pp. 805--811, 2006. Google ScholarDigital Library
- C. Jacquemin, "Allegra: a new instrument for bringing interactive graphics to life, in MM '08: Proceeding of the 16th ACM international conference on Multimedia. New York, NY, USA: ACM, 2008, pp. 961--964. Google ScholarDigital Library
- T. Kim, "Hardware-aware analysis and optimization of stable fluids," in I3D '08: Proceedings of the 2008 symposium on Interactive 3D graphics and games. New York, NY, USA: ACM, 2008, pp. 99--106. Google ScholarDigital Library
- L. Loke, A. T. Larssen, T. Robertson, and J. Edwards, "Understanding movement for interaction design: frameworks and approaches," Personal Ubiquitous Comput., vol. 11, no. 8, pp. 691--701, 2007. Google ScholarDigital Library
- H. R. Maturana and F. J. Varela, Autopoiesis and Cognition : The Realization of the Living, Boston Studies in the Philosophy of Science, Vol. 42. D. Reidel Pub. Co., 1980.Google Scholar
- F. Neyret and N. Praizelin, "Phenomenological simulation of brooks," in Proceedings of the Eurographic workshop on Computer animation and simulation. New York, NY, USA: Springer-Verlag New York, Inc., 2001, pp. 53--64. Google ScholarDigital Library
- J. Petitot, Morphogenesis of meaning. Bern: P. Lang, 2004, vol. 3.Google Scholar
- X. W. Sha, "Topological media lab," Concordia University (Georgia Institute of Technology 2001--2005), Tech. Rep., 2001--2006.Google Scholar
- , "Resistance is fertile: Gesture and agency in the field of responsive media," Configurations, vol. 10, no. 3, pp. 439--472, 2002.Google ScholarCross Ref
- X. W. Sha, T. Sutton, J.-S. Rousseau, H. C. Smoak, M. Fortin, and M. Sutherland, "Ozone: A continuous state-based approach to media choreography," Concordia University, Topological Media Lab, Tech. Rep., 2009, submitted to ACM Multimedia 2009.Google Scholar
- J. Stam, "Stable fluids," in SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques. New York, NY, USA: ACM Press/Addison-Wesley Publishing Co., 1999, pp. 121--128. {Online}. Available: http://www.dgp.toronto.edu/people/stam/reality/Research/ pdf/ns.pdf Google ScholarDigital Library
- R. Thom, Mathematical models of morphogenesis. Chichester: Ellis Horwood, 1983.Google Scholar
- ---, Structural stability and morphogenesis: an outline of a general theory of models. Reading, Mass.: Addison-Wesley Pub., 1989.Google Scholar
- J. Varona, A. J. i Capó, J. Gonzàlez, and F. J. Perales, "Toward natural interaction through visual recognition of body gestures in real-time," Interacting with Computers, vol. 21, no. 1-2, Special issue: Enactive Interfaces, pp. 3--10, January 2009. Google ScholarDigital Library
- Y. Visell, "Tactile sensory substitution: Models for enaction in hci," Interact. Comput., vol. 21, no. 1--2, pp. 38--53, 2009. Google ScholarDigital Library
- A. Webb, A., E. Koh, P. Joshi, Y. Park, and R. Graeber, "Choreographic buttons: Promoting social interaction through human movement and clear affordances." Santa Barbara: ACM Multimedia, October 2006. Google ScholarDigital Library
- K. A. Woolford and C. Guedes, "Particulate matters: generating particle flows from human movement," in MULTIMEDIA '07: Proceedings of the 15th international conference on Multimedia. New York, NY, USA: ACM, 2007, pp. 691--696. Google ScholarDigital Library
- C. Woolley, GPU Gems 2 - Programming Techniques for High-Performance Graphics and General-Purpose Computation. Addison Wesley, 2005, ch. GPU Program Optimization. {Online}. Available: http://http.developer.nvidia.com/GPUGems2/gpugems2_ chapter35.html Google ScholarDigital Library
Index Terms
Calligraphic video: a phenomenological approach to dense visual interaction
Comments