Brygg Ullmer
ABSTRACT
We describe an approach for a class of tangible interaction elements that are applicable across a broad variety of interactive systems. These tangibles share certain physical, visual, tagging, and software conventions, while fostering diversity in many aspects of design and function. Building on related techniques using paper and graspable artifacts as interactive embodiments of digital information, we propose several fixed and free parameters, present illustrative examples and applications, and discuss the resulting design space.
- Packaging -- bar code and two-dimensional symbols for shipping, transport and receiving labels. ISO/DIS 15394 (draft), 2007.Google Scholar
- Encyclopédie Larousse en Ligne, chapter Cartouche. 2009.Google Scholar
- M. Back, J. Cohen, R. Gold, S. Harrison, and S. Minneman. Listen reader: an electronically augmented paper-based book. In Proc. of CHI '01, pp. 23--29. Google ScholarDigital Library
- A. Blackwell, M. Stringer, E. Toye, and J. Rode. Tangible interface for collaborative information retrieval. In Proc. of CHI'04, pp. 1473--1476. Google ScholarDigital Library
- E. Blevis. Two digital divides and four perspectives. interactions, pp. 61--66, January+February 2008. Google ScholarDigital Library
- L. Bolotnyy and G. Robins. Multi-tag rfid systems. Int. J. Internet Protocol Technology, 2(3/4):218--231, 2007. Google ScholarDigital Library
- J. Buur and A. Soendergaard. Video card game: an augmented environment for user centred design discussions. In Proc. of DARE '00, pp. 63--69. Google ScholarDigital Library
- J.-F. Champollion. Lettre à M. Dacier relative à l'alphabet des hiéroglyphes. Fata Morgan, Paris, 1989.Google Scholar
- T. Chapman, V. Le, C. Ballesty, and A. Edwards. Rfid encoder and verifier. U.S. Patent 0230478, 2005.Google Scholar
- N. Couture, G. Riviére, and P. Reuter. Geotui: a tangible user interface for geoscience. In Proc. of TEI'08, pp. 89--96. Google ScholarDigital Library
- EVL. Tactile: A high-definition multi-touch lcd display designed for the visual exporation of scientific datasets. http://www.evl.uic.edu/cavern/tactile/.Google Scholar
- G. Fitzmaurice, H. Ishii, and W. Buxton. Bricks: laying the foundations for graspable user interfaces. In Proc. of CHI '95, pp. 442--449. Google ScholarDigital Library
- T. Friedman. The World is Flat. Farrar, 2006.Google Scholar
- J. Gibson. The theory of affordances. Perceiving, acting and knowing: toward an ecological psychology, pp. 67--82, 1977.Google Scholar
- L. Holmquist, J. Redström, and P. Ljungstrand. Token-based access to digital information. Proc. of HUC'99, pp. 234--245. Google ScholarDigital Library
- L. Holmquist, A. Schmidt, and B. Ullmer. Tangible interfaces in perspective. Personal and Ubiquitous Computing, 8(5):291--293, 2004. Google ScholarDigital Library
- E. Hornecker, R. Jacob, C. Hummels, B. Ullmer, A. Schmidt, E. van der Hoven, and A. Mazalek. Tei goes on: Tangible and embedded interaction. IEEE Pervasive Computing Magazing/Journal, 7(2):91--96, April-June 2008.Google Scholar
- H. Ishii and B. Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proc. of CHI '97, pp. 234--241. Google ScholarDigital Library
- R. Jacob, A. Girouard, L. Hirshfield, M. Horn, O. Shaer, E. Solovey, and J. Zigelbaum. Reality-based interaction: a framework for post-WIMP interfaces. Proc. of CHI'08. Google ScholarDigital Library
- S. Klemmer, W. Newman, R. Farrell, M. Bilezikjian, and J. Landay. The designers' outpost: a tangible interface for collaborative web site design. In Proc. of UIST'01, pp. 1--10. Google ScholarDigital Library
- M. Konkel, V. Leung, B. Ullmer, and C. Hu. Tagaboo: a collaborative children's game based upon wearable RFID technology. Personal and Ubiquitous Computing, 8(5):382--384, 2004. Google ScholarCross Ref
- M. Kumpf. Trackmate: Large-scale accessibility of tangible user interfaces. Master's thesis, MIT, 2009.Google Scholar
- W. Mackay and D. Pagani. Video Mosaic: Laying out time in a physical space. In Proc. of Multimedia'94, pp. 165--172. Google ScholarDigital Library
- D. McGee, P. Cohen, and L. Wu. Something from nothing: augmenting a paper-based work practice via multimodal interaction. In Proc. of DARE'00, pp. 71--80. Google ScholarDigital Library
- A. Mohan, G. Woo, S. Hiura, Q. Smithwick, and R. Raskar. Bokode: imperceptible visual tags for camera based interaction from a distance. Proc. of SIGGRAPH'09, 28(3):1--8. Google ScholarDigital Library
- L. Nelson, S. Ichimura, E. Pedersen, and L. Adams. Palette: a paper interface for giving presentations. In Proc. of CHI'99, pp. 354--361. Google ScholarDigital Library
- J. Patten, H. Ishii, J. Hines, and G. Pangaro. Sensetable: a wireless object tracking platform for tangible user interfaces. In Proc. of CHI'01, pp. 253--260. Google ScholarDigital Library
- R. Perlman. Using computer technology to provide a creative learning environment for preschool children. MIT Lego Memo, #24, 1976.Google Scholar
- M. Rauterberg, M. Fjeld, H. Krueger, M. Bichsel, U. Leonhardt, and M. Meier. Build-it: a planning tool for construction and design. In Proc. of CHI'98, pp. 177--178. Google ScholarDigital Library
- J. Rekimoto, B. Ullmer, and H. Oba. Datatiles: a modular platform for mixed physical and graphical interactions. In Proc. of CHI '01, pp. 269--276, 2001. Google ScholarDigital Library
- S. Rossini. Egyptian Hieroglyphics: How to Read and Write Them. Courier Dover Publications, New York, 1989.Google Scholar
- R. Sankaran, B. Ullmer, J. Ramanujam, K. Kallakuri, S. Jandhyala, C. Toole, and C. Laan. Decoupling interaction hardware design using libraries of reusable electronics. In Proc. of TEI '09, pp. 331--337. Google ScholarDigital Library
- B. Signer and M. Norrie. Paperpoint: a paper-based presentation and interactive paper prototyping tool. In Proc. of TEI'07, pp. 57--64. Google ScholarDigital Library
- T. Sokoler, H. Edeholt, and M. Johansson. VideoTable: a tangible interface for collaborative exploration of video material during design sessions. In Proc. of CHI'02, pp. 656--657. Google ScholarDigital Library
- L. Stifelman, B. Arons, and C. Schmandt. The audio notebook: paper and pen interaction with structured speech. In Proc. of CHI '01, pp. 182--189. Google ScholarDigital Library
- B. Ullmer, H. Ishii, and R. Jacob. Token+constraint systems for tangible interaction with digital information. ACM Transaction on Computer-Human Interaction (TOCHI), 12(1):81--118, 2005. Google ScholarDigital Library
- B. Ullmer, R. Sankaran, S. Jandhyala, B. Tregre, C. Toole, K. Kallakuri, C. Laan, M. Hess, F. Harhad, U. Wiggins, et al. Tangible menus and interaction trays: core tangibles for common physical/digital activities. In Proc. of TEI'08, pp. 209--212. Google ScholarDigital Library
- B. Ullmer, A. Schmidt, E. Hornecker, C. Hummels, R. Jacob, and E. Hoven. Tangible and embedded interaction (preface). In Proc. of TEI'07. Google Scholar
- J. Underkoffler and H. Ishii. Illuminating light: an optical design tool with a luminous-tangible interface. In Proc. of CHI'98, pp. 542--549. Google ScholarDigital Library
- J. Underkoffler, B. Ullmer, and H. Ishii. Emancipated pixels: real-world graphics in the luminous room. In Proc. of SIGGRAPH'99, pp. 385--392. Google ScholarDigital Library
- P. Wellner. Interacting with paper on the digital desk. Communications of the ACM, 36(7):86, 1993. Google ScholarDigital Library
- R. Yeh, C. Liao, S. Klemmer, F. Guimbretière, B. Lee, B. Kakaradov, J. Stamberger, and A. Paepcke. Butterflynet: a mobile capture and access system for field biology research. In Proc. of CHI'06, pp. 571--580. Google ScholarDigital Library
Index Terms
Cartouche: conventions for tangibles bridging diverse interactive systems
Recommendations
Tangible menus and interaction trays: core tangibles for common physical/digital activities
We introduce core tangibles: physical interaction elements which serve common roles across a variety of tangible and embedded interfaces. We describe two such tangibles: tangible menus and interaction trays. These may be composed together to dynamically ...
Casier: structures for composing tangibles and complementary interactors for use across diverse systems
Casiers are a class of tangible interface elements that structure the physical and functional composition of tangibles and complementary interactors (e.g., buttons and sliders). Casiers allow certain subsets of interactive functionality to be accessible ...
Reality-based interaction: a framework for post-WIMP interfaces
We are in the midst of an explosion of emerging human-computer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a ...
Comments