Abstract

Since its introduction in 2005, the TUIO protocol has been widely employed within a multitude of usage contexts in tangible and multi-touch interaction. While its simple and versatile design still covers the core functionality of interactive tabletop systems, the conceptual and technical developments of the past decade also led to a variety of ad-hoc extensions and modifications for specific scenarios. In this paper, we present an analysis of the strengths and shortcomings of TUIO 1.1, leading to the constitution of an extended abstraction model for tangible interactive surfaces and the specification of the second-generation TUIO 2.0 protocol, along with several example encodings of existing tangible interaction concepts.
- Lisa Anthony and Jacob O. Wobbrock. 2012. $N-protractor: A Fast and Accurate Multistroke Recognizer. In Proceedings of Graphics Interface 2012 (GI '12). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 117--120. http://dl.acm.org/citation.cfm?id=2305276.2305296 Google Scholar
Digital Library
- Sandra Baldassarri, Eva Cerezo, and José Ramón Beltrán. 2017. Immertable: A Configurable and Customizable Tangible Tabletop for Audiovisual and Musical Control. In Proceedings of the XVIII International Conference on Human Computer Interaction (Interaccion '17). ACM, New York, NY, USA, Article 32, 8 pages. Google Scholar
Digital Library
- Michel Beaudouin-Lafon. 2004. Designing Interaction, Not Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '04). ACM, New York, NY, USA, 15--22. Google Scholar
Digital Library
- S. Mealla Cincuegrani, S. Jordà, and A. Väljamäe. 2016. Physiopucks: Increasing User Motivation by Combining Tangible and Implicit Physiological Interaction. ACM Trans. Comput.-Hum. Interact. 23, 1, Article 4 (Feb. 2016), 22 pages. Google Scholar
Digital Library
- Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-user Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology. ACM. Google Scholar
Digital Library
- Florian Echtler and Andreas Butz. 2012. GISpL: Gestures Made Easy. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM. Google Scholar
Digital Library
- Florian Echtler, Manuel Huber, and Gudrun Klinker. 2008. Shadow Tracking on Multi-touch Tables. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM. Google Scholar
Digital Library
- Florian Echtler and Gudrun Klinker. 2008. A Multitouch Software Architecture. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges. ACM, New York, NY. Google Scholar
Digital Library
- Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and Hand Detection for Multi-touch Interfaces Based on Maximally Stable Extremal Regions. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 173--182. Google Scholar
Digital Library
- Matthew G. Gorbet, Maggie Orth, and Hiroshi Ishii. 1998. Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google Scholar
Digital Library
- Jefferson Y. Han. 2005. Multi-touch Sensing Through Frustrated Total Internal Reflection. In ACM SIGGRAPH 2005 Sketches (SIGGRAPH '05). ACM. Google Scholar
Digital Library
- Martin Kaltenbrunner. 2009. reacTIVision and TUIO: A Tangible Tabletop Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2009). ACM, Banff, Canada. Google Scholar
Digital Library
- Martin Kaltenbrunner. 2018. An Abstraction Framework for Tangible Interactive Surfaces. Doctoral Thesis. BauhausUniversität Weimar. http://nbn-resolving.de/urn:nbn:de:gbv:wim2--20180205--37178Google Scholar
- Martin Kaltenbrunner, Till Bovermann, Ross Bencina, and Enrico Costanza. 2005. TUIO - A Protocol for Table Based Tangible User Interfaces. In Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005). Vannes, France.Google Scholar
- Martin Kaltenbrunner and Florian Echtler. 2014. TUIO Hackathon. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2014). Dresden, Germany. Google Scholar
Digital Library
- Dietrich Kammer, Jan Wojdziak, Mandy Keck, Rainer Groh, and Severin Taranko. 2010. Towards a Formalization of Multi-Touch Gestures. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 49--58. Google Scholar
Digital Library
- Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 477--486. Google Scholar
Digital Library
- Scott R. Klemmer, Jack Li, James Lin, and James A. Landay. 2004. Papier-Mache: Toolkit Support for Tangible Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google Scholar
Digital Library
- David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 36, 17 pages. Google Scholar
Digital Library
- Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring Mobile Gaming with Flexible Devices. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 163--172. Google Scholar
Digital Library
- David Merrill, Jeevan Kalanithi, and Pattie Maes. 2007. Siftables: Towards Sensor Network User Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction. ACM. Google Scholar
Digital Library
- James Patten and Hiroshi Ishii. 2007. Mechanical Constraints As Computational Constraints in Tabletop Tangible Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google Scholar
Digital Library
- Raf Ramakers, Davy Vanacken, Kris Luyten, Karin Coninx, and Johannes Schöning. 2012. Carpus: A Non-intrusive User Identification Technique for Interactive Surfaces. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology. ACM. Google Scholar
Digital Library
- Christophe Scholliers, Lode Hoste, Beat Signer, and Wolfgang De Meuter. 2011. Midas: A Declarative Multi-Touch Interaction Framework. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 49--56. Google Scholar
Digital Library
- Brygg Ullmer and Hiroshi Ishii. 1999. mediaBlocks: Tangible Interfaces for Online Media. In CHI '99 Extended Abstracts on Human Factors in Computing Systems. ACM. Google Scholar
Digital Library
- Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM systems journal (2000). Google Scholar
Digital Library
- Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures As Point Clouds: A $P Recognizer for User Interface Prototypes. In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA, 273--280. Google Scholar
Digital Library
- Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. 2009. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google Scholar
Digital Library
- Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168. Google Scholar
Digital Library
Index Terms
The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces
Recommendations
Mouse 2.0: multi-touch meets the mouse
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technologyIn this paper we present novel input devices that combine the standard capabilities of a computer mouse with multi-touch sensing. Our goal is to enrich traditional pointer-based desktop interactions with touch and gestures. To chart the design space, we ...
Development strategies for tangible interaction on horizontal surfaces
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interactionTangible interactions on horizontal surfaces are increasingly relevant for collaborative applications, embodied interaction, musical performance, and interaction with 3D information. This unique studio opportunity introduces approaches to developing ...
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...






Comments