skip to main content
research-article

The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces

Published:19 June 2018Publication History
Skip Abstract Section

Abstract

Since its introduction in 2005, the TUIO protocol has been widely employed within a multitude of usage contexts in tangible and multi-touch interaction. While its simple and versatile design still covers the core functionality of interactive tabletop systems, the conceptual and technical developments of the past decade also led to a variety of ad-hoc extensions and modifications for specific scenarios. In this paper, we present an analysis of the strengths and shortcomings of TUIO 1.1, leading to the constitution of an extended abstraction model for tangible interactive surfaces and the specification of the second-generation TUIO 2.0 protocol, along with several example encodings of existing tangible interaction concepts.

References

  1. Lisa Anthony and Jacob O. Wobbrock. 2012. $N-protractor: A Fast and Accurate Multistroke Recognizer. In Proceedings of Graphics Interface 2012 (GI '12). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 117--120. http://dl.acm.org/citation.cfm?id=2305276.2305296 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Sandra Baldassarri, Eva Cerezo, and José Ramón Beltrán. 2017. Immertable: A Configurable and Customizable Tangible Tabletop for Audiovisual and Musical Control. In Proceedings of the XVIII International Conference on Human Computer Interaction (Interaccion '17). ACM, New York, NY, USA, Article 32, 8 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Michel Beaudouin-Lafon. 2004. Designing Interaction, Not Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '04). ACM, New York, NY, USA, 15--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Mealla Cincuegrani, S. Jordà, and A. Väljamäe. 2016. Physiopucks: Increasing User Motivation by Combining Tangible and Implicit Physiological Interaction. ACM Trans. Comput.-Hum. Interact. 23, 1, Article 4 (Feb. 2016), 22 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-user Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Florian Echtler and Andreas Butz. 2012. GISpL: Gestures Made Easy. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Florian Echtler, Manuel Huber, and Gudrun Klinker. 2008. Shadow Tracking on Multi-touch Tables. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Florian Echtler and Gudrun Klinker. 2008. A Multitouch Software Architecture. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges. ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and Hand Detection for Multi-touch Interfaces Based on Maximally Stable Extremal Regions. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Matthew G. Gorbet, Maggie Orth, and Hiroshi Ishii. 1998. Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jefferson Y. Han. 2005. Multi-touch Sensing Through Frustrated Total Internal Reflection. In ACM SIGGRAPH 2005 Sketches (SIGGRAPH '05). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Martin Kaltenbrunner. 2009. reacTIVision and TUIO: A Tangible Tabletop Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2009). ACM, Banff, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Martin Kaltenbrunner. 2018. An Abstraction Framework for Tangible Interactive Surfaces. Doctoral Thesis. BauhausUniversität Weimar. http://nbn-resolving.de/urn:nbn:de:gbv:wim2--20180205--37178Google ScholarGoogle Scholar
  14. Martin Kaltenbrunner, Till Bovermann, Ross Bencina, and Enrico Costanza. 2005. TUIO - A Protocol for Table Based Tangible User Interfaces. In Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005). Vannes, France.Google ScholarGoogle Scholar
  15. Martin Kaltenbrunner and Florian Echtler. 2014. TUIO Hackathon. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2014). Dresden, Germany. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Dietrich Kammer, Jan Wojdziak, Mandy Keck, Rainer Groh, and Severin Taranko. 2010. Towards a Formalization of Multi-Touch Gestures. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 49--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 477--486. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Scott R. Klemmer, Jack Li, James Lin, and James A. Landay. 2004. Papier-Mache: Toolkit Support for Tangible Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 36, 17 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring Mobile Gaming with Flexible Devices. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 163--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. David Merrill, Jeevan Kalanithi, and Pattie Maes. 2007. Siftables: Towards Sensor Network User Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. James Patten and Hiroshi Ishii. 2007. Mechanical Constraints As Computational Constraints in Tabletop Tangible Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Raf Ramakers, Davy Vanacken, Kris Luyten, Karin Coninx, and Johannes Schöning. 2012. Carpus: A Non-intrusive User Identification Technique for Interactive Surfaces. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Christophe Scholliers, Lode Hoste, Beat Signer, and Wolfgang De Meuter. 2011. Midas: A Declarative Multi-Touch Interaction Framework. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 49--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Brygg Ullmer and Hiroshi Ishii. 1999. mediaBlocks: Tangible Interfaces for Online Media. In CHI '99 Extended Abstracts on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM systems journal (2000). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures As Point Clouds: A $P Recognizer for User Interface Prototypes. In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA, 273--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. 2009. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!