skip to main content
research-article

INFEX: A Unifying Framework for Cross-Device Information Exploration and Exchange

Published:19 June 2018Publication History
Skip Abstract Section

Abstract

In our daily lives we are witnessing a proliferation of digital devices including tablets, smartphones, digital cameras or wearable appliances. A major effort has been made to enable these devices to exchange information in intelligent spaces and collaborative settings. However, the arising technical challenges often manifest themselves to end users as limitations, inconsistencies or added complexity. A wide range of existing and emerging devices cannot be used with existing solutions for cross-device information exchange due to restrictions in terms of the supported communication protocols, hardware or media types. We present INFEX, a general and extensible framework for cross-device information exploration and exchange. While existing solutions often support a restricted set of devices and networking protocols, our unifying and extensible INFEX framework enables information exchange and exploration across arbitrary devices and also supports devices that cannot run custom software or do not offer their own I/O modalities. The plug-in based INFEX architecture allows developers to provide custom but consistent user interfaces for information exchange and exploration across a heterogeneous set of devices.

References

  1. Monica Anderson. 2015. Technology Device Ownership: 2015. http://www.pewinternet.org/2015/10/29/ technology-device-ownership-2015Google ScholarGoogle Scholar
  2. Pierre-Alain Avouac, Philippe Lalanda, and Laurence Nigay. 2012. Autonomic Management of Multimodal Interaction: DynaMo in action. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2012). Copenhagen, Denmark. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jakob E. Bardram. 2005. The Java Context Awareness Framework (JCAF) - A Service Infrastructure and Programming Framework for Context-Aware Applications. In Proceedings of the 3rd IEEE International Conference on Pervasive Computing and Communications (PerCom 2005). Kauai Island, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jacob T. Biehl, William T. Baker, Brian P. Bailey, Desney S. Tan, Kori M. Inkpen, and Mary Czerwinski. 2008. Impromptu: A New Interaction Framework for Supporting Collaboration in Multiple Display Environments and its Field Evaluation for Co-located Software Development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008). Florence, Italy. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Raimund Dachselt and Robert Buchholz. 2009. Natural Throw and Tilt Interaction Between Mobile Phones and Distant Displays. In CHI 2009 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2009). Boston USA, 3253--3258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Andreas Dippon, Norbert Wiedermann, and Gudrun Klinker. 2012. Seamless Integration of Mobile Devices into Interactive Surface Environments. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2012). Cambridge, USA, 331--334. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. W. Keith Edwards, Mark W. Newman, and Erika Shehan Poole. 2010. The Infrastructure Problem in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010). Atlanta, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Luca Frosini, Marco Manca, and Fabio Paternò. 2013. A Framework for the Development of Distributed Interactive Applications. In Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2013). London, UK, 249--254. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Issac Garcia, Gabriel Pedraza, Bassem Debbabi, Philippe Lalanda, and Catherine Hamon. 2010. Towards a Service Mediation Framework for Dynamic Applications. In Proceedings of the IEEE Asia-Pacific Services Computing Conference ((APSCC 2010). Hangzhou, China. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hans Gellersen, Carl Fischer, Dominique Guinard, Roswitha Gostner, Gerd Kortuem, Christian Kray, Enrico Rukzio, and Sara Streng. 2009. Supporting Device Discovery and Spontaneous Interaction with Spatial References. Personal Ubiquitous Computing 13, 4 (May 2009), 255--264. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1 (January 2011), 42--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: Enabling and Understanding Cross-device Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada, 2773--2782. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Mike Hazas, Christian Kray, Hans Gellersen, Henoc Agbota, Gerd Kortuem, and Albert Krohn. 2005. A Relative Positioning System for Co-located Mobile Devices. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys 2005). Seattle, USA, 177--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Simo Hosio, Fahim Kawsar, Jukka Riekki, and Tatsuo Nakajima. 2007. DroPicks - A Tool for Collaborative Content Sharing Exploiting Everyday Artefacts. In Ubiquitous Computing Systems, Haruhisa Ichikawa, We-Duke Cho, Ichiro Satoh, and HeeYong Youn (Eds.). Lecture Notes in Computer Science, Vol. 4836. 258--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric CrossDevice Applications. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Republic of Korea, 1247--1256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Steven Houben, Paolo Tell, and Jakob E. Bardram. 2014. ActivitySpace: Managing Device Ecologies in an ActivityCentric Configuration Space. In Proceedings of the 9th ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Shahram Izadi, Harry Brignull, Tom Rodden, Yvonne Rogers, and Mia Underwood. 2003. Dynamo: A Public Interactive Surface Supporting the Cooperative Sharing and Exchange of Media. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST 2003). Vancouver, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Clemens Nylandsted Klokmose, Janus Bager Kristensen, Rolf Bagge, and Kim Halskov. 2014. BullsEye: High-Precision Fiducial Tracking for Table-based Tangible Interaction. In Proceedings of the 9th ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany, 269--278. https://doi.org/2669485.2669503 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Ming Li and Leif Kobbelt. 2012. Dynamic Tiling Display: Building an Interactive Display Surface Using Multiple Mobile Devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM 2012). Ulm, Germany, Article 24, 24:1--24:4 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011). Vancouver, Canada, 1787--1796. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual Engagement: Facilitating Information Exchange Between Digital Devices As a Function of Proximity. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2012). Cambridge, USA, 31--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-mobility and Fformations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST 2012). Cambridge, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jakob Nielsen. 1989. Coordinating User Interfaces for Consistency. SIGCHI Bull. 20, 3 (January 1989), 63--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany, 45--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jun Rekimoto. 1997. Pick-and-drop: A Direct Manipulation Technique for Multiple Computer Environments. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST 1997). 31--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1999). Pittsburgh, USA, 378--385. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Iván Sánchez, Jukka Riekki, Jarkko Rousu, and Susanna Pirttikangas. 2008. Touch & Share: RFID Based Ubiquitous File Containers. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia (MUM 2008). Umeå, Sweden, 57--63. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A Cross-device Interaction Style for Mobiles and Surfaces. In Proceedings of the Designing Interactive Systems Conference (DIS 2012). Newcastle Upon Tyne, UK, 318--327. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Arne Schmitz, Ming Li, Volker Schönefeld, and Leif Kobbelt. 2010. Ad-hoc Multi-Displays for Mobile Interactive Applications. In Proceedings of the 31st Annual Conference of the European Association for Computer Graphics (Eurographics 2010), Vol. 29. 8.Google ScholarGoogle Scholar
  30. Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2015). Seoul, Republic of Korea. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Khoovirajsingh Seewoonauth, Enrico Rukzio, Robert Hardy, and Paul Holleis. 2009. Touch & Connect and Touch & Select: Interacting with a Computer by Touching It with a Mobile Phone. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009). Bonn, Germany, 36:1--36:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Khoovirajsingh Seewoonauth, Enrico Rukzio, Robert Hardy, and Paul Holleis. 2009. Two NFC Interaction Techniques for Quickly Exchanging Pictures Between a Mobile Phone and a Computer. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009). Bonn, Germany, 39:1--39:4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Manas Tungare, Pardha S. Pyla, Pradyut Bafna, Vladimir Glina, Wenjie Zheng, Xiaoyan Yu, Umut Balli, and Steven Harrison. 2006. Embodied Data Objects: Tangible Interfaces to Information Appliances. In Proceedings of the 44th Annual Southeast Regional Conference (ACM-SE 44). Melbourne, USA, 359--364. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39, 3.4 (2000), 915--931. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Daniel Wigdor, Hao Jiang, Clifton Forlines, Michelle Borkin, and Chia Shen. 2009. WeSpace: The Design Development and Deployment of a Walk-up and Share Multi-surface Visual Collaboration System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009). Boston, USA. https://doi.org/1518701.1518886 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Andrew D. Wilson and Raman Sarin. 2007. BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-based Handshaking. In Proceedings of Graphics Interface, Conference on Graphics, Visualization and HCI (GI 2007). Montreal, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Christian Winkler, Markus Löchtefeld, David Dobbelstein, Antonio Krüger, and Enrico Rukzio. 2014. SurfacePhone: A Mobile Projection Device for Single- and Multiuser Everywhere Tabletop Interaction. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada, 3513--3522. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. INFEX: A Unifying Framework for Cross-Device Information Exploration and Exchange

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!