Abstract

In our daily lives we are witnessing a proliferation of digital devices including tablets, smartphones, digital cameras or wearable appliances. A major effort has been made to enable these devices to exchange information in intelligent spaces and collaborative settings. However, the arising technical challenges often manifest themselves to end users as limitations, inconsistencies or added complexity. A wide range of existing and emerging devices cannot be used with existing solutions for cross-device information exchange due to restrictions in terms of the supported communication protocols, hardware or media types. We present INFEX, a general and extensible framework for cross-device information exploration and exchange. While existing solutions often support a restricted set of devices and networking protocols, our unifying and extensible INFEX framework enables information exchange and exploration across arbitrary devices and also supports devices that cannot run custom software or do not offer their own I/O modalities. The plug-in based INFEX architecture allows developers to provide custom but consistent user interfaces for information exchange and exploration across a heterogeneous set of devices.
- Monica Anderson. 2015. Technology Device Ownership: 2015. http://www.pewinternet.org/2015/10/29/ technology-device-ownership-2015Google Scholar
- Pierre-Alain Avouac, Philippe Lalanda, and Laurence Nigay. 2012. Autonomic Management of Multimodal Interaction: DynaMo in action. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2012). Copenhagen, Denmark. Google Scholar
Digital Library
- Jakob E. Bardram. 2005. The Java Context Awareness Framework (JCAF) - A Service Infrastructure and Programming Framework for Context-Aware Applications. In Proceedings of the 3rd IEEE International Conference on Pervasive Computing and Communications (PerCom 2005). Kauai Island, USA. Google Scholar
Digital Library
- Jacob T. Biehl, William T. Baker, Brian P. Bailey, Desney S. Tan, Kori M. Inkpen, and Mary Czerwinski. 2008. Impromptu: A New Interaction Framework for Supporting Collaboration in Multiple Display Environments and its Field Evaluation for Co-located Software Development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008). Florence, Italy. Google Scholar
Digital Library
- Raimund Dachselt and Robert Buchholz. 2009. Natural Throw and Tilt Interaction Between Mobile Phones and Distant Displays. In CHI 2009 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2009). Boston USA, 3253--3258. Google Scholar
Digital Library
- Andreas Dippon, Norbert Wiedermann, and Gudrun Klinker. 2012. Seamless Integration of Mobile Devices into Interactive Surface Environments. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2012). Cambridge, USA, 331--334. Google Scholar
Digital Library
- W. Keith Edwards, Mark W. Newman, and Erika Shehan Poole. 2010. The Infrastructure Problem in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010). Atlanta, USA. Google Scholar
Digital Library
- Luca Frosini, Marco Manca, and Fabio Paternò. 2013. A Framework for the Development of Distributed Interactive Applications. In Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2013). London, UK, 249--254. Google Scholar
Digital Library
- Issac Garcia, Gabriel Pedraza, Bassem Debbabi, Philippe Lalanda, and Catherine Hamon. 2010. Towards a Service Mediation Framework for Dynamic Applications. In Proceedings of the IEEE Asia-Pacific Services Computing Conference ((APSCC 2010). Hangzhou, China. Google Scholar
Digital Library
- Hans Gellersen, Carl Fischer, Dominique Guinard, Roswitha Gostner, Gerd Kortuem, Christian Kray, Enrico Rukzio, and Sara Streng. 2009. Supporting Device Discovery and Spontaneous Interaction with Spatial References. Personal Ubiquitous Computing 13, 4 (May 2009), 255--264. Google Scholar
Digital Library
- Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1 (January 2011), 42--50. Google Scholar
Digital Library
- Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: Enabling and Understanding Cross-device Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada, 2773--2782. Google Scholar
Digital Library
- Mike Hazas, Christian Kray, Hans Gellersen, Henoc Agbota, Gerd Kortuem, and Albert Krohn. 2005. A Relative Positioning System for Co-located Mobile Devices. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys 2005). Seattle, USA, 177--190. Google Scholar
Digital Library
- Simo Hosio, Fahim Kawsar, Jukka Riekki, and Tatsuo Nakajima. 2007. DroPicks - A Tool for Collaborative Content Sharing Exploiting Everyday Artefacts. In Ubiquitous Computing Systems, Haruhisa Ichikawa, We-Duke Cho, Ichiro Satoh, and HeeYong Youn (Eds.). Lecture Notes in Computer Science, Vol. 4836. 258--265. Google Scholar
Digital Library
- Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric CrossDevice Applications. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Republic of Korea, 1247--1256. Google Scholar
Digital Library
- Steven Houben, Paolo Tell, and Jakob E. Bardram. 2014. ActivitySpace: Managing Device Ecologies in an ActivityCentric Configuration Space. In Proceedings of the 9th ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany. Google Scholar
Digital Library
- Shahram Izadi, Harry Brignull, Tom Rodden, Yvonne Rogers, and Mia Underwood. 2003. Dynamo: A Public Interactive Surface Supporting the Cooperative Sharing and Exchange of Media. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST 2003). Vancouver, Canada. Google Scholar
Digital Library
- Clemens Nylandsted Klokmose, Janus Bager Kristensen, Rolf Bagge, and Kim Halskov. 2014. BullsEye: High-Precision Fiducial Tracking for Table-based Tangible Interaction. In Proceedings of the 9th ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany, 269--278. https://doi.org/2669485.2669503 Google Scholar
Digital Library
- Ming Li and Leif Kobbelt. 2012. Dynamic Tiling Display: Building an Interactive Display Surface Using Multiple Mobile Devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM 2012). Ulm, Germany, Article 24, 24:1--24:4 pages. Google Scholar
Digital Library
- Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011). Vancouver, Canada, 1787--1796. Google Scholar
Digital Library
- Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual Engagement: Facilitating Information Exchange Between Digital Devices As a Function of Proximity. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2012). Cambridge, USA, 31--40. Google Scholar
Digital Library
- Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-mobility and Fformations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST 2012). Cambridge, USA. Google Scholar
Digital Library
- Jakob Nielsen. 1989. Coordinating User Interfaces for Consistency. SIGCHI Bull. 20, 3 (January 1989), 63--65. Google Scholar
Digital Library
- Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS 2014). Dresden, Germany, 45--54. Google Scholar
Digital Library
- Jun Rekimoto. 1997. Pick-and-drop: A Direct Manipulation Technique for Multiple Computer Environments. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST 1997). 31--39. Google Scholar
Digital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1999). Pittsburgh, USA, 378--385. Google Scholar
Digital Library
- Iván Sánchez, Jukka Riekki, Jarkko Rousu, and Susanna Pirttikangas. 2008. Touch & Share: RFID Based Ubiquitous File Containers. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia (MUM 2008). Umeå, Sweden, 57--63. Google Scholar
Digital Library
- Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A Cross-device Interaction Style for Mobiles and Surfaces. In Proceedings of the Designing Interactive Systems Conference (DIS 2012). Newcastle Upon Tyne, UK, 318--327. Google Scholar
Digital Library
- Arne Schmitz, Ming Li, Volker Schönefeld, and Leif Kobbelt. 2010. Ad-hoc Multi-Displays for Mobile Interactive Applications. In Proceedings of the 31st Annual Conference of the European Association for Computer Graphics (Eurographics 2010), Vol. 29. 8.Google Scholar
- Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2015). Seoul, Republic of Korea. Google Scholar
Digital Library
- Khoovirajsingh Seewoonauth, Enrico Rukzio, Robert Hardy, and Paul Holleis. 2009. Touch & Connect and Touch & Select: Interacting with a Computer by Touching It with a Mobile Phone. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009). Bonn, Germany, 36:1--36:9. Google Scholar
Digital Library
- Khoovirajsingh Seewoonauth, Enrico Rukzio, Robert Hardy, and Paul Holleis. 2009. Two NFC Interaction Techniques for Quickly Exchanging Pictures Between a Mobile Phone and a Computer. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009). Bonn, Germany, 39:1--39:4. Google Scholar
Digital Library
- Manas Tungare, Pardha S. Pyla, Pradyut Bafna, Vladimir Glina, Wenjie Zheng, Xiaoyan Yu, Umut Balli, and Steven Harrison. 2006. Embodied Data Objects: Tangible Interfaces to Information Appliances. In Proceedings of the 44th Annual Southeast Regional Conference (ACM-SE 44). Melbourne, USA, 359--364. Google Scholar
Digital Library
- Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39, 3.4 (2000), 915--931. Google Scholar
Digital Library
- Daniel Wigdor, Hao Jiang, Clifton Forlines, Michelle Borkin, and Chia Shen. 2009. WeSpace: The Design Development and Deployment of a Walk-up and Share Multi-surface Visual Collaboration System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009). Boston, USA. https://doi.org/1518701.1518886 Google Scholar
Digital Library
- Andrew D. Wilson and Raman Sarin. 2007. BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-based Handshaking. In Proceedings of Graphics Interface, Conference on Graphics, Visualization and HCI (GI 2007). Montreal, Canada. Google Scholar
Digital Library
- Christian Winkler, Markus Löchtefeld, David Dobbelstein, Antonio Krüger, and Enrico Rukzio. 2014. SurfacePhone: A Mobile Projection Device for Single- and Multiuser Everywhere Tabletop Interaction. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada, 3513--3522. Google Scholar
Digital Library
Index Terms
INFEX: A Unifying Framework for Cross-Device Information Exploration and Exchange
Recommendations
Toss-it: intuitive information transfer techniques for mobile devices
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsIn recent years, mobile devices have rapidly penetrated into our daily lives. However, several drawbacks of mobile devices have been mentioned so far. The proposed system called Toss-It provides intuitive information transfer techniques for mobile ...
Toss-It: Intuitive Information Transfer Techniques for Mobile Devices Using Toss and Swing Actions
Mobile devices have acceleratedly penetrated into our daily lives. Though they were originally designed as a communication tool or for personal use, and due to the rapid availability of wireless network technologies, people have begun to use mobile ...
CapCam: Enabling Rapid, Ad-Hoc, Position-Tracked Interactions Between Devices
ISS '16: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and SpacesWe present CapCam, a novel technique that enables smartphones (and similar devices) to establish quick, ad-hoc connections with a host touchscreen device, simply by pressing a device to the screen's surface. Pairing data, used to bootstrap a ...






Comments