Abstract
Interactive tabletops offer unique collaborative features, particularly their size, geometry, orientation and, more importantly, the ability to support multi-user interaction. Although previous efforts were made to make interactive tabletops accessible to blind people, the potential to use them in collaborative activities remains unexplored. In this paper, we present the design and implementation of a multi-user auditory display for interactive tabletops, supporting three feedback modes that vary on how much information about the partners' actions is conveyed. We conducted a user study with ten blind people to assess the effect of feedback modes on workspace awareness and task performance. Furthermore, we analyze the type of awareness information exchanged and the emergent collaboration strategies. Finally, we provide implications for the design of future tabletop collaborative tools for blind users.
- Jé ré my Albouys-Perrois, Jé ré my Laviole, Carine Briant, and Anke M Brock. 2018. Towards a Multisensory Augmented Reality Map for Blind and Low Vision People: A Participatory Design Approach. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 629:1---629:14. https://doi.org/10.1145/3173574.3174203Google Scholar
- Edward Anstead, Abigail Durrant, Steve Benford, and David Kirk. 2012. Tabletop Games for Photo Consumption at Theme Parks. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 61--70. https://doi.org/10.1145/2396636.2396646Google Scholar
Digital Library
- Apple. 2019. VoiceOver . https://www.apple.com/lae/accessibility/iphone/vision/. [Online; accessed 10-September-2019].Google Scholar
- Shiri Azenkot, JAcob O. Wobbrock, Sanjana Prasain, and Richard E. Ladner. 2012. Input finger detection for nonvisual touch screen text entry in Perkinput. In Proceedings of Graphics Interface. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 121--129. https://doi.org/2305276.2305297Google Scholar
- Sandra Bardot, Marcos Serrano, Simon Perrault, Shengdong Zhao, and Christophe Jouffrais. 2019. Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision. In Human-Computer Interaction -- INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 305--324.Google Scholar
Digital Library
- Syed Masum Billah, Yu-Jung Ko, Vikas Ashok, Xiaojun Bi, and I V Ramakrishnan. 2019. Accessible Gesture Typing for Non-Visual Text Entry on Smartphones. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 376:1---376:12. https://doi.org/10.1145/3290605.3300606Google Scholar
Digital Library
- Anke Brock, Bernard Oriola, Philippe Truillet, Christophe Jouffrais, and Delphine Picard. 2013. Map design for visually impaired people: past, present, and future research . Mé diation et Information , Vol. 36 (dec 2013), 117--129. http://oatao.univ-toulouse.fr/12339/Google Scholar
- Abhizna Butchibabu, Christopher Sparano-Huiban, Liz Sonenberg, and Julie Shah. 2016. Implicit coordination strategies for effective team communication. Human factors , Vol. 58, 4 (2016), 595--610.Google Scholar
- Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, Giulio Mori, and Victor M R Penichet. 2014. Collaborative Editing: Collaboration, Awareness and Accessibility Issues for the Blind. In On the Move to Meaningful Internet Systems: OTM 2014 Workshops , , Robert Meersman, Hervé Panetto, Alok Mishra, Rafael Valencia-Garcí a, Antó nio Lucas Soares, Ioana Ciuciu, Fernando Ferri, Georg Weichhart, Thomas Moser, Michele Bezzi, and Henry Chan (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 567--573.Google Scholar
- Xiang Cao, Siâ n E Lindley, John Helmes, and Abigail Sellen. 2010. Telling the Whole Story: Anticipation, Inspiration and Reputation in a Field Deployment of TellTable. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 251--260. https://doi.org/10.1145/1718918.1718967Google Scholar
Digital Library
- E Colin Cherry. 1953. Some Experiments on the Recognition of Speech, with One and with Two Ears . The Journal of the Acoustical Society of America , Vol. 25, 5 (1953), 975--979. https://doi.org/10.1121/1.1907229Google Scholar
Cross Ref
- Jonathon N Cummings and Sara Kiesler. 2008. Who collaborates successfully? Prior experience reduces collaboration barriers in distributed interdisciplinary research. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. 437--446.Google Scholar
Digital Library
- Maitraye Das, Darren Gergle, and Anne Marie Piper. 2019. 'It Doesn't Win You Friends': Understanding Accessibility in Collaborative Writing for People with Vision Impairments . Proc. ACM Hum.-Comput. Interact. , Vol. 3, CSCW (nov 2019). https://doi.org/10.1145/3359293Google Scholar
Digital Library
- Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces.. In CSCW , Vol. 92. 107--114.Google Scholar
Digital Library
- Julie Ducasse, Marc Macé, Marcos Serrano, and Christophe Jouffrais. 2016. Tangible Reels : Construction and Exploration of Tangible Maps by Visually Impaired Users . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2016). https://doi.org/10.1016/j.brainresbull.2008.09.003Google Scholar
Digital Library
- Thomas Erickson and Wendy A. Kellogg. 2000. Social Translucence: An Approach to Designing Systems That Support Social Processes. ACM Trans. Comput.-Hum. Interact. , Vol. 7, 1 (March 2000), 59--83. https://doi.org/10.1145/344949.345004Google Scholar
Digital Library
- Taciana Pontual Falc a o and Sara Price. 2009. What Have You Done! The Role of 'Interference' in Tangible Environments for Supporting Collaborative Learning. In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning - Volume 1 (CSCL'09). International Society of the Learning Sciences, 325--334. http://dl.acm.org/citation.cfm?id=1600053.1600103Google Scholar
- Eynat Gal, Liron Lamash, Nirit Bauminger-Zviely, Massimo Zancanaro, and Patrice L (Tamar) Weiss. 2016. Using Multitouch Collaboration Technology to Enhance Social Interaction of Children with High-Functioning Autism . Physical & Occupational Therapy In Pediatrics , Vol. 36, 1 (2016), 46--58. https://doi.org/10.3109/01942638.2015.1040572Google Scholar
Cross Ref
- Cagatay Goncu and Kim Marriott. 2011. GraVVITAS: generic multi-touch presentation of accessible graphics . Human-computer interaction--INTERACT 2011 (2011), 30--48. http://link.springer.com/chapter/10.1007/978--3--642--23774--4_5Google Scholar
- Google. 2019. Talkback . https://play.google.com/store/apps/details?id=com.google.android.marvin.talkback . [Online; accessed 11-September-2019].Google Scholar
- William Grussenmeyer and Eelke Folmer. 2017. Accessible Touchscreen Technology for People with Visual Impairments: A Survey . ACM Transactions on Accessible Computing (TACCESS) , Vol. 9, 2 (jan 2017), 6:1---6:31. https://doi.org/10.1145/3022701Google Scholar
Digital Library
- Jo ao Guerreiro and Daniel Goncc alves. 2016. Scanning for digital content: How blind and sighted people perceive concurrent speech. ACM Transactions on Accessible Computing (TACCESS) , Vol. 8, 1 (2016), 1--28.Google Scholar
Digital Library
- Jo a o Guerreiro, André Rodrigues, Kyle Montague, Tiago Guerreiro, Hugo Nicolau, and Daniel Goncc alves. 2015b. TabLETS Get Physical: Non-Visual Text Entry on Tablet Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems .Google Scholar
- T Guerreiro, P Lagoá, H Nicolau, D Goncc alves, and J A Jorge. 2008. From tapping to touching: Making touch screens accessible to blind users . IEEE MultiMedia (2008), 48--50.Google Scholar
- Tiago Guerreiro, Kyle Montague, Jo a o Guerreiro, Rafael Nunes, Hugo Nicolau, and Daniel J V Goncc alves. 2015a. Blind People Interacting with Large Touch Surfaces: Strategies for One-handed and Two-handed Exploration. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. ACM, 25--34.Google Scholar
Digital Library
- Anhong Guo, Xiang'Anthony' Chen, Haoran Qi, Samuel White, Suman Ghosh, Chieko Asakawa, and Jeffrey P Bigham. 2016. Vizlens: A robust and interactive screen reader for interfaces in the real world. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology . 651--664.Google Scholar
Digital Library
- Anhong Guo, Junhan Kong, Michael Rivera, Frank F Xu, and Jeffrey P Bigham. 2019. StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 371--385.Google Scholar
Digital Library
- Carl Gutwin and Saul Greenberg. 2002 a. A descriptive framework of workspace awareness for real-time groupware . Computer Supported Cooperative Work , Vol. 11, 3--4 (2002), 411--446. https://doi.org/10.1023/A:1021271517844Google Scholar
Digital Library
- Carl Gutwin and Saul Greenberg. 2002 b. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work (CSCW) , Vol. 11, 3--4 (2002), 411--446.Google Scholar
Digital Library
- Carl Gutwin, Oliver Schneider, Robert Xiao, and Stephen Brewster. 2011. Chalk Sounds: The Effects of Dynamic Synthesized Audio on Workspace Awareness in Distributed Groupware. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW '11). ACM, New York, NY, USA, 85--94. https://doi.org/10.1145/1958824.1958838Google Scholar
Digital Library
- Mark S Hancock, Chia Shen, Clifton Forlines, and Kathy Ryall. 2005. Exploring Non-speech Auditory Feedback at an Interactive Multi-user Tabletop. In Proceedings of Graphics Interface 2005 (GI '05). Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 41--50. http://dl.acm.org/citation.cfm?id=1089508.1089516Google Scholar
Digital Library
- Amanda Harris, Jochen Rick, Victoria Bonnett, Nicola Yuill, Rowanne Fleck, Paul Marshall, and Yvonne Rogers. 2009. Around the Table: Are Multiple-touch Surfaces Better Than Single-touch for Children's Collaborative Interactions?. In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning - Volume 1 (CSCL'09). International Society of the Learning Sciences, 335--344. http://dl.acm.org/citation.cfm?id=1600053.1600104Google Scholar
Digital Library
- Steven E Higgins, Emma Mercier, Elizabeth Burd, and Andrew Hatch. 2011. Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review . International Journal of Computer-Supported Collaborative Learning , Vol. 6, 4 (dec 2011), 515--538. https://doi.org/10.1007/s11412-011--9131-yGoogle Scholar
Cross Ref
- Uta Hinrichs and Sheelagh Carpendale. 2011. Gestures in the Wild: Studying Multi-touch Gesture Sequences on Interactive Tabletop Exhibits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3023--3032. https://doi.org/10.1145/1978942.1979391Google Scholar
Digital Library
- Hiroshi Ishii and Minoru Kobayashi. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 525--532.Google Scholar
Digital Library
- I. Jamil, C.S. Montero, M. Perry, K. O'Hara, A. Karnik, K. Pihlainen, M.T. Marshall, S. Jha, S. Gupta, and S. Subramanian. 2017. Collaborating around digital tabletops: Children's physical strategies from India, the UK and Finland . ACM Transactions on Computer-Human Interaction , Vol. 24, 3 (2017), 1--30. https://doi.org/10.1145/3058551Google Scholar
Digital Library
- Izdihar Jamil, Kenton O'Hara, Mark Perry, Abhijit Karnik, and Sriram Subramanian. 2011. The Effects of Interaction Techniques on Talk Patterns in Collaborative Peer Learning Around Interactive Tables. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3043--3052. https://doi.org/10.1145/1978942.1979393Google Scholar
Digital Library
- Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Halifax, Nova Scotia, Canada) (Assets '08). Association for Computing Machinery, New York, NY, USA, 73--80. https://doi.org/10.1145/1414471.1414487Google Scholar
Digital Library
- Shaun K Kane, Meredith Ringel Morris, Annuska Z Perkins, Daniel Wigdor, Richard E Ladner, and Jacob O Wobbrock. 2011a. Access Overlays: Improving Non-visual Access to Large Touch Screens for Blind Users. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 273--282. https://doi.org/10.1145/2047196.2047232Google Scholar
Digital Library
- Shaun K Kane, Meredith Ringel Morris, and Jacob O Wobbrock. 2013. Touchplates: Low-cost Tactile Overlays for Visually Impaired Touch Screen Users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, 22:1---22:8. https://doi.org/10.1145/2513383.2513442Google Scholar
Digital Library
- Shaun K Kane, Jacob O Wobbrock, and Richard E Ladner. 2011b. Usable Gestures for Blind People: Understanding Preference and Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 413--422. https://doi.org/10.1145/1978942.1979001Google Scholar
Digital Library
- Andreas Kunz, Dirk Schnelle-Walka, Ali Alavi, Stephan Pö lzer, Max Mü hlh"a user, and Klaus Miesenberger. 2014. Making Tabletop Interaction Accessible for Blind Users . Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14 (2014), 327--332. https://doi.org/10.1145/2669485.2669541Google Scholar
Digital Library
- Pedro Lopes, Ricardo Jota, and Joaquim A Jorge. 2011. Augmenting touch interaction through acoustic sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. 53--56.Google Scholar
Digital Library
- Alina Lungeanu, Yun Huang, and Noshir S Contractor. 2014. Understanding the assembly of interdisciplinary teams and its impact on performance. Journal of informetrics , Vol. 8, 1 (2014), 59--70.Google Scholar
Cross Ref
- L Luque, L d. O. Brand a o, and A A F Brand a o. 2018. A Framework to Foster Diversity in Collaborative Activities. In 2018 IEEE Frontiers in Education Conference (FIE). 1--9. https://doi.org/10.1109/FIE.2018.8658438Google Scholar
Digital Library
- Muhanad S Manshad and Ahmad S Manshad. 2008. Multimodal Vision Glove for Touchscreens. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '08). ACM, New York, NY, USA, 251--252. https://doi.org/10.1145/1414471.1414523Google Scholar
Digital Library
- David McGookin and Stephen Brewster. 2007. An Initial Investigation into Non-visual Computer Supported Collaboration. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 2573--2578. https://doi.org/10.1145/1240866.1241043Google Scholar
Digital Library
- Oussama Metatla, Nick Bryan-Kinns, and Tony Stockman. 2018. "I Hear You": Understanding Awareness Information Exchange in an Audio-only Workspace . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2018), 1--13. https://doi.org/10.1145/1235 arxiv: arXiv:1603.07016v1Google Scholar
- Meredith Ringel Morris, Anqi Huang, Andreas Paepcke, and Terry Winograd. 2006. Cooperative gestures: multi-user gestural interactions for co-located groupware. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 1201--1210.Google Scholar
Digital Library
- Meredith Ringel Morris, Dan Morris, and Terry Winograd. 2004. Individual Audio Channels with Single Display Groupware: Effects on Communication and Task Strategy. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, New York, NY, USA, 242--251. https://doi.org/10.1145/1031607.1031646Google Scholar
Digital Library
- Hugo Nicolau, Kyle Montague, Tiago Guerreiro, Jo a o Guerreiro, and Vicki L Hanson. 2014. B#: Chord-based Correction for Multitouch Braille Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'14). ACM, New York, NY, USA, 1705--1708. https://doi.org/10.1145/2556288.2557269Google Scholar
Digital Library
- Jo a o Oliveira, Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge, and Daniel Goncc alves. 2011. Blind people and mobile touch-based text-entry: Acknowledging the Need for Different Flavors. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '11. ACM, 179. https://doi.org/10.1145/2049536.2049569Google Scholar
Digital Library
- Stephan Pö lzer, Andreas Kunz, Ali Alavi, and Klaus Miesenberger. 2016. An Accessible Environment to Integrate Blind Participants into Brainstorming Sessions. In Computers Helping People with Special Needs , , Klaus Miesenberger, Christian Bü hler, and Petr Penaz (Eds.). Springer International Publishing, Cham, 587--593.Google Scholar
- R Ramloll and S Brewster. 2002. An environment for studying the impact of spatialising sonified graphs on data comprehension. In Proceedings Sixth International Conference on Information Visualisation. 167--174. https://doi.org/10.1109/IV.2002.1028773Google Scholar
Cross Ref
- Jochen Rick, Paul Marshall, and Nicola Yuill. 2011. Beyond One-size-fits-all: How Interactive Tabletops Support Collaborative Learning. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC '11). ACM, New York, NY, USA, 109--117. https://doi.org/10.1145/1999030.1999043Google Scholar
Digital Library
- Stacey D. Scott, M. Sheelagh T. Carpendale, and Kori M. Inkpen. 2004. Territoriality in Collaborative Tabletop Workspaces. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (Chicago, Illinois, USA) (CSCW '04). ACM, New York, NY, USA, 294--303. https://doi.org/10.1145/1031607.1031655Google Scholar
- Maur'icio Sousa, Daniel Mendes, Rafael Kuffner Dos Anjos, Daniel Medeiros, Alfredo Ferreira, Alberto Raposo, Jo ao Madeiras Pereira, and Joaquim Jorge. 2017. Creepy Tracker Toolkit for Context-aware Interfaces. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS '17). ACM, New York, NY, USA, 191--200. https://doi.org/10.1145/3132272.3134113Google Scholar
Digital Library
- Caleb Southern, James Clawson, Brian Frey, Gregory Abowd, and Mario Romero. 2012. An Evaluation of BrailleTouch: Mobile Touchscreen Text Entry for the Visually Impaired. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 317--326. https://doi.org/10.1145/2371574.2371623Google Scholar
Digital Library
- Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, and Patrick Baudisch. 2016. Linespace: A sensemaking platform for the blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2175--2185.Google Scholar
Digital Library
- Daniel Trindade, André Rodrigues, Tiago Guerreiro, and Hugo Nicolau. 2018. Hybrid-Brailler: Combining Physical and Gestural Interaction for Mobile Braille Input and Editing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 27:1---27:12. https://doi.org/10.1145/3173574.3173601Google Scholar
Digital Library
- Fredrik Winberg and John Bowers. 2004. Assembling the Senses: Towards the Design of Cooperative Interfaces for Visually Impaired Users. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, New York, NY, USA, 332--341. https://doi.org/10.1145/1031607.1031662Google Scholar
Digital Library
- Xiaoyi Zhang, Tracy Tran, Yuqian Sun, Ian Culhane, Shobhit Jain, James Fogarty, and Jennifer Mankoff. 2018. Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18). ACM, New York, NY, USA, 131--142. https://doi.org/10.1145/3234695.3236349Google Scholar
Digital Library
Index Terms
Collaborative Tabletops for Blind People: The Effect of Auditory Design on Workspace Awareness
Recommendations
Usable gestures for blind people: understanding preference and performance
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsDespite growing awareness of the accessibility issues surrounding touch screen use by blind people, designers still face challenges when creating accessible touch screen interfaces. One major stumbling block is a lack of understanding about how blind ...
Exploring the potential of tabletops for collaborative learning
ITS'12: Proceedings of the 11th international conference on Intelligent Tutoring SystemsDigital tabletops, with their multi-touch surfaces, are innovation that could provide new opportunities for learning. They could support rich interactive collaborative activities while maintaining natural face-to-face communication. Nevertheless, we ...
Supporting air traffic control collaboration with a TableTop system
CSCW '11: Proceedings of the ACM 2011 conference on Computer supported cooperative workCollaboration is key to safety and efficiency in Air Traffic Control. Legacy paper-based systems enable seamless and non-verbal collaboration, but trends in new software and hardware for ATC tend to separate controllers more and more, which hinders ...






Comments