"Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities

ABSTRACT

From an accessibility perspective, voice-controlled, home-based intelligent personal assistants (IPAs) have the potential to greatly expand speech interaction beyond dictation and screen reader output. To examine the accessibility of off-the-shelf IPAs (e.g., Amazon Echo) and to understand how users with disabilities are making use of these devices, we conducted two exploratory studies. The first, broader study is a content analysis of 346 Amazon Echo reviews that include users with disabilities, while the second study more specifically focuses on users with visual impairments, through interviews with 16 current users of home-based IPAs. Findings show that, although some accessibility challenges exist, users with a range of disabilities are using the Amazon Echo, including for unexpected cases such as speech therapy and support for caregivers. Richer voice-based applications and solutions to support discoverability would be particularly useful to users with visual impairments. These findings should inform future work on accessible voice-based IPAs.

References

1. Eric T. Anderson and Duncan I. Simester. 2014. Reviews Without a Purchase: Low Ratings, Loyal Customers, and Deception. Journal of Marketing Research 51, 3: 249--269.
2. Lisa Anthony, Yoojin Kim, and Leah Findlater. 2013. Analyzing User-Generated YouTube Videos to Understand Touchscreen Use by People with Motor Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1223--1232.
3. Vikas Ashok, Yevgen Borodin, Svetlana Stoyanchev, Yuri Puzis, and I. V. Ramakrishnan. 2014. Wizard-ofOz evaluation of speech-driven web browsing interface for people with vision impairments. In Proceedings of the 11th Web for All Conference (W4A '14), 1--9.
4. Shiri Azenkot and Nicole B. Lee. 2013. Exploring the use of speech input by blind people on mobile devices. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13), 1--8.
5. James P. Barber and Kelley K. Walczak. 2009. Conscience and Critic: Peer Debriefing Strategies in Grounded Theory Research. In Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, California, April 13--17, 2009.
6. Scott Beach, Richard Schulz, Julie Downs, Judith Matthews, Bruce Barron, and Katherine Seelman. 2009. Disability, Age, and Informational Privacy Attitudes in Quality of Life Technology Applications. ACM Transactions on Accessible Computing (TACCESS) 2, 1: 1--21.
7. Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Pyschology 3, 2: 77--101.
8. A J Bernheim Brush, Bongshin Lee, Ratul Mahajan, Sharad Agarwal, Stefan Saroiu, and Colin Dixon. 2011. Home Automation in the Wild: Challenges and Opportunities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2115--2124.
9. Erin Buehler, Stacy Branham, Abdullah Ali, Jeremy J. Chang, Megan Kelly Hofmann, Amy Hurst, and Shaun K. Kane. 2015. Sharing is Caring: Assistive Technology Designs on Thingiverse. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 525--534.
10. Zoraida Callejas and Ramón López-Cózar. 2009. Designing smart home interfaces for the elderly. ACM SIGACCESS Accessibility and Computing, 10--16.
11. Clare Carroll, Catherine Chiodo, Xin Adena Lin, Meg Nidever, and Jayanth Prathipati. 2017. Robin: Enabling Independence For Individuals With Cognitive Disabilities Using Voice Assistive Technology. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI '17), 46--53.
12. Eric Corbett and Astrid Weber. 2016. What can I say? Addressing User Experience Challenges of a Mobile Voice User Interface for Accessibility. In Proceedings of the 18th International Conference on HumanComputer Interaction with Mobile Devices and Services (MobileHCI '16), 72--82.
13. George Demiris, Marilyn J Rantz, Myra A Aud, Karen D Marek, Harry W Tyrer, Marjorie Skubic, and Ali A Hussam. 2004. Older adults' attitudes towards and perceptions of "smart home" technologies: a pilot study. Medical Informatics and the Internet in Medicine 29, 2: 87--94.
14. Jan Derboven, Jonathan Huyghe, and Dirk De Grooff. 2014. Designing voice interaction for people with physical and speech impairments. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14), 217--226.
15. Mari Carmen Domingo. 2012. An overview of the Internet of Things for people with disabilities. Journal of Network and Computer Applications 35, 2: 584--596.
16. Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. "Hey Google is it OK if I eat you?" Initial Explorations in Child-Agent Interaction. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17), 595--600.
17. Aarthi Easwara Moorthy and Kim-Phuong L Vu. 2015. Privacy concerns for use of Voice Activated Personal Assistant in the public space. International Journal of Human-Computer Interaction 31, 4: 307--335.
18. Susan Koch Fager. 2017. Speech Recognition as a Practice Tool for Dysarthria. Seminars in Speech and Language 38, 3: 220--228.
19. Anushay Furqan, Chelsea Myers, and Jichen Zhu. 2017. Learnability through Adaptive Discovery Tools in Voice User Interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI'17), 1617--1623.
20. Susumu Harada, Jacob O. Wobbrock, Jonathan Malkin, Jeff A. Bilmes, and James A. Landay. 2009. Longitudinal study of people learning to use continuous voice-based cursor control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 347--356.
21. Daniel J. Hruschka, Deborah Schwartz, Daphne Cobb St.John, Erin Picone-Decaro, Richard A. Jenkins, and James W. Carey. 2004. Reliability in Coding OpenEnded Data: Lessons Learned from HIV Behavioral Research. Field Methods 16, 3: 307--331.
22. Shaun K Kane, Meredith Ringel Morris, Ann Paradiso, and Jon Campbell. 2017. "At times avuncular and cantankerous, with the reflexes of a mongoose": Understanding Self-Expression through Augmentative and Alternative Communication Devices. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 1166--1179.
23. Matthew L. Lee and Anind K. Dey. 2008. Lifelogging memory appliance for people with episodic memory impairment. In Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08, 44--53.
24. Ewa Lugar and Abigail Sellen. 2016. "Like Having a Really bad PA": The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5286--5297.
25. Michal Luria, Guy Hoffman, and Oren Zuckerman. 2017. Comparing Social Robot, Screen and Voice Interfaces for Smart-Home Control. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 580--592.
26. Bill Manaris, Valanne Macgyvers, and Michail Lagoudakis. 2002. A Listening Keyboard for Users with Motor Impairments - A Usability Study *. International Journal of Speech Technology 5, 4: 371-- 388.
27. Alex Mihailidis, Amy Cockburn, Catherine Longley, and Jennifer Boger. 2008. The acceptability of home monitoring technology among community-dwelling older adults and baby boomers. Assistive technology 20, 1: 1--12.
28. Maia Naftali and Leah Findlater. 2014. Accessibility in context: understanding the truly mobile experience of smartphone users with motor impairments. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '14), 209--216.
29. Gregor Pačnik, Karl Benkič, and Bojan Brečko. 2005. Voice operated intelligent wheelchair - VOIC. In IEEE International Symposium on Industrial Electronics (IEEE ISIE '05), 1221--1226.
30. Rebecca Palmer, Pam Enderby, and Mark Hawley. 2007. Addressing the needs of speakers with longstanding dysarthria: computerized and traditional therapy compared. International Journal of Language & Communication Disorders 42, Sup1: 61--67.
31. François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: Acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1: 127--144.
32. Amanda Purington, Jessie G. Taft, Shruti Sannon, Natalya N. Bazarova, and Samuel Hardman Taylor. 2017. "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17), 2853-- 2859.
33. Frank Rudzicz, Rosalie Wang, Momotaz Begum, and Alex Mihailidis. 2015. Speech Interaction with Personal Assistive Robots Supporting Aging at Home for Individuals with Alzheimer's Disease. ACM Transactions on Accessible Computing (TACCESS) 7, 2: 1--22.
34. Richard C. Simpson and Simon P. Levine. 2002. Voice control of a powered wheelchair. IEEE Transactions on Neural Systems and Rehabilitation Engineering 10, 2: 122--125.
35. Christoph Stahl and Pascal Laub. 2017. Maintaining multiple sclerosis patients' quality of life -- a case study on environment control assistance in a smart home. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17), 83--86.
36. Matthieu Tixier and Myriam Lewkowicz. 2015. Looking for Respite and Support: Technological Opportunities for Spousal Caregivers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1155--1158.
37. Michel Vacher, Benjamin Lecouteux, Dan Istrate, Thierry Joubert, François Portet, Mohamed Sehili, and Pedro Chahuara. 2013. Experimental Evaluation of Speech Recognition Technologies for Voice-based Home Automation Control in a Smart Home. In 4th Workshop on Speech and Language Processing for Assistive Technologies, 99--105.
38. Amber Wagner, Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame, and Jeff Gray. 2012. Programming by voice: a hands-free approach for motorically challenged children. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts (CHI EA '12), 2087--2092.
39. Bruce N Walker, Jeffrey Lindsay, Amanda Nance, Yoko Nakano, K Palladino, Tilman Dingler, and Myounghoon Jeon. 2011. Spearcons ( Speech-Based Earcons ) Improve Navigation Performance in Advanced Auditory Menus. Human Factors 55, 1: 157--182.
40. Maria Klara Wolters, Fiona Kelly, and Jonathan Kilgour. 2016. Designing a spoken dialogue interface to an intelligent cognitive assistant for people with dementia. Health informatics journal 22, 4: 854--866.
41. Nicole Yankelovich. 1996. How Do Users Know What to Say? Interactions 3, 32--43.
42. Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and Future Mobile and Wearable Device Use by People With Visual Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 3123--3132.
43. Eric Zeng, Shrirang Mare, and Franziska Roesner. 2017. End User Security & Privacy Concerns with Smart Homes. In Symposium on Usable Privacy and Security (SOUPS '17).
44. VoiceOver for Mac: VoiceOver overview. Retrieved September 14, 2017 from https://support.apple.com/kb/PH22549?locale=en_US
45. JAWS Screen Reader - Best in Class. Retrieved September 14, 2017 from http://www.freedomscientific.com/Products/Blindness/ JAWS
46. Dragon NaturallySpeaking - world's best-selling speech recognition software | Nuance. Retrieved September 14, 2017 from https://www.nuance.com/dragon.html

Index Terms

• Human-centered computing