Vitro: Designing a Voice Assistant for the Scientific Lab Workplace

ABSTRACT

This paper investigates whether voice assistants can play a useful role in the specialized work-life of the knowledge worker (in a biology lab). It is motivated both by promising advances in voice-input technology, and a long-standing vision in the community to augment scientific processes with voice-based agents. Through a reflection on our design process and a limited but fully functional prototype, Vitro, we find that scientists wanted a voice-enabled device that acted not a lab assistant, but lab equipment. Second, we discovered that such a device would need to be deeply embedded in the physical and social space in which it served scientists. Finally, we discovered that scientists preferred a device that supported their practice of "careful deviation" from protocols in their lab work. Through this research, we contribute implications for the design of voice-enabled systems in workplace settings.

References

1. 2019a. HelixAI. (2019). https://www.askhelix.io/
2. 2019b. NIH/3T3 (ATCC® CRL-1658). (2019). https://www.atcc.org/products/all/CRL-1658.aspx
3. Gregory D Abowd and Elizabeth D Mynatt. 2000. Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction (TOCHI) 7, 1 (2000), 29--58.
4. Larry Arnstein, Chia Yang Hung, Robert Franza, Qing Hong Zhou, Gaetano Borriello, Sunny Consolvo, and Jing Su. 2002. Labscape: A smart environment for the cell biology laboratory . IEEE Pervasive Computing 1, 3 (2002), 13--21.
5. Barry Arons. 1991. Hyperspeech: Navigating in speech-only hypermedia. In Proceedings of the third annual ACM conference on Hypertext. ACM, 133--146.
6. Jonas Austerjost, Marc Porr, Noah Riedel, Dominik Geier, Thomas Becker, Thomas Scheper, Daniel Marquard, Patrick Lindner, and Sascha Beutel. 2018. Introducing a Virtual Assistant to the Lab: A Voice User Interface for the Intuitive Control of Laboratory Instruments . SLAS Technology (2018), 1--7.
7. Vannevar Bush. 1945. As we may think . The Atlantic Monthly 176, 1 (1945), 101--108.
8. Graham Button, Jeff Coulter, John RE Lee, and Wes Sharrock. 1995. Computers, minds, and conduct. (1995).
9. Patrick Cahan and George Q Daley. 2013. Origins and implications of pluripotent stem cell variability and heterogeneity . Nature reviews Molecular cell biology 14, 6 (2013), 357.
10. Praveen Chandar, Yasaman Khazaeni, Matthew Davis, Michael Muller, Marco Crasso, Q Vera Liao, N Sadat Shami, and Werner Geyer. 2017. Leveraging conversational systems to assists new hires during onboarding. In IFIP Conference on Human-Computer Interaction. Springer, 381--391.
11. Janghee Cho and Janghee. 2018. Mental Models and Home Virtual Assistants (HVAs) . Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (2018), SRC05:1--SRC05:6.
12. Benjamin R Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. "What Can I Help You with?": Infrequent Users' Experiences of Intelligent Personal Assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, 43:1--43:12.
13. Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K Dey. 2006. Principles of smart home control. In International conference on ubiquitous computing. Springer, 19--34.
14. Megan Rose Dickey. 2018. Now you can have a conversation with Alexa without screaming 'Hey, Alexa' for every request. (3 2018). https://techcrunch.com/2018/03/10/now-you-can-have-a-conversation-with-alexa-without-screaming-hey-alexa-for-every-request/
15. Stefan Etienne. 2018. Continued conversation is arriving for Google Home users today. (6 2018). https://www.theverge.com/2018/6/21/17486062/google-assistant-continued-conversations-home-max-mini-us-launch
16. Gerhard Fischer. 1993. Beyond human computer interaction: Designing useful and usable computational environments. People and Computers (1993), 17--17.
17. Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016. Interactive Worker Assistance: Comparing the Effects of In-situ Projection, Head-mounted Displays, Tablet, and Paper Instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 934--939.
18. Verena Giller, Manfred Tscheligi, Reinhard Sefelin, Anu M"akel"a, Aapo Puskala, Kristiina Karvonen, and Victor Joseph. 1999. Maypole highlights: Image makers. Interactions 6, 6 (1999), 12--15.
19. Google. 2019. Conversation design. (2019). https://designguidelines.withgoogle.com/conversation/
20. H Paul Grice. 1975. Logic and conversation . 1975 (1975), 41--58.
21. Grace Hu, Lily Chen, Johanna Okerlund, and Orit Shaer. 2015. Exploring the Use of Google Glass in Wet Laboratories . Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '15 (2015), 2103--2108.
22. Ruogu Kang, Laura Dabbish, Nathaniel Fruchter, and Sara Kiesler. 2015. "My data just goes everywhere": User mental models of the internet and implications for privacy and security . Symposium on Usable Privacy and Security (SOUPS) 2015 (2015), 39--52.
23. Rabia Khan and Antonella De Angeli. 2007. Mapping the demographics of virtual humans. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 2. BCS Learning & Development Ltd., 149--152.
24. Sara Kiesler and Jennifer Goetz. 2002. Mental Models and Cooperation with Robotic Assistants . CHI'02 extended abstracts on Human factors in computing systems (2002), 576--577.
25. Robert Kincaid and Graham Pollock. 2017. Nicky: Toward a Virtual Assistant for Test and Measurement Instrument Recommendations. In Semantic Computing (ICSC), 2017 IEEE 11th International Conference on. IEEE, 196--203.
26. Sara Kleinberg. 2018. 5 ways voice assistance is shaping consumer behavior . Thinking with Google (2018). https://www.thinkwithgoogle.com/consumer-insights/voice-assistance-consumer-experience/
27. Rafal Kocielnik, Daniel Avrahami, Jennifer Marlow, Di Lu, and Gary Hsieh. 2018. Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent . Proceedings of the 2018 Designing Interactive Systems Conference (2018), 881--894.
28. Q Vera Liao, Matthew Davis, Werner Geyer, Michael Muller, and N Sadat Shami. 2016. What Can You Do? Studying Social-Agent Orientation and Agent Proactive Interactions with an Agent for Employees . Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16 (2016), 264--275.
29. Q. Vera Liao, Werner Geyer, Muhammed Mas-ud Hussain, Praveen Chandar, Matthew Davis, Yasaman Khazaeni, Marco Patricio Crasso, Dakuo Wang, Michael Muller, and N. Sadat Shami. 2018. All Work and No Play? Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--13.
30. Christoph Lipps, Franziska Klein, Tom Wahlicht, Virginia Seiffert, Milada Butueva, Jeannette Zauers, Theresa Truschel, Martin Luckner, Mario Kö ster, Roderick MacLeod, Jörn Pezoldt, Jochen Hü hn, Qinggong Yuan, Peter Paul Mü ller, Henning Kempf, Robert Zweigerdt, Oliver Dittrich-Breiholz, Thomas Pufe, Rainer Beckmann, Wolf Drescher, Jose Riancho, Carolina Sa n udo, Thomas Korff, Bertram Opalka, Vera Rebmann, Joachim R Gö thert, Paula M Alves, Michael Ott, Roland Schucht, Hansjörg Hauser, Dagmar Wirth, and Tobias May. 2018. Expansion of functional personalized cells with specific transgene combinations . Nature Communications 9, 1 (2018), 994.
31. Gordon J Lithgow, Monica Driscoll, and Patrick Phillips. 2017. A long journey to reproducible results . Nature News 548, 7668 (2017), 387.
32. Panagiotis Louridas. 1999. Design as bricolage: anthropology meets design thinking. Design Studies 20, 6 (1999), 517--535.
33. Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents . Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 (2016), 5286--5297.
34. Michal Luria, Guy Hoffman, and Oren Zuckerman. 2017. Comparing Social Robot, Screen and Voice Interfaces for Smart-Home Control. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 580--628.
35. Carlos D Luzzani and Santiago G Miriuka. 2017. Pluripotent stem cells as a robust source of mesenchymal stem cells . Stem Cell Reviews and Reports 13, 1 (2017), 68--78.
36. Moira McGregor and John C Tang. 2017. More to Meetings: Challenges in Using Speech-Based Technology to Support Meetings. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 2208--2220.
37. Christine Murad, Cosmin Munteanu, Leigh Clark, and Benjamin R Cowan. 2018. Design Guidelines for Hands-free Speech Interaction. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '18). ACM, New York, NY, USA, 269--276.
38. Chelsea Myers, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for How Users Overcome Obstacles in Voice User Interfaces . (2018), 1--7.
39. Kenneth Olmstead. 2017. Nearly half of Americans use digital voice assistants, mostly on their smartphones . Technical Report. https://www.pewresearch.org/fact-tank/2017/12/12/nearly-half-of-americans-use-digital-voice-assistants-mostly-on-their-smartphones/
40. Sharon Oviatt, Colin Swindells, and Alex Arthur. 2008. Implicit user-adaptive system engagement in speech and pen interfaces . Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08 4 (2008), 969.
41. Sabine Payr. 2013. Virtual butlers and real people: styles and practices in long-term use of a companion. In Your Virtual Butler. Springer, 134--178.
42. Sara Perez. 2017. Voice-enabled smart speakers to reach 55% of U.S. households by 2022, says report . TechCrunch (2017). https://techcrunch.com/2017/11/08/voice-enabled-smart-speakers-to-reach-55-of-u-s-households-by-2022-says-report/
43. James Pierce and Eric Paulos. 2015. Making multiple uses of the obscura 1C digital camera: reflecting on the design, production, packaging and distribution of a counterfunctional device. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2103--2112.
44. Michael Polanyi. 2009. The tacit dimension . University of Chicago press.
45. Martin Porcheron, Joel E Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life . Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--12.
46. Philipp M Scholl, Embedded Systems, Matthias Wille, Unit Human Factors, Health Dortmund, Kristof Van Laerhoven, and Embedded Systems. 2015. Wearables in the Wet Lab: A Laboratory System for Capturing and Guiding Experiments . Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2015), 589--599.
47. Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I Hong. 2018. "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage . Proceedings of the 2018 on Designing Interactive Systems Conference 2018 - DIS '18 (2018), 857--868.
48. Ben Shneiderman. 2000. The limits of speech recognition . Commun. ACM 43, 9 (2000), 63--65.
49. Aaron Springer and Henriette Cramer. 2018. "Play PRBLMS": Identifying and Correcting Less Accessible Content in Voice Interfaces . (2018), 1--13.
50. Cal Swann. 2002. Action research and the practice of design. Design issues 18, 1 (2002), 49--61.
51. Aurélien Tabard, Juan-David Hincapié -Ramos, Morten Esbensen, and Jakob E Bardram. 2011. The eLabBench: an interactive tabletop system for the biology laboratory . Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS '11 (2011), 202--211.
52. Alexandra Vtyurina and Adam Fourney. 2018. Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 208:1--208:7.
53. Alex C. Williams, Harmanpreet Kaur, Gloria Mark, Anne L. Thompson, Shamsi Iqbal, and Jaime Teevan. 2018. Supporting Workplace Detachment and Reattachment using Conversational Intelligence . Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018).
54. Leslie Wu, Jesse Cirimele, Kristen Leach, Stuart Card, Larry Chu, T Kyle Harrison, and Scott R Klemmer. 2014. Supporting crisis response with dynamic procedure aids. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 315--324.
55. N Yankelovich, G-A Levow, and Matt Marx. 1995. Designing SpeechActs: Issues in Speech User Interfaces . Proceedings of the SIGCHI conference on Human factors in computing systems (1995), 369--376.
56. R Yeh, Chunyuan Liao, and S Klemmer. 2006. ButterflyNet: a mobile capture and access system for field biology research . Proc. of the SIGCHI conference on Human Factors in Computing Systems (2006), 571--580.
57. Xianjun Sam Zheng, Cedric Foucault, Patrik da Silva, Siddharth Dasari, Tao Yang, and Stuart Goose. 2015. Eye-Wearable Technology for Machine Maintenance: Effects of Display Position and Hands-free Operation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2125--2134.
58. John Zimmerman and Jodi Forlizzi. 2014. Research through design in HCI. In Ways of Knowing in HCI. Springer, 167--189.
59. John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI . Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07 (2007), 493.
60. John Zimmerman, Erik Stolterman, and Jodi Forlizzi. 2010. An analysis and critique of Research through Design: towards a formalization of a research approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems. ACM, 310--319.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Sound-based input / output

    • Interaction paradigms

      • Natural language interfaces