Abstract

Body movements, from a short smile to a marathon run, are driven by muscle activity. Despite the fact that measuring muscle activity with electromyography (EMG) is technically well established, it is highly complex and its use in interfaces has been limited. Easy access to muscle sensing can offer new opportunities to Human-Computer Interaction (HCI) research. Off-the-shelf sensors often only provide low-level access, hence requiring expertise in signal processing and widening the gulf of execution for users without engineering skills. To address this challenge, we introduce EMBody, a data-centric toolkit for EMG-based interface prototyping and experimentation. EMBody offers multiple levels of prototyping fidelity for EMG sensing, signal processing, and data interpretation. Our data-centric toolkit encapsulates the different data representation stages, offering a wide range of customization opportunities to experts while also allowing non-technical designers to focus on creating new interaction techniques. EMBody features a lightweight form factor and wireless connectivity. Additionally, the system leverages an exploration-centered workflow by allowing rapid access to measurement data via the accompanying software. Users define a set of motions to be recognized and interactively provide example data points. The toolkit then handles signal processing and classification. The recognized movements are streamed on the local network, ready to be used by interactive applications. This paper reports on how to use EMBody and its implementation. We iteratively developed the toolkit in a series of workshops and example applications. Users who had none or very limited knowledge of EMG could rapidly create engaging functional prototypes, while experts appreciated the modularity of the software component allowing for a high degree of customization. We contribute the software and hardware components of EMBody as a tool for the research community to stimulate creative exploration of EMG systems.
Supplemental Material
- Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI research: Going behind the scenes. Synthesis lectures on human-centered informatics, Vol. 9, 1 (2016), 1--115.Google Scholar
Cross Ref
- Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Paweł Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3572--3583. https://doi.org/10.1145/2858036.2858220Google Scholar
Digital Library
- Pei-Yu (Peggy) Chi and Yang Li. 2015. Weave: Scripting Cross-Device Wearable Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3923--3932. https://doi.org/10.1145/2702123.2702451Google Scholar
Digital Library
- Enrico Costanza, Samuel A. Inverso, Rebecca Allen, and Pattie Maes. 2007. Intimate Interfaces in Action : Assessing the Usability and Subtlety of Emg -Based Motionless Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 819--828. https://doi.org/10.1145/1240624.1240747Google Scholar
Digital Library
- Paul Dourish. 1999. Embodied interaction: Exploring the foundations of a new approach to HCI. Unpublished paper, on-line: http://www.ics.uci.edu/jpd/publications/misc/embodied.pdf (1999).Google Scholar
- Stephen H. Fairclough. 2009. Fundamentals of physiological computing. Interact Comput, Vol. 21, 1--2 (Jan. 2009), 133--145. https://doi.org/10.1016/j.intcom.2008.10.011Google Scholar
Digital Library
- Tong Gao, Jessica R. Hullman, Eytan Adar, Brent Hecht, and Nicholas Diakopoulos. 2014. NewsViews: An Automated Pipeline for Creating Custom Geovisualizations for News. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 3005--3014. https://doi.org/10.1145/2556288.2557228Google Scholar
Digital Library
- Saul Greenberg and Chester Fitchett. 2001. Phidgets: Easy Development of Physical Interfaces through Physical Widgets. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST '01). Association for Computing Machinery, Orlando, Florida, 209--218. https://doi.org/10.1145/502348.502388Google Scholar
Digital Library
- Tobias Grosse-Puppendahl, Yannick Berghoefer, Andreas Braun, Raphael Wimmer, and Arjan Kuijper. 2013. OpenCapSense : A Rapid Prototyping Toolkit for Pervasive Interaction Using Capacitive Sensing. In 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom ). 152--159. https://doi.org/10.1109/PerCom.2013.6526726Google Scholar
Cross Ref
- Juan Haladjian. 2019. The Wearables Development Toolkit : An Integrated Development Environment for Activity Recognition Applications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 3, 4 (Dec. 2019), 134:1--134:26. https://doi.org/10.1145/3369813Google Scholar
Digital Library
- Juan Haladjian, Katharina Bredies, and Bernd Brügge. 2016. Interactex: An Integrated Development Environment for Smart Textiles. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC '16). Association for Computing Machinery, New York, NY, USA, 8--15. https://doi.org/10.1145/2971763.2971776Google Scholar
Digital Library
- Björn Hartmann, Leith Abdulla, Manas Mittal, and Scott R. Klemmer. 2007. Authoring Sensor-Based Interactions by Demonstration with Direct Manipulation and Pattern Recognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, San Jose, California, USA, 145--154. https://doi.org/10.1145/1240624.1240646Google Scholar
Digital Library
- Cedric Honnet, Hannah Perner-Wilson, Marc Teyssier, Bruno Fruchard, Jürgen Steimle, Ana C. Baptista, and Paul Strohmeier. 2020. PolySense : Augmenting Textiles with Electrical Functionality Using In -Situ Polymerization. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, Honolulu, HI, USA, 1--13. https://doi.org/10.1145/3313831.3376841Google Scholar
Digital Library
- Steven Houben, Connie Golsteijn, Sarah Gallacher, Rose Johnson, Saskia Bakker, Nicolai Marquardt, Licia Capra, and Yvonne Rogers. 2016. Physikit: Data Engagement Through Physical Ambient Visualizations in the Home. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1608--1619. https://doi.org/10.1145/2858036.2858059Google Scholar
Digital Library
- Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 1247--1256. https://doi.org/10.1145/2702123.2702215Google Scholar
Digital Library
- Scott E. Hudson and Jennifer Mankoff. 2006. Rapid Construction of Functioning Physical Interfaces from Cardboard, Thumbtacks, Tin Foil and Masking Tape. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). Association for Computing Machinery, Montreux, Switzerland, 289--298. https://doi.org/10.1145/1166253.1166299Google Scholar
- Martin Kaltenbrunner and Ross Bencina. 2007. ReacTIVision: A Computer-Vision Framework for Table-Based Tangible Interaction. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (Baton Rouge, Louisiana) (TEI '07). Association for Computing Machinery, New York, NY, USA, 69--74. https://doi.org/10.1145/1226969.1226983Google Scholar
Digital Library
- Jakob Karolus, Annika Kilian, Thomas Kosch, Albrecht Schmidt, and Paweł W. Wozniak. 2020. Hit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS '20). Association for Computing Machinery, New York, NY, USA, 429--440. https://doi.org/10.1145/3357236.3395500Google Scholar
- Jakob Karolus, Hendrik Schuff, Thomas Kosch, Pawel W. Wozniak, and Albrecht Schmidt. 2018. EMGuitar: Assisting Guitar Playing with Electromyography. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 651--655. https://doi.org/10.1145/3196709.3196803 event-place: Hong Kong, China.Google Scholar
Digital Library
- Mohamed Khamis, Ozan Saltuk, Alina Hang, Katharina Stolz, Andreas Bulling, and Florian Alt. 2016. TextPursuits: Using Text for Pursuits-Based Interaction and Calibration on Public Displays. In Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). 274--285. https://doi.org/10.1145/2971648.2971679Google Scholar
Digital Library
- David Ledo, Fraser Anderson, Ryan Schmidt, Lora Oehlberg, Saul Greenberg, and Tovi Grossman. 2017. Pineal: Bringing Passive Objects to Life with Embedded Mobile Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 2583--2593. https://doi.org/10.1145/3025453.3025652Google Scholar
Digital Library
- David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, Montreal QC, Canada, 1--17. https://doi.org/10.1145/3173574.3173610Google Scholar
Digital Library
- Johnny C. Lee, Daniel Avrahami, Scott E. Hudson, Jodi Forlizzi, Paul H. Dietz, and Darren Leigh. 2004. The Calder Toolkit: Wired and Wireless Components for Rapidly Prototyping Interactive Devices. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '04). Association for Computing Machinery, Cambridge, MA, USA, 167--175. https://doi.org/10.1145/1013115.1013139Google Scholar
Digital Library
- Javier Marco, Eva Cerezo, and Sandra Baldassarri. 2012. ToyVision: A Toolkit for Prototyping Tabletop Tangible Games. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Copenhagen, Denmark) (EICS '12). Association for Computing Machinery, New York, NY, USA, 71--80. https://doi.org/10.1145/2305484.2305498Google Scholar
Digital Library
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). Association for Computing Machinery, Santa Barbara, California, USA, 315--326. https://doi.org/10.1145/2047196.2047238Google Scholar
Digital Library
- Nicolai Marquardt and Saul Greenberg. 2007. Distributed Physical Interfaces with Shared Phidgets. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). Association for Computing Machinery, Baton Rouge, Louisiana, 13--20. https://doi.org/10.1145/1226969.1226973Google Scholar
Digital Library
- Roberto Merletti and Dario Farina. 2016. Surface Electromyography : Physiology, Engineering and Applications. John Wiley & Sons.Google Scholar
- Roberto Merletti and Philip A. Parker. 2004. Electromyography: Physiology, Engineering, and Non -Invasive Applications. John Wiley & Sons.Google Scholar
- Michael Nebeling, Theano Mintsi, Maria Husmann, and Moira Norrie. 2014. Interactive Development of Cross-Device User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2793--2802. https://doi.org/10.1145/2556288.2556980Google Scholar
Digital Library
- Aditya Shekhar Nittala, Arshad Khan, Klaus Kruttwig, Tobias Kraus, and Jürgen Steimle. 2020. PhysioSkin : Rapid Fabrication of Skin -Conformal Physiological Interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, Honolulu, HI, USA, 1--10. https://doi.org/10.1145/3313831.3376366Google Scholar
Digital Library
- Galen Panger. 2012. Kinect in the Kitchen: Testing Depth Camera Interactions in Practical Home Environments. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA '12). Association for Computing Machinery, New York, NY, USA, 1985--1990. https://doi.org/10.1145/2212776.2223740Google Scholar
Digital Library
- G. M. Paul, F. Cao, R. Torah, K. Yang, S. Beeby, and J. Tudor. 2014. A Smart Textile Based Facial EMG and EOG Computer Interface. IEEE Sensors Journal, Vol. 14, 2 (2014), 393--400.Google Scholar
Cross Ref
- Max Pfeiffer, Tim Duente, and Michael Rohs. 2016. Let Your Body Move: A Prototyping Toolkit for Wearable Force Feedback with Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 418--427. https://doi.org/10.1145/2935334.2935348Google Scholar
Digital Library
- Angkoon Phinyomark, Pornchai Phukpattaranont, and Chusak Limsakul. 2012. Feature reduction and selection for EMG signal classification. Expert Systems with Applications, Vol. 39, 8 (June 2012), 7420--7431. https://doi.org/10.1016/j.eswa.2012.01.102Google Scholar
Digital Library
- Raf Ramakers, Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2016. RetroFab: A Design Tool for Retrofitting Physical Interfaces Using Actuators, Sensors and 3D Printing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 409--419. https://doi.org/10.1145/2858036.2858485Google Scholar
Digital Library
- Raf Ramakers, Kashyap Todi, and Kris Luyten. 2015. PaperPulse: An Integrated Approach for Embedding Electronics in Paper Designs. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 2457--2466. https://doi.org/10.1145/2702123.2702487Google Scholar
Digital Library
- T Scott Saponas, Desney S. Tan, Dan Morris, and Ravin Balakrishnan. 2008. Demonstrating the Feasibility of Using Forearm Electromyography for Muscle -Computer Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 515--524. https://doi.org/10.1145/1357054.1357138Google Scholar
Digital Library
- Valkyrie Savage, Colin Chang, and Björn Hartmann. 2013. Sauron: Embedded Single-Camera Sensing of Printed Physical User Interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). Association for Computing Machinery, St. Andrews, Scotland, United Kingdom, 447--456. https://doi.org/10.1145/2501988.2501992Google Scholar
Digital Library
- Valkyrie Savage, Sean Follmer, Jingyi Li, and Björn Hartmann. 2015. Makers' Marks: Physical Markup for Designing and Fabricating Functional Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 103--108. https://doi.org/10.1145/2807442.2807508Google Scholar
Digital Library
- Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). Association for Computing Machinery, Cambridge, Massachusetts, USA, 579--588. https://doi.org/10.1145/2380116.2380189Google Scholar
Digital Library
- B. Schilit, N. Adams, and R. Want. 1994. Context-Aware Computing Applications. In 1994 First Workshop on Mobile Computing Systems and Applications. 85--90. https://doi.org/10.1109/WMCSA.1994.16Google Scholar
Digital Library
- Albrecht Schmidt. 2016. Biosignals in human-computer interaction. interactions, Vol. 23, 1 (Dec. 2016), 76--79. https://doi.org/10.1145/2851072Google Scholar
- Martin Schmitz, Martin Stitz, Florian Müller, Markus Funk, and Max Mühlh"auser. 2019. ../Trilaterate: A Fabrication Pipeline to Design and 3D Print Hover-, Touch-, and Force-Sensitive Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300684Google Scholar
Digital Library
- Teddy Seyed, Alaa Azazi, Edwin Chan, Yuxi Wang, and Frank Maurer. 2015. SoD-Toolkit: A Toolkit for Interactively Prototyping and Developing Multi-Sensor, Multi-Device Environments. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS '15). Association for Computing Machinery, New York, NY, USA, 171--180. https://doi.org/10.1145/2817721.2817750Google Scholar
- C. Estelle Smith, Eduardo Nevarez, and Haiyi Zhu. 2020. Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376744Google Scholar
Digital Library
- Evan Strasnick, Sean Follmer, and Maneesh Agrawala. 2019. Pinpoint: A PCB Debugging Pipeline Using Interruptible Routing and Instrumentation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--11. https://doi.org/10.1145/3290605.3300278Google Scholar
Digital Library
- Paul Strohmeier, Narjes Pourjafarian, Marion Koelle, Cedric Honnet, Bruno Fruchard, and Jürgen Steimle. 2020. Sketching On -Body Interactions Using Piezo -Resistive Kinesiology Tape. In Proceedings of the 1st Augmented Humans International Conference (AHs '20). ACM, New York, NY, USA. https://doi.org/10.1145/3384657.3384774Google Scholar
Digital Library
- Dag Svanæs. 2013. Interaction Design for and with the Lived Body: Some Implications of Merleau-Ponty's Phenomenology. ACM Trans. Comput.-Hum. Interact., Vol. 20, 1, Article 8 (April 2013), 30 pages. https://doi.org/10.1145/2442106.2442114Google Scholar
Digital Library
- Marc Teyssier, Gilles Bailly, Catherine Pelachaud, Eric Lecolinet, Andrew Conn, and Anne Roudaut. 2019. Skin-On Interfaces : A Bio -Driven Approach for Artificial Skin Design to Cover Interactive Devices. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, New Orleans, LA, USA, 307--322. https://doi.org/10.1145/3332165.3347943Google Scholar
Digital Library
- Nicolas Villar, James Scott, Steve Hodges, Kerry Hammil, and Colin Miller. 2012. .NET Gadgeteer: A Platform for Custom Devices. In Proceedings of the 10th International Conference on Pervasive Computing (Pervasive'12). Springer-Verlag, Newcastle, UK, 216--233. https://doi.org/10.1007/978--3--642--31205--2_14Google Scholar
Digital Library
- Scott R. Vrana. 1993. The Psychophysiology of Disgust: Differentiating Negative Emotional Contexts with Facial EMG. Psychophysiology, Vol. 30, 3 (May 1993), 279--286. https://doi.org/10.1111/j.1469--8986.1993.tb03354.xGoogle Scholar
- Chiuan Wang, Hsuan-Ming Yeh, Bryan Wang, Te-Yen Wu, Hsin-Ruey Tsai, Rong-Hao Liang, Yi-Ping Hung, and Mike Y. Chen. 2016. CircuitStack: Supporting Rapid Prototyping and Evolution of Electronic Circuits. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 687--695. https://doi.org/10.1145/2984511.2984527Google Scholar
Digital Library
- Michael Wessely, Theophanis Tsandilas, and Wendy E. Mackay. 2018. Shape-Aware Material : Interactive Fabrication with ShapeMe. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). Association for Computing Machinery, Berlin, Germany, 127--139. https://doi.org/10.1145/3242587.3242619Google Scholar
- Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3929--3942. https://doi.org/10.1145/3025453.3025562Google Scholar
Digital Library
- Jishuo Yang and Daniel Wigdor. 2014. Panelrama: Enabling Easy Specification of Cross-Device Web Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2783--2792. https://doi.org/10.1145/2556288.2557199Google Scholar
Digital Library
Index Terms
EMBody: A Data-Centric Toolkit for EMG-Based Interface Prototyping and Experimentation
Recommendations
Predicting EMG Based Elbow Joint Torque Model Using Multiple Input ANN Neurons for Arm Rehabilitation
UKSIM '14: Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and SimulationThis paper illustrates the Artificial Neural Network (ANN) technique to predict the joint torque estimation model for arm rehabilitation device in a clear manner. This device acts as an exoskeleton for people who had failure of their limb. ...
Human motion intention recognition based on EMG signal and angle signal
AbstractAs the traditional single biological signal or physical signal is not good at predicting the angle value of the knee joint, the innovative fusion of biological signals and physical signals is used to analyze the movement posture of the lower ...
Detection of human reflex response in EMG signals: a time-frequency approach
CBMS '97: Proceedings of the 10th IEEE Symposium on Computer-Based Medical Systems (CBMS '97)The paper presents a new method based on time-frequency representations (TFRs) for detecting reflex activities in EMG signals of biceps brachii. A perturbed flexion-extension forearm movement in the horizontal plane is studied here and a stationarity ...






Comments