Lin Chen
ABSTRACT
Input is a significant problem for wearable devices, particularly for head-mounted virtual and augmented reality systems. Contemporary AR/VR systems use in-air gestures or handheld controllers for interactivity. However, mid-air handwriting provides a natural, subtle, and easy-to-use way to input commands and text. In this demo, we propose and investigate ViFin, a new technique for input commands and text entry which tracks continuous micro finger-level writing with a commodity smartwatch through vibrations. Inspired by the recurrent neural aligner and transfer learning, ViFin recognizes continuous finger writing and works across different users and achieves an accuracy of 90% and 91% for recognizing numbers and letters, respectively. Finally, a real-time writing system with two specific applications using AR smartglasses are implemented.
- Fang Hu, Peng He, Songlin Xu, Yin Li, and Cheng Zhang. 2020. FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 71 (June 2020), 24 pages.Google Scholar
Digital Library
- Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: talk to your smart devices with finger-grained gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp). 250--261.Google ScholarDigital Library
- Viet Nguyen, Siddharth Rupavatharam, Luyang Liu, Richard Howard, and Marco Gruteser. 2019. HandSense: capacitive coupling-based dynamic, micro finger gesture recognition. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems (SenSys). 285--297.Google ScholarDigital Library
- Siddharth S. Rautaray and Anupam Agrawal. 2015. Vision Based Hand Gesture Recognition for Human Computer Interaction: A Survey. Artif. Intell. Rev. 43, 1 (Jan. 2015), 1--54.Google ScholarCross Ref
Index Terms
Continuous micro finger writing recognition with a commodity smartwatch: demo abstract
Recommendations
ViFin: Harness Passive Vibration to Continuous Micro Finger Writing with a Commodity Smartwatch
Wearable devices, such as smartwatches and head-mounted devices (HMD), demand new input devices for a natural, subtle, and easy-to-use way to input commands and text. In this paper, we propose and investigate ViFin, a new technique for input commands ...
A smartwatch product provides on-body tapping gestures recognition: demo abstract
SenSys '20: Proceedings of the 18th Conference on Embedded Networked Sensor SystemsSmartwatches, which are small and portable, have become dominant devices in the wearable ecosystem. However, due to the limited size of the touch screens, smartwatches typically have a poor interactive experience for users. In our previous work [3, 4], ...
Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
HotMobile '15: Proceedings of the 16th International Workshop on Mobile Computing Systems and ApplicationsSmartwatch is becoming one of the most popular wearable device with many major smartphone manufacturers such as Samsung and Apple releasing their smartwatches recently. Apart from the fitness applications, the smartwatch provides a rich user interface ...
Comments