ABSTRACT
Many patients with paralyzing injuries or medical conditions retain the use of their cranial nerves, which control the eyes, jaw, and tongue. While researchers have explored eye-tracking and speech technologies for these patients, we believe there is potential for directly sensing explicit tongue movement for controlling computers. In this paper, we describe a novel approach of using infrared optical sensors embedded within a dental retainer to sense tongue gestures. We describe an experiment showing our system effectively discriminating between four simple gestures with over 90% accuracy. In this experiment, users were also able to play the popular game Tetris with their tongues. Finally, we present lessons learned and opportunities for future work.
References
- Bach-y-Rita, P., Kaczmarek K., Tyler M.,&Garcia-Lara, J. (1998). Form perception with a 49-point electrotactile stimulus array on the tongue. J Rehabil Res Dev, 35, 427--430.Google Scholar
- Chin, C.A., Barreto, A., Cremades, J.G. and Adjouadi, M. 2008. Integrated electromyogram and eye-gaze tracking cursor control system for computer users with motor disabilities. J Rehabil Res Dev, 45(1), 161--174.Google Scholar
Cross Ref
- Fried-Oken, M. 1985. Voice recognition device as a computer interface for motor and speech impaired people, Archives of Physical Medicine and Rehabilitation, 66(10), 678--81.Google Scholar
- Huo, X., Wang, J., and Ghovanloo, M. 2008. A magne-to-inductive sensor based wireless tongue-computer interface, IEEE Trans on Neural Sys Rehab Eng 16(5), 497--504.Google Scholar
Cross Ref
- Peng, Q., Budinger, T.F. ZigBee-based wireless intraoral control system for quadriplegic patients. Conf Proc IEEE Eng Med Biol Soc. 2007, 1647--50.Google Scholar
- Salem, C. and Zhai, S. 1997. An isometric tongue pointing device. In Proc. of CHI '97 Conference, 538--539. Google Scholar
Digital Library
- Struijk, L. 2006. An inductive tongue computer interface for control of computers and assistive devices, IEEE Trans on BioMed Eng, 53(12): 2594--2597.Google Scholar
Cross Ref
Index Terms
Optically sensing tongue gestures for computer input


Desney S. Tan



Comments