10.1145/1622176.1622209acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedings
research-article

Optically sensing tongue gestures for computer input

ABSTRACT

Many patients with paralyzing injuries or medical conditions retain the use of their cranial nerves, which control the eyes, jaw, and tongue. While researchers have explored eye-tracking and speech technologies for these patients, we believe there is potential for directly sensing explicit tongue movement for controlling computers. In this paper, we describe a novel approach of using infrared optical sensors embedded within a dental retainer to sense tongue gestures. We describe an experiment showing our system effectively discriminating between four simple gestures with over 90% accuracy. In this experiment, users were also able to play the popular game Tetris with their tongues. Finally, we present lessons learned and opportunities for future work.

References

  1. Bach-y-Rita, P., Kaczmarek K., Tyler M.,&Garcia-Lara, J. (1998). Form perception with a 49-point electrotactile stimulus array on the tongue. J Rehabil Res Dev, 35, 427--430.Google ScholarGoogle Scholar
  2. Chin, C.A., Barreto, A., Cremades, J.G. and Adjouadi, M. 2008. Integrated electromyogram and eye-gaze tracking cursor control system for computer users with motor disabilities. J Rehabil Res Dev, 45(1), 161--174.Google ScholarGoogle ScholarCross RefCross Ref
  3. Fried-Oken, M. 1985. Voice recognition device as a computer interface for motor and speech impaired people, Archives of Physical Medicine and Rehabilitation, 66(10), 678--81.Google ScholarGoogle Scholar
  4. Huo, X., Wang, J., and Ghovanloo, M. 2008. A magne-to-inductive sensor based wireless tongue-computer interface, IEEE Trans on Neural Sys Rehab Eng 16(5), 497--504.Google ScholarGoogle ScholarCross RefCross Ref
  5. Peng, Q., Budinger, T.F. ZigBee-based wireless intraoral control system for quadriplegic patients. Conf Proc IEEE Eng Med Biol Soc. 2007, 1647--50.Google ScholarGoogle Scholar
  6. Salem, C. and Zhai, S. 1997. An isometric tongue pointing device. In Proc. of CHI '97 Conference, 538--539. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Struijk, L. 2006. An inductive tongue computer interface for control of computers and assistive devices, IEEE Trans on BioMed Eng, 53(12): 2594--2597.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Optically sensing tongue gestures for computer input

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!