HoliBraille: multipoint vibrotactile feedback on mobile devices

ABSTRACT

We propose HoliBraille, a system that enables Braille input and output on current mobile devices. We use vibrotactile motors combined with dampening materials in order to actuate directly on users' fingers. The prototype can be attached to current capacitive touchscreen devices enabling multipoint and localized feedback. HoliBraille can be leveraged in several applications including educational tools for learning Braille, as a communication device for deaf-blind people, and as a tactile feedback system for multitouch Braille input. We conducted a user study with 12 blind participants on Braille character discrimination. Results show that HoliBraille is effective in providing localized feedback; however, character discrimination performance is strongly related with number of simultaneous stimuli. We finish by discussing the obtained results and propose future research avenues to improve multipoint vibrotactile perception.

References

1. Craig, J. C. Tactile pattern perception and its perturbations. The Journal of the Acoustical Society of America, 77, 1 (1985), 238--246.
2. Heller, M., Beernardine, M. Helping new Braille readers: Effects of spacing, finger locus, and gloves. Perceptual and motor skills, 61, 2 (1985), 363--369.
3. Jayant, C., Acuario, C., Johnson, W., Hollier, J., and Ladner, R. V-braille: haptic braille perception using a touch-screen and vibration on mobile phones. In Proc. ASSETS 2010, 295--296.
4. Nicolau, H., Guerreiro, J., Guerreiro, T. UbiBraille: designing and evaluating a vibrotactile Braille-reading device. In Proc. ASSETS 2013, 23--30.
5. Nicolau, H., Montague, K., Guerreiro, J., Marques, D., Guerreiro, T., Stewart, C., Hanson, V. Augmenting Braille Input through Multitouch Feedback. In Adj. Proc. UIST 2013, 81--82.
6. Rantala, J., Raisamo, R., Lylykangas, J., Surakka, V., Raisamo, J., Salminen, K., Pakkanen, T., and Hippula, A. Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. Transactions on Haptics, 2, 1 (2009), 28--39.
7. Southern, C., Clawson, J., Frey, B., Abowd, G., Romero, M. An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired. In Proc. MHCI 2012, 317--326.
8. Yatani, K., Truong, K. SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In Proc. UIST 2009, 111--120.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices

      • Touch screens

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping