UbiBraille: designing and evaluating a vibrotactile Braille-reading device

ABSTRACT

Blind people typically resort to audio feedback to access information on electronic devices. However, this modality is not always an appropriate form of output. Novel approaches that allow for private and inconspicuous interaction are paramount. In this paper, we present a vibrotactile reading device that leverages the users' Braille knowledge to read textual information. UbiBraille consists of six vibrotactile actuators that are used to code a Braille cell and communicate single characters. The device is able to simultaneously actuate the users' index, middle, and ring fingers of both hands, providing fast and mnemonic output. We conducted two user studies on UbiBraille to assess both character and word reading performance. Character recognition rates ranged from 54% to 100% and were highly character- and user-dependent. Indeed, participants with greater expertise in Braille reading/writing were able to take advantage of this knowledge and achieve higher accuracy rates. Regarding word reading performance, we investigated four different vibrotactile timing conditions. Participants were able to read entire words and obtained recognition rates up to 93% with the most proficient ones being able achieve a rate of 1 character per second.

References

1. Z. Al-Qudah, I. A. Doush, F. Alkhateeb, E. A. Maghayreh, and O. Al-Khaleel. Reading Braille on mobile phones: A fast method with low battery power consumption. In User Science and Engineering (i-USEr), 2011 International Conference on, pages 118--123. IEEE, 2011.
2. S. S. An, J. W. Jeon, S. Lee, H. Choi, and H.-G. Choi. A pair of wireless braille-based chording gloves. In Computers Helping People with Special Needs, pages 490--497. Springer, 2004.
3. Azenkot S., Wobbrock J. O., S. Prasain, and R. E. Ladner. Input Finger Detection for nonvisual touch screen text entry in Perkinput. In Proceedings of Graphics Interface (GI '12), 2012.
4. S. Brewster and L. M. Brown. Tactons: structured tactile messages for non-visual information display. In Proceedings of the fifth conference on Australasian user interface-Volume 28, pages 15--23. Australian Computer Society, Inc., 2004.
5. L. M. Brown, S. A. Brewster, and H. C. Purchase. Multidimensional tactons for non-visual information presentation in mobile devices. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, page 238. ACM, 2006.
6. A. Chang, S. O'Modhrain, R. Jacob, E. Gunther, and H. Ishii. ComTouch: design of a vibrotactile communication device. In Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques, DIS '02, pages 312--320, New York, NY, USA, 2002. ACM.
7. M.-C. Cho, K.-H. Park, S.-H. Hong, J. W. Jeon, S. I. Lee, H. Choi, and H.-G. Choi. A pair of Braille-based chord gloves. In Wearable Computers, 2002. (ISWC 2002). Proceedings. Sixth International Symposium on, pages 154--155, 2002.
8. B. Frey, C. Southern, and M. Romero. Brailletouch: mobile texting for the visually impaired. Universal Access in Human-Computer Interaction. Context Diversity, pages 19--25, 2011.
9. M. Fukumoto and T. Sugimura. Active click: tactile feedback for touch panels. In CHI'01 extended abstracts on Human factors in computing systems, pages 121--122. ACM, 2001.
10. G. Ghiani, B. Leporini, and F. Paterno. Vibrotactile feedback as an orientation aid for blind users of mobile guides. In MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, pages 431--434, New York, NY, USA, 2008.
11. E. Hoggan, S. Anwar, and S. A. Brewster. Mobile multi-actuator tactile displays. In Proceedings of the 2nd international workshop on Haptic and audio interaction design, pages 22--33. Springer-Verlag, 2007.
12. E. Hoggan, S. A. Brewster, and J. Johnston. Investigating the effectiveness of tactile feedback for mobile touchscreens. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 1573--1582, New York, NY, USA, 2008.
13. E. Hoggan, T. Kaaresoja, P. Laitinen, and S. Brewster. Crossmodal congruence: the look, feel and sound of touchscreen widgets. In Proceedings of the 10th international conference on Multimodal interfaces, ICMI '08, pages 157--164, New York, NY, USA, 2008. ACM.
14. A. Israr and I. Poupyrev. Tactile brush: drawing on skin with a tactile grid display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11, pages 2019--2028, New York, NY, USA, 2011. ACM.
15. C. Jayant, C. Acuario, W. Johnson, J. Hollier, and R. Ladner. V-braille: haptic braille perception using a touch-screen and vibration on mobile phones. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, ASSETS '10, pages 295--296, New York, NY, USA, 2010. ACM.
16. S. Kammoun, C. Jouffrais, T. Guerreiro, H. Nicolau, and J. Jorge. Guiding Blind People with Haptic Feedback. In Pervasive Workshop on Frontiers in Accessibility for Pervasive Computing, New Castle, UK, 2012.
17. I. S. MacKenzie and R. W. Soukoreff. Text entry for mobile computing: Models and methods, theory and practice. Human--Computer Interaction, 17(2):147--198, 2002.
18. S. Mascetti, C. Bernareggi, and M. Belotti. TypeInBraille: a braille-based typing application for touchscreen devices. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, pages 295--296. ACM, 2011.
19. S. Ohtsuka, N. Sasaki, S. Hasegawa, and T. Harakawa. Body-Braille system for disabled people. In Computers Helping People with Special Needs, pages 682--685. Springer, 2008.
20. J. Oliveira, T. Guerreiro, H. Nicolau, J. Jorge, and D. Gonçalves. BrailleType: unleashing braille over touch screen mobile phones. Human-Computer Interaction--INTERACT 2011, pages 100--107, 2011.
21. M. Pielot, B. Poppinga, and S. Boll. PocketNavigator: vibro-tactile waypoint navigation for everyday mobile devices. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, MobileHCI '10, pages 423--426, New York, NY, USA, 2010. ACM.
22. I. Poupyrev, S. Maruyama, and J. Rekimoto. Ambient touch: designing tactile interfaces for handheld devices. In Proceedings of the 15th annual ACM symposium on User interface software and technology, UIST '02, pages 51--60, New York, NY, USA, 2002. ACM.
23. J. Rantala, R. Raisamo, J. Lylykangas, V. Surakka, J. Raisamo, K. Salminen, T. Pakkanen, and A. Hippula. Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. Haptics, IEEE Transactions on, 2(1):28--39, 2009.
24. H. Z. Tan, N. I. Durlach, W. M. Rabinowitz, C. M. Reed, and J. R. Santos. Reception of Morse code through motional, vibrotactile, and auditory stimulation. Perception & psychophysics, 59(7):1004--1017, 1997.
25. D. Wechsler. WAIS-R manual: Wechsler adult intelligence scale-revised. Psychological Corporation, 1981.
26. K. Yatani and K. N. Truong. SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 111--120. ACM, 2009

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices