Nicoletta Adamo-Villani
ABSTRACT
In this paper we describe the development of a new immersive 3D learning environment to increase mathematical skills of deaf children. The application teaches mathematical concepts and ASL (American Sign Language) math terminology through user interaction with fantasy 3D virtual signers and environments. The program can be displayed in immersive devices and includes a gesture control system comprised of a pair of pinch gloves and a 6-degrees-of-freedom wrist tracker.
Supplemental Material
- Adamo-Villani, N., Doublestein, J., and Martin, Z. 2004. The MathSigner: an Interactive Learning Tool for American Sign Language K-3 Mathematics. IEEE Proc. of IV04 - 8th International Conference on Information Visualization, London, 713--716. Google Scholar
Digital Library
- Adamo-Villani, N., Doublestein, J., and Martin, Z. 2005. Sign Language for K-8 Mathematics by 3D Interactive Animation. Journal of Educational Technology Systems, 33, 3, 243--259.Google ScholarCross Ref
- Arangarasan, R., Arns, L., And Bertoline, G. 2003. A Portable Passive Stereoscopic System for Teaching Engineering Design Graphics. American Society for Engineering Education (ASEE) Engineering Design Graphics Division 58th Annual Midyear Meeting, Scottsdale, AZ, 99--116.Google Scholar
- Balk, S. 2005. Virtual Reality Education for Assisted Learning Project. Proc. of Instructional Technology and Education of the Deaf: an International Symposium, NTID-RIT.Google Scholar
- Cromby, J., Standen, P., and Brown, D. 1995. Using Virtual Environments in Special Education. VR in the Schools, - coe.ecu.edu, 1, 3.Google Scholar
- Edge, R. 2001. VREAL: Virtual Reality Education for Assisted Learning. Proc. of Instructional Technology and Education of the Deaf: an International Symposium, NTID-RIT.Google Scholar
- Fakespace Labs, Pinch Glove. http://www.fakespacelabs.com/tools.htmlGoogle Scholar
- Fakespace Systems, Flex. http://www.fakespace.com/flexReflex.htmGoogle Scholar
- Greenleaf, W. J. 1992. DataGlove, DataSuit and Virtual Reality: Advanced Technology For People With Disabilities. Proc. of VR Conference, Northridge, CA: California State Center on Disabilities.Google Scholar
- Hernandez-Rebollar, J. L., and Kyriakopoulos, N. 2002. The AcceleGlove, a Whole-Hand Input for Virtual Reality. Proc. of Siggraph 2002 - Sketches and Applications, San Antonio TX. Google ScholarDigital Library
- Holt, J. A., Traxler, C. B., and Allen, T. E. 1997. Interpreting the Scores: A User's Guide to the 9th Edition Stanford Achievement Test for Educators of Deaf and Hard-of-Hearing Students. Washington, D.C., Gallaudet Research Institute.Google Scholar
- InterSense IS-900 Precision Motion Tracker. http://www.intersense.com/products/prec/is900/Google Scholar
- Kuroda, T., Yabata, Y., Goto, A., Ikuta, H. and Murakami, M. 2004. Consumer price data-glove for sign language recognition. Proc. of 5th Intl. Conf. Disability, Virtual Reality & Assoc. Tech., Oxford, UK.Google Scholar
- Lang, H. G., Mckee, B. G., and Conner, K. N. 1993. Characteristics of effective teachers: A descriptive study of perceptions of faculty and deaf college students. American Annals of the Deaf, 138, 3, 252--259.Google ScholarCross Ref
- National Science Task Force on Mathematics and Science Achievement, Preparing our children: math and science education in the national interest. National Science Foundation, Washington, D.C., 1999.Google Scholar
- NCAC (National Center on Accessing the General Curriculum) 2003. Virtual Reality/Computer Simulations. Curriculum Enhancement. U.S. Office of Special Education Programs.Google Scholar
- OpenSceneGraph. http://www.openscenegraph.orgGoogle Scholar
- VAMPLEW, P. 1996. Recognition of sign language gestures using neural networks. Proc. of 1st Euro. Conf. Disability, Virtual Reality & Assoc. Tech., Maidenhead, UK.Google Scholar
- VRJuggler. http://www.vrjuggler.orgGoogle Scholar
- Western PA School for the Deaf. Virtual Reality (VREAL) comes to WSPD. http://www.wpsd.org/technology/VReal03.htmlGoogle Scholar
- Youngblut, C. 1997. Educational Uses of Virtual Reality Technology. VR in the Schools, - coe.ecu.edu, 3, 1.Google Scholar
Index Terms
An immersive virtual environment for learning sign language mathematics
Recommendations
Immersive visualization anatomical environment using virtual reality devices
TEEM '16: Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing MulticulturalityAn immersive system allows the user to experience a virtual environment. For the interaction to be as natural as possible, special devices are used to immerse ourselves in a virtual environment. The use of mobile devices in teaching is already a ...
Design of a Mixed Reality-Based Immersive Virtual Environment System for Social Interaction and Behavioral Studies
Intelligent Human Computer InteractionAbstractThe advancements in immersive technologies allow us to create more sophisticated environments designed to help engage users by merging the physical world with a digital or simulated reality. These can range from completely immersive virtual ...
Exploring the potential of a 360° video application for foreign language learning
TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing MulticulturalityIn recent years, 360° videos combined with virtual reality (VR) techniques have been used to recreate highly interactive and immersive environments, allowing its users to directly experience and interact with its content and environment. Unlike ...
Comments