Abstract
In order to leverage the use of various modalities such as audio-visual materials in instilling effective learning behavior we present an intuitive approach of annotation based hapto-audio-visual interaction with the traditional digital learning materials such as e-books. By integrating the home entertainment system in the user's reading experience combined with haptic interfaces we want to examine whether such augmentation of modalities influence the user's learning patterns. The proposed Haptic E--Book (HE-Book) system leverages the haptic jacket, haptic arm band as well as haptic sofa interfaces to receive haptic emotive signals wirelessly in the form of patterned vibrations of the actuators and expresses the learning material by incorporating image, video, 3D environment based augmented display in order to pave ways for intimate reading experience in the popular mobile e-book platform.
- Alam, K. M., Hardy, S., Akther, A., and El Saddik, A. 2011a. SMS text based affective haptic application. In Proceedings of the Virtual Reality International Conference (VRIC'11).Google Scholar
- Alam, K. M., Rahman, A. S. M. M., and El Saddik, A. 2011b. HE-book: A prototype haptic interface for immersive e-book reading experience. In Proceedings of the World Haptics Conference (WHC'11). IEEE. 367--371. http://dx.doi.org/10.1109/WHC.2011.5945514.Google Scholar
Cross Ref
- Alam, K. M., Rahman, M. A., El Saddik, A., and Gueaieb, W. 2011c. Adding emotional tag to augment context-awareness in social network services. In Proceedings of the Instrumentation and Measurement Technology Conference (I2MTC'11). IEEE, 1--6. http://dx.doi.org/10.1109/IMTC.2011.5944225.Google Scholar
- Arafsha, F., Alam, K. M., and El Saddik A. 2012. EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion. In Proceedings of the International Conference on Innovations in Information Technology. 350--355. http://dx.doi.org/10.1109/INNOVATIONS.2012.6207766.Google Scholar
Cross Ref
- Barghout, A., Cha, J., El Saddik, A., Kammerl, J., and Steinbach, E. 2009. Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion. In Proceedings of the IEEE International Workshop on HAVE. 19--23.Google Scholar
- Billinghurst, M., Kato, H., and Poupyrev, I. 2001. The MagicBook: Moving seamlessly between reality and virtuality. IEEE Comput. Graph. Appl. 21, 3, 6--8. http://dx.doi.org/10.1109/38.920621. Google Scholar
Digital Library
- Brewster, S. A., Chohan, F., and Brown L. M. 2007. Tactile feedback for mobile interactions. In Proceedings of the Conference on Human Factors in Computing Systems. ACM Press, 159--162. Google Scholar
Digital Library
- Brunken, R., Plass, J. L., and Leutner, D. 2003. Direct measurement of cognitive load in multimedia learning. Educ. Psych. 38, 1, 53--61. http://www.informaworld.com/10.1207/S15326985EP3801n 7.Google Scholar
Cross Ref
- Card, S. K., Hong, L., Mackinlay, J. D., Chi, E. H., and Chi, H. 2004. 3Book: A scalable 3D virtual book. In Extended Abstracts of the Conference on Human Factors and Computing Systems, ACM Press, 1095--1098. Google Scholar
Digital Library
- Carney, R. and Levin, J. 2002. Pictorial illustrations still improve students' learning from text. Educ. Psych. Rev. 14, 5--26. http://dx.doi.org/10.1023/A:1013176309260 10.1023/A:1013176309260.Google Scholar
Cross Ref
- Carver, R. P. 1992. Reading rate: theory, research, and practical implications. J. Read. 36, 2, 84--95. http://www.jstor.org/stable/40016440.Google Scholar
- Chen, N., Guimbretiere, F., Dixon, M., Lewis, C., and Agrawala, M. 2008. Navigation techniques for dual-display e-book readers. In Proceeding of the SIGCHI conference on Human factors in computing systems (CHI'08). ACM, 1779--1788. Google Scholar
Digital Library
- Dale, E. 1969. Audio-Visual Methods in Teaching. Rinehart and Winston.Google Scholar
- Grasset, R., Dunser, A., and Billinghurst, M. 2008. The design of a mixed-reality book: Is it still a real book? In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR'08). 99--102. http://dx.doi.org/10.1109/ISMAR.2008.4637333. Google Scholar
Digital Library
- Gupta, S. and Jaynes, C. 2006. The universal media book: tracking and augmenting moving surfaces with projected information. In Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, 177--180. Google Scholar
Digital Library
- Haans, A. and Ijsselsteijn, W. 2006. Mediated social touch: a review of current research and future directions. Virtual Real. 9, 2, 149--159. Google Scholar
Digital Library
- Harrison, B. L. 2000. E-books and the future of reading. IEEE Comput. Graph. Appl. 20, 32--39. Google Scholar
Digital Library
- Hoggan, E., Brewster, S. A., and Johnston, J. 2008. Investigating the effectiveness of tactile feedback for mobile touchscreens. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, New York, 1573--1582. Google Scholar
Digital Library
- Hong, L., Chi, E. H., and Card, S. K. 2005. Annotating 3D electronic books. In Extended Abstracts of the Conference on Human Factors in Computing Systems, ACM, 463--1466. Google Scholar
Digital Library
- Kameyama, S. and Ishibashi, Y. 2006. Perception of synchronization errors in haptic and visual communications. Proc. SPIE 6391, 639108. http://dx.doi.org/doi:10.1117/12.685686.Google Scholar
- Lemmens, P., Crompvoets, F., Brokken, D., van den Eerenbeemd, J., and de Vries, G.-J. 2009. A body-conforming tactile jacket to enrich movie viewing. In Proceedings of the 3rd Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 7--12. http://dx.doi.org/10.1109/WHC.2009.4810832. Google Scholar
Digital Library
- Likert, R. 1932. A technique for the measurement of attitudes. Arch. Psych. 140, 1--55.Google Scholar
- Mangent, A. 2008. Hypertext fiction reading: Haptics and immersion. Res. Read. 31, 4, 404--419. http://dx.doi.org/10.1111/j.1467-9817.2008.00380.x.Google Scholar
Cross Ref
- Park, A., Lee, K. J., and Casalegno, F. 2010. The three dimensions of book evolution in ubiquitous computing age: Digitalization, augmentation, and hypermediation. In Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing. 374--378. http://dx.doi.org/10.1109/SUTC.2010.50. Google Scholar
Digital Library
- Park, J. and Woo, W. 2009. Multi-layer based authoring tool for Digilog book. In Proceedings of the International Conference on Entertainment Computing (ICEC'09). S. Natkin and J. Dupire, Eds., Lecture Notes in Computer Science, vol. 5709, Springer, 234--239. http://dx.doi.org/10.1007/978-3-642-04052-8n 26 10.1007/978-3-642-04052-826. Google Scholar
Digital Library
- Park, T., Hwang, J., and Hwang, W. 2009. Facilitating the design of vibration for handheld devices. In Human- Computer Interaction. Novel Interaction Methods and Techniques, J. Jacko, Ed., Lecture Notes in Computer Science, vol. 5611, Springer, 496--502. Google Scholar
Digital Library
- Rahal, L., Cha, J., and El Saddik, A. 2009. Continuous tactile perception for vibrotactile displays. In Proceedings of the IEEE International Workshop on Robotic and Sensors Environments (ROSE'09). 86--91. http://dx.doi.org/10.1109/ROSE.2009.5355986.Google Scholar
Cross Ref
- Rahman, A. S. M. M., Alam, K. M., and El Saddik, A. 2011. Augmented he-book: A multimedia-based extension to support immersive reading experience. In Proceedings of the 2nd International Conference on Autonomous and Intelligent Systems (AIS'11). Springer, 321--330. http://dl.acm.org/citation.cfm?id=2026956.2026992. Google Scholar
Digital Library
- Rahman, A. S. M. M., Hossain, S. K. A., and El Saddik, A. 2010. Bridging the gap between virtual and real world by bringing an interpersonal haptic communication system in second life. In Proceedings of the IEEE International Symposium on Multimedia. Google Scholar
Digital Library
- Schilit, B. N., Price, M. N., Golovchinsky, G., Tanaka, K., and Marshall, C. C. 1999. The reading appliance revolution. Computer 32, 1, 65--73. http://dx.doi.org/10.1109/2.738306. Google Scholar
Digital Library
- Taketa, N., Hayashi, K., Kato, H., and Noshida, S. 2007. Virtual pop-up book based on augmented reality. In Human Interface and the Management of Information. Interacting in Information Environments, M. Smith and G. Salvendy, Eds., Lecture Notes in Computer Science, vol. 4558, Springer, 475--484. http://dx.doi.org/10.1007/978-3-540-73354-6n52 10.1007/978-3-540-73354-652. Google Scholar
Digital Library
- Toutanova, K. and Manning, C. D. 2000. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora. 63--70. Google Scholar
Digital Library
- Welch, G., State, A., Ilie, A., Low, K.-L., Lastra, A., Cairns, B., Towles, H., Fuchs, H., Yang, R., Becker, S., Russo, D., Funaro, J., and van Dam, A. 2005. Immersive electronic books for surgical training. IEEE Multimedia 12, 3, 22--35. http://dx.doi.org/10.1109/MMUL.2005.48. Google Scholar
Digital Library
Index Terms
Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments
Recommendations
Envisioning Haptic Design for Immersive Virtual Environments
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems ConferenceCurrent techniques for haptics in immersive virtual environments (IVEs) allow users to perceive materials while exploring virtual surfaces. However, these experiences are usually restricted to the properties defined during the design phase of the IVE. ...
A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment
This study presents a 3D virtual reality (VR) keyboard system with realistic haptic feedback. The system uses two five-fingered data gloves to track finger positions and postures, uses micro-speakers to create simulated vibrations, and uses a head-...
Presence in immersive virtual environments
VRAIS '93: Proceedings of the 1993 IEEE Virtual Reality Annual International SymposiumImmersive virtual environments (IVEs) provide a tightly coupled human-computer interface; input to the sensory organs of the human participant are directly generated through computer displays, in the visual, auditory, tactile and haptic modalities. Some ...






Comments