10.1145/2556288.2557125acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedings
research-article

The use of surrounding visual context in handheld AR: device vs. user perspective rendering

ABSTRACT

The magic lens paradigm, a commonly used descriptor for handheld Augmented Reality (AR), presents the user with dual views: the augmented view (magic lens) that appears on the device, and the real view of the surroundings (what the user can see around the perimeter of the device). The augmented view is typically implemented by rendering the video captured by the rear-facing camera directly onto the device's screen. This results in dual perspectives - the real world being captured from the device's perspective rather than the user's perspective (what an observer would see looking through a transparent glass pane). These differences manifest themselves in misaligned and/or incorrectly scaled transparency resulting in the dual-view problem.

This paper presents two user studies comparing (a) device-perspective and (b) fixed Point-of-View (POV) user-perspective magic lenses to analyze the effect of the dual-view problem on the use of the surrounding visual context. The results confirm that the dual-view problem, a result of dual perspective, has a significant effect on the use of information from the surrounding visual context. The study also highlights that magnification and not the dual-view problem is the key factor explaining the correlation between magic lens size and the increased intensity of the magic lens type effect. From the results, we derive design guidelines for future magic lenses.

References

  1. Artur, K. W., Booth, K. S., and Ware, C. Evaluating 3D task performance for fish tank virtual worlds. In TOIS '93, 239--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Asteriadis, S., Karpouzis, K., and Kollias, S. Head pose estimation with one camera in uncalibrated environments. In EGIHMI '10, 55--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Baricević, D., Lee, C., Höllerer, T., and Bowman, D. A. A hand-held AR magic lens with user-perspective rendering. In ISMAR'12, 197--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Baudisch, P., Good, N., Bellotti, V., and Schraedley, P. Keeping things in context: A comparative evaluation of focus plus context screens, overviews, and zooming. In SIGCHI '02, 259--266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Baudisch, P., Good, N., and Stewart, P. Focus plus context screens: combining display technology with visualization techniques. In UIST '01, 31--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In SIGGRAPH '93, 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Butts, D. R. W and McAllister, D. F. Implementation of true 3D cursors in computer graphics. In proc. SPIE, vol. 902, 74--84, 1988.Google ScholarGoogle Scholar
  8. Copic Pucihar, K., Coulton, P., and Alexander, J. Creating a stereoscopic magic-lens to improve depth perception in handheld augmented reality. In MobileHCI '13, 448--451. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Copic Pucihar, K., Coulton, P., and Alexander, J. Evaluating dual-view perceptual issues in handheld augmented reality: Device vs. user perspective rendering. In ICMI '13, 381--388. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Drascic, D. and Milgram, P. Perceptual issues in augmented reality. In proc. SPIE, vol. 2653, 123--134.Google ScholarGoogle Scholar
  11. Duwaer, L. and Brink, G. What is the diplopia threshold? Perception & psychophysics, vol. 29, no. 4, 295--309, 1981.Google ScholarGoogle Scholar
  12. Furnas, G. Generalized fisheye views. In CHI '86, 16--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hill, A., Wilson, J., Davidson, B., Gandy, M., and Macintyre, B. Virtual transparency: Introducing parallax view into video see-through AR, In ISMAR '11, 239--240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jauregui, D. A. G., Argelaguet, F., and Lecuyer, A. Design and evaluation of 3D cursors and motionparallax for the exploration of desktop virtual environments. In 3DUI '12, 69--76.Google ScholarGoogle Scholar
  15. Klein, G. and Murray, D. Parallel tracking and mapping on a camera phone. In ISMAR '09, 83--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kruijff, E., Swan, J. E., and Feiner, S. Perceptual issues in augmented reality revisited. In ISMAR '09, 3--12.Google ScholarGoogle Scholar
  17. Kurz, D. and Benhimane, S. Gravity-aware handheld augmented reality. In ISMAR '11, 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Liao, C., Liu, Q., Liew, B., and Wilcox, L. Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone. In CHI '10, 2441--2450. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Matsuda, Y., Shibata, F., and Tamura, A. Creating a user-specific perspective view for mobile mixed reality systems on smartphones. In 3DUI '13, 157--158.Google ScholarGoogle Scholar
  20. Mehra, S., Werkhoven, P., and Worring, M. Navigating on handheld displays: Dynamic versus static peephole navigation. In TOCHI '06, 448--457. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Oh, J. and Hua, H. User evaluations on form factors of tangible magic lenses. In ISMAR '06, 23--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Olsson, T., and Salo, M. Online user survey on current mobile augmented reality applications. In ISMAR '11, 75--84. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Robbins, D. C., Cutrell, E., Sarin, R., and Horvitz, E. ZoneZoom: Map navigation for smartphones with recursive view segmentation. In AVI '04, 231--234. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Rohs, M., Schöning, J., Schleicher, R., Essl, G., Naumann, A., and Krüger, A. Impact of Item Density on Magic Lens Interactions. In MobileHCI '09, 1--4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Rohs, M., Schöning, M., Raubal, G., Essl, and Krüger, A. Map navigation with mobile devices: Virtual versus physical movement with and without visual context. In ICMI' 07, 146--153. Google ScholarGoogle ScholarDigital LibraryDigital Library

Supplemental Material

pn0916-file3.m4v

Index Terms

  1. The use of surrounding visual context in handheld AR

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!