10.5555/946248.946801acmotherconferencesArticle/Chapter ViewAbstractPublication PagesismarConference Proceedings
Article

Multiview Paraperspective Projection Model for Diminished Reality

ABSTRACT

This paper introduces a "Diminished Reality" technique for removing an object or collection of objects andreplacing it with an appropriate background image. Diminished Reality can be considered an important part ofmany Mixed and Augmented Reality applications. Ourtarget application is the use of Augmented Reality (AR)to revamp procedures in industrial plants. An objector a region of interest is delineated on a single reference image. A paraperspective projection model is usedto generate the correct background from multiple calibrated views of the scene. We propose methods to dealwith approximately planar backgrounds with differentorientations. We also propose a multi-resolution approach to deal with non-planar backgrounds. Differentsets of experimental results demonstrate the success andlimits of the algorithms. Results on real data from water treatment and power plants show the usefulness ofthis method for industrial applications.

References

  1. Augmented reality for development, production and servicing (http://www.arvika.de), germany.Google ScholarGoogle Scholar
  2. Adelson and Wang. Representing moving images with layers. IEEE Transactions on Image Processing Special Issue: Image Sequence Compression, September 1994.Google ScholarGoogle Scholar
  3. E. H. Adelson and J. R. Bergen. The plenoptic function and elements of early vision. Computational Models of Visual Processing, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Appel and N. Navab. 3D reconstruction from co-registered orthographic and perspective images: Theoretical framework and applications. In IEEE Int. Conference on Pattern Recognition, August 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Appel and N. Navab. Registration of technical drawings and calibrated images for industrial augmented reality. In Machine Vision and Applications, volume 13, pages 111-118, 2002. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B., MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics and Applications, pages 21, (6):34-47, Nov/Dec 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. R. T. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, pages 355- 385, August 1997.Google ScholarGoogle Scholar
  8. W. Birkfellner, M. Figl, K. Huber, and e. a. Franz Watzinger. A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation. volume 21, pages 991-997, 2002.Google ScholarGoogle Scholar
  9. P. Burt and E. H. Adelson. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, October 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. T. P. Caudell and D. W. Mizell. Augmented reality: An application of heads-up display technology to manual manufactuing processes. In Proceedings of Hawaii International Conference on System Sciences, II:659- 669, January 1992.Google ScholarGoogle ScholarCross RefCross Ref
  11. P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. SIG- GRAPH96, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. C. R. Dyer. Volumetric scene reconstruction from multiple views. pages 469-489, 2001.Google ScholarGoogle Scholar
  13. R. Gortler, S. J. and Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. SIGGRAPH96, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. R. Horaud, F. Dornaika, B. Lamiroy, and S. Christy. Object pose: The link between weak perspective, paraperspective and full perspective. International Journal of Computer Vision, 22(2):173-189, March 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. A. Khamene, F. Wacker, S. Vogt, F. Azar, M. Wendt, F. Sauer, and J. Lewin. An augmented reality system for MRI-guided needle biopsies. In Proceedings of the 11th Annual Medicine Meets Virtual Reality Conference (MMVR), pages 151-157, Jan. 2003.Google ScholarGoogle Scholar
  16. G. Klinker, O. Creighton, A. Dutoit, R. Kobylinski, C. Vilsmeier, and B. B. Augmented maintenance of powerplants: A prototyping case study of a mobile AR system. October 2001.Google ScholarGoogle Scholar
  17. S. Laveau and O. Faugeras. 3-D scene representation as a collection of images and fundamental matrices. Proceedings of 12th International Conference on Pattern Recognition, 1, 1994.Google ScholarGoogle ScholarCross RefCross Ref
  18. V. Lepetit and M.-O. Berger. A semi-automatic method for resolving occlusion in augmented reality. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00), June 2000.Google ScholarGoogle ScholarCross RefCross Ref
  19. M. Levoy and P. Hanrahan. Light field rendering. SIG- GRAPH96, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. S. Mann and J. Fung. Videoorbits on eye tap devices for deliberately diminished reality or altering the isual perception of rigid planar patches of a real world scene. International Symposium on Mixed Reality (ISMR2001), March 2001.Google ScholarGoogle Scholar
  21. L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. SIGGRAPH95, August 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. F. Mourgues, D. F., and. Coste-Manire. 3D reconstruction of the operating field for image overlay in 3D-endoscopic surgery. International Symposium on Augmented Reality (ISAR 2001), Octber 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. N. Navab, B. Bascle, M. Appel, and E. Cubillo. Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration. In Proc. IEEE International Workshop on Augmented Reality (IWAR 99), October 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. N. Navab, E. Cubillo, B. Bascle, J. Lockau, K. Kamsties, and M. Neuberger. Cylicon: A software platform for the creation update of virtual factories. In 7th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA'99), October 1999.Google ScholarGoogle ScholarCross RefCross Ref
  25. F. Schaffalitzky and A. Zisserman. Viewpoint invariant texture matching and wide baseline stereo. In Proc. ICCV, July 2001.Google ScholarGoogle ScholarCross RefCross Ref
  26. S. M. Seitz and C. R. Dyer. View morphing. SIG- GRAPH96, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. R. Szeliski. Rapid octree construction from image sequences. CVGIP: Image Understanding, July 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. T. Tuytelaars and L. Van Gool. Wide baseline stereo matching based on local affinely invariant regions. In Proc. BMVC, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  29. L. Wang, S. Kang, R. Szeliski, and H. Shum. Optimal texture map reconstruction from multiple views. pages 347-354, December 2001.Google ScholarGoogle Scholar
  30. G. Wolberg and S. Zokai. Image registration for perspective deformation recovery. SPIE Conf. on Automatic Target Recognition X, April 2000.Google ScholarGoogle ScholarCross RefCross Ref
  31. X. Zhang, Y. Genc, and N. Navab. Taking AR into large scale industrial environments: Navigation and information access with mobile computers. October 2001.Google ScholarGoogle Scholar

Index Terms

  1. Multiview Paraperspective Projection Model for Diminished Reality

                Comments

                Login options

                Check if you have access through your login credentials or your institution to get full access on this article.

                Sign in
                • Published in

                  ACM Other conferences cover image
                  ISMAR '03: Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
                  October 2003
                  365 pages
                  ISBN:0769520065

                  Copyright © Copyright (c) 2003 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

                  Publisher

                  IEEE Computer Society

                  United States

                  Publication History

                  • Published: 7 October 2003

                  Qualifiers

                  • Article

                PDF Format

                View or Download as a PDF file.

                PDF

                eReader

                View online with eReader.

                eReader
                About Cookies On This Site

                We use cookies to ensure that we give you the best experience on our website.

                Learn more

                Got it!