ABSTRACT
This paper introduces a "Diminished Reality" technique for removing an object or collection of objects andreplacing it with an appropriate background image. Diminished Reality can be considered an important part ofmany Mixed and Augmented Reality applications. Ourtarget application is the use of Augmented Reality (AR)to revamp procedures in industrial plants. An objector a region of interest is delineated on a single reference image. A paraperspective projection model is usedto generate the correct background from multiple calibrated views of the scene. We propose methods to dealwith approximately planar backgrounds with differentorientations. We also propose a multi-resolution approach to deal with non-planar backgrounds. Differentsets of experimental results demonstrate the success andlimits of the algorithms. Results on real data from water treatment and power plants show the usefulness ofthis method for industrial applications.
References
- Augmented reality for development, production and servicing (http://www.arvika.de), germany.Google Scholar
- Adelson and Wang. Representing moving images with layers. IEEE Transactions on Image Processing Special Issue: Image Sequence Compression, September 1994.Google Scholar
- E. H. Adelson and J. R. Bergen. The plenoptic function and elements of early vision. Computational Models of Visual Processing, 1991. Google Scholar
Digital Library
- M. Appel and N. Navab. 3D reconstruction from co-registered orthographic and perspective images: Theoretical framework and applications. In IEEE Int. Conference on Pattern Recognition, August 2002. Google Scholar
Digital Library
- M. Appel and N. Navab. Registration of technical drawings and calibrated images for industrial augmented reality. In Machine Vision and Applications, volume 13, pages 111-118, 2002. Springer-Verlag. Google Scholar
Digital Library
- R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B., MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics and Applications, pages 21, (6):34-47, Nov/Dec 2001. Google Scholar
Digital Library
- R. T. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, pages 355- 385, August 1997.Google Scholar
- W. Birkfellner, M. Figl, K. Huber, and e. a. Franz Watzinger. A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation. volume 21, pages 991-997, 2002.Google Scholar
- P. Burt and E. H. Adelson. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, October 1983. Google Scholar
Digital Library
- T. P. Caudell and D. W. Mizell. Augmented reality: An application of heads-up display technology to manual manufactuing processes. In Proceedings of Hawaii International Conference on System Sciences, II:659- 669, January 1992.Google Scholar
Cross Ref
- P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. SIG- GRAPH96, 1996. Google Scholar
Digital Library
- C. R. Dyer. Volumetric scene reconstruction from multiple views. pages 469-489, 2001.Google Scholar
- R. Gortler, S. J. and Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. SIGGRAPH96, 1996. Google Scholar
Digital Library
- R. Horaud, F. Dornaika, B. Lamiroy, and S. Christy. Object pose: The link between weak perspective, paraperspective and full perspective. International Journal of Computer Vision, 22(2):173-189, March 1997. Google Scholar
Digital Library
- A. Khamene, F. Wacker, S. Vogt, F. Azar, M. Wendt, F. Sauer, and J. Lewin. An augmented reality system for MRI-guided needle biopsies. In Proceedings of the 11th Annual Medicine Meets Virtual Reality Conference (MMVR), pages 151-157, Jan. 2003.Google Scholar
- G. Klinker, O. Creighton, A. Dutoit, R. Kobylinski, C. Vilsmeier, and B. B. Augmented maintenance of powerplants: A prototyping case study of a mobile AR system. October 2001.Google Scholar
- S. Laveau and O. Faugeras. 3-D scene representation as a collection of images and fundamental matrices. Proceedings of 12th International Conference on Pattern Recognition, 1, 1994.Google Scholar
Cross Ref
- V. Lepetit and M.-O. Berger. A semi-automatic method for resolving occlusion in augmented reality. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00), June 2000.Google Scholar
Cross Ref
- M. Levoy and P. Hanrahan. Light field rendering. SIG- GRAPH96, 1996. Google Scholar
Digital Library
- S. Mann and J. Fung. Videoorbits on eye tap devices for deliberately diminished reality or altering the isual perception of rigid planar patches of a real world scene. International Symposium on Mixed Reality (ISMR2001), March 2001.Google Scholar
- L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. SIGGRAPH95, August 1995. Google Scholar
Digital Library
- F. Mourgues, D. F., and. Coste-Manire. 3D reconstruction of the operating field for image overlay in 3D-endoscopic surgery. International Symposium on Augmented Reality (ISAR 2001), Octber 2001. Google Scholar
Digital Library
- N. Navab, B. Bascle, M. Appel, and E. Cubillo. Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration. In Proc. IEEE International Workshop on Augmented Reality (IWAR 99), October 1999. Google Scholar
Digital Library
- N. Navab, E. Cubillo, B. Bascle, J. Lockau, K. Kamsties, and M. Neuberger. Cylicon: A software platform for the creation update of virtual factories. In 7th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA'99), October 1999.Google Scholar
Cross Ref
- F. Schaffalitzky and A. Zisserman. Viewpoint invariant texture matching and wide baseline stereo. In Proc. ICCV, July 2001.Google Scholar
Cross Ref
- S. M. Seitz and C. R. Dyer. View morphing. SIG- GRAPH96, 1996. Google Scholar
Digital Library
- R. Szeliski. Rapid octree construction from image sequences. CVGIP: Image Understanding, July 1993. Google Scholar
Digital Library
- T. Tuytelaars and L. Van Gool. Wide baseline stereo matching based on local affinely invariant regions. In Proc. BMVC, 2000.Google Scholar
Cross Ref
- L. Wang, S. Kang, R. Szeliski, and H. Shum. Optimal texture map reconstruction from multiple views. pages 347-354, December 2001.Google Scholar
- G. Wolberg and S. Zokai. Image registration for perspective deformation recovery. SPIE Conf. on Automatic Target Recognition X, April 2000.Google Scholar
Cross Ref
- X. Zhang, Y. Genc, and N. Navab. Taking AR into large scale industrial environments: Navigation and information access with mobile computers. October 2001.Google Scholar
Index Terms
Multiview Paraperspective Projection Model for Diminished Reality




Comments