Drag-and-drop pasting

Abstract

In this paper, we present a user-friendly system for seamless image composition, which we call drag-and-drop pasting. We observe that for Poisson image editing [Perez et al. 2003] to work well, the user must carefully draw a boundary on the source image to indicate the region of interest, such that salient structures in source and target images do not conflict with each other along the boundary. To make Poisson image editing more practical and easy to use, we propose a new objective function to compute an optimized boundary condition. A shortest closed-path algorithm is designed to search for the location of the boundary. Moreover, to faithfully preserve the object's fractional boundary, we construct a blended guidance field to incorporate the object's alpha matte. To use our system, the user needs only to simply outline a region of interest in the source image, and then drag and drop it onto the target image. Experimental results demonstrate the effectiveness of our "drag-and-drop pasting" system.

References

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. Proceedings of ACM SIGGRAPH 23, 3, 294--302.
2. Berman, A., Vlahos, P., and Dadourian, A. 2000. Comprehensive method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,345.
3. Boykov, Y., and Jolly, M. P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. In Proceedings of ICCV.
4. Burt, P. J., and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. In ACM Transactions on Graphics, vol. 2, 217--236.
5. Chuang, Y., Curless, B., Salesin, D., and Szeliski, R. 2001. A bayesian approach to digital matting. In Proceedings of CVPR01, vol. 2, 264--271.
6. Dijkstra, E. W. 1959. A note on two problems in connexion with graphs. Numerische Mathematik 1, 269--270.
7. Jia, J., and Tang, C.-K. 2005. Eliminating structure and intensity misalignment in image stitching. In Proceedings of ICCV.
8. Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graph-cut textures: image and video synthesis using graph cuts. Proceedings of ACM SIGGRAPH 22, 3, 277--286.
9. Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In Proceedings of ECCV, Vol IV: 377--389.
10. Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. Proceedings of ACM SIGGRAPH, 303--308.
11. McGuire, M., Matusik, W., Pfister, H., Hughes, J. F., and Durand, F. 2005. Defocus video matting. In Proceedings of ACM SIGGRAPH, vol. 24, 567--576.
12. Mortensen, E. N., and Barrett, W. A. 1995. Intelligent scissors for image composition. Proceedings of ACM SIGGRAPH, 191--198.
13. Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. Proceedings of ACM SIGGRAPH, 313--318.
14. Rother, C., Kolmogorov, V., and Blake, A. 2004. "grabcut" - interactive foreground extraction using iterated graph cuts. Proceedings of ACM SIGGRAPH, 309--314.
15. Ruzon, M., and Tomasi, C. 2000. alpha estimation in natural images. In Proceedings of CVPR00, 18--25.
16. Shum, H.-Y., Sun, J., Yamazaki, S., Li, Y., and Tang, C.-K. 2004. Popup light field: An interactive image-based modeling and rendering system. ACM Trans. Graph. 23, 2, 143--162.
17. Smith, A., and Blinn, J. 1996. Blue screen matting. Proceedings of ACM SIGGRAPH, 259--268.
18. Sun, J., Jia, J., Tang, C., and Shum, H. 2004. Poisson matting. Proceedings of ACM SIGGRAPH, 315--321.
19. Zwillinger, D. 1997. Handbook of Differential Equations, 3rd ed. Boston, MA: Academic Press.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Interest point and salient region detections

  • Computer graphics

    • Shape modeling

      • Point-based models

• Theory of computation

  • Randomness, geometry and discrete structures