Image-based plant modeling

Abstract

In this paper, we propose a semi-automatic technique for modeling plants directly from images. Our image-based approach has the distinct advantage that the resulting model inherits the realistic shape and complexity of a real plant. We designed our modeling system to be interactive, automating the process of shape recovery while relying on the user to provide simple hints on segmentation. Segmentation is performed in both image and 3D spaces, allowing the user to easily visualize its effect immediately. Using the segmented image and 3D data, the geometry of each leaf is then automatically recovered from the multiple views by fitting a deformable leaf model. Our system also allows the user to easily reconstruct branches in a similar manner. We show realistic reconstructions of a variety of plants, and demonstrate examples of plant editing.

References

1. Besl, P., and McKay, N. 1992. A method for registration of 3D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2, 239--256.
2. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222--1239.
3. De Reffye, P., Edelin, C., Francon, J., Jaeger, M., and Puech, C. 1988. Plant models faithful to botanical structure and development. SIGGRAPH, 151--158.
4. Faugeras, O., Luong, Q., and Papadopoulo, T. 2001. The Geometry of Multiple Images. The MIT Press, Cambridge, MA, USA.
5. Han, F., and Zhu, S.-C. 2003. Bayesian reconstruction of 3d shapes and scenes from a single image. In Proc. IEEE Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 12--20.
6. Hartley, R., and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press, June.
7. Ijiri, T., Owada, O., Okabe, M., and Igarashi, T. 2005. Floral diagrams and inflorescences: Interactive flower modeling using botanical structural constraints. ACM Transactions on Graphics (SIGGRAPH) 24, 3 (July), 720--726.
8. Lhuillier, M., and Quan, L. 2005. A quasi-dense approach to surface reconstruction from uncalibrated images. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 3, 418--433.
9. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. SIGGRAPH 2004, Los Angeles, USA 23, 3, 303--308.
10. Mech, R., and Prusinkiewicz, P. 1996. Visual models of plants interacting with their environment. SIGGRAPH, 397--410.
11. Noser, H., and Thalmann, D. 1994. Simulating life of virtual plants, fishes and butterflies. In Artificial Life and Virtual Reality, N. Magnenat-Thalmann and D. Thalmann, Eds. John Wiley and Sons, Ltd.
12. Noser, H., Rudolph, S., and Stucki, P. 2001. Physics-enhanced L-systems. In Procs. 9th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, vol. 2, 214--221.
13. Prusinkiewicz, P., James, M., and Mech, R. 1994. Synthetic topiary. SIGGRAPH, 351--358.
14. Prusinkiewicz, P., Muendermann, L., Karwowski, R., and Lane, B. 2001. The use of positional information in the modeling of plants. SIGGRAPH, 289--300.
15. Reche-Martinez, A., Martin, I., and Drettakis, G. 2004. Volumetric reconstruction and interactive rendering of trees from photographs. ACM Transactions on Graphics (SIGGRAPH) 23, 3 (August), 720--727.
16. Sakaguchi, T., and Ohya, J. 1999. Modeling and animation of botanical trees for interactive virtual environments. In Procs. ACM Symposium on Virtual Reality Software and Technology, 139--146.
17. Sakaguchi, T. 1998. Botanical tree structure modeling based on real image set. In SIGGRAPH 1998 (Tech. Sketch), 272.
18. Shi, J., and Malik, J. 2000. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8, 888--905.
19. Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3d tree models from instrumented photographs. IEEE Computer Graphics and Applications 21, 3 (May/June), 53--61.
20. Van Haevre, W., and Bekaert, P. 2003. A simple but effective algorithm to model the competition of virtual plants for light and space. In Procs. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG'03).
21. Wang, L., Wang, W., Dorsey, J., Yang, X., Guo, B., and Shum, H.-Y. 2005. Real-time rendering of plant leaves. SIGGRAPH 2005, Los Angeles, USA 24, 3, 712--719.
22. Weber, J., and Penn, J. 1995. Creation and rendering of realistic trees. In SIGGRAPH, 119--127.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Reconstruction

  • Computer graphics

    • Shape modeling

• Software and its engineering

  • Software notations and tools

    • Development frameworks and environments

      • Application specific development environments