Dinesh K. Pai
Doug L. James
ABSTRACT
We describe a system for constructing computer models of several aspects of physical interaction behavior, by scanning the response of real objects. The behaviors we can successfully scan and model include deformation response, contact textures for interaction with force-feedback, and contact sounds. The system we describe uses a highly automated robotic facility that can scan behavior models of whole objects. We provide a comprehensive view of the modeling process, including selection of model structure, measurement, estimation, and rendering at interactive rates. The results are demonstrated with two examples: a soft stuffed toy which has significant deformation behavior, and a hard clay pot which has significant contact textures and sounds. The results described here make it possible to quickly construct physical interaction models of objects for applications in games, animation, and e-commerce.
- 1.M.J. Black and P. Anandan. The Robust Estimation of Multiple Motions: Parametric and Piecewise-smooth Flow Fields. Computer Vision and Image Understanding, 63(1):75-104, 1996. Google Scholar
Digital Library
- 2.Y. Bouguet and P. Perona. 3D Photography on Your Desk. In Proc. ICCV98, pages 43-50, 1998. Google ScholarDigital Library
- 3.J.C. Brown and M.S. Puckette. A High Resolution Fundamental Frequency Determination Based on Phase Changes of the Fourier Transform. J. Acoust. Soc. Am., 94(2):662-667, 1993.Google ScholarCross Ref
- 4.M. Cohen, M. Levoy, J. Malik, L. McMillan, and E. Chen. Image-based Rendering: Really New or Deja Vu? ACM SIGGRAPH 97 Panel, pages 468 - 470. Google ScholarDigital Library
- 5.P.R. Cook. Integration of Physical Modeling for Synthesis and Animation. In Proceedings of the International Computer Music Conference, pages 525-528, Banff, 1995.Google Scholar
- 6.P.R. Cook and D. Trueman. NBody: Interactive Multidirectional Musical Instrument Body Radiation Simulations, and a Database of Measured Impulse Responses. In Proceedings of the International Computer Music Conference, San Francisco, 1998.Google Scholar
- 7.S. Cotin, H. Delingette, J-M Clement, V. Tassetti, J. Marescaux, and N. Ayache. Geometric and Physical Representations for a Simulator of Hepatic Surgery. In Proceedings of Medicine Meets Virtual Real ity IV, pages 139-151. IOS Press, 1996.Google Scholar
- 8.B. Curless and M. Levoy. A Volumetric Method for Building Complex Models from Range Images. In SIG- GRAPH 96 Conference Proceedings, pages 303-312, 1996. Google ScholarDigital Library
- 9.K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink. Re ectance and Texture of Real-world Surfaces. ACM Transactions on Graphics, 18(1):1-34, 1999. Google ScholarDigital Library
- 10.P. Debevec, T. Hawkins, C. Tchou, H-P Duiker, W. Sarokin, and M. Sagar. Acquiring the Re ectance Field of a Human Face. In SIGGRAPH 2000 Conference Proceedings, pages 145-156, 2000. Google ScholarDigital Library
- 11.P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In SIGGRAPH 96 Conference Proceedings, pages 11-20, 1996. Google ScholarDigital Library
- 12.T.A. Funkhouser, I. Carlbom, G. Pingali G. Elko, M. Sondhi, and J. West. Interactive Acoustic Modeling of Complex Environments. J. Acoust. Soc. Am., 105(2), 1999.Google Scholar
- 13.M. Garland and P.S. Heckbert. Surface Simplification Using Quadric Error Metrics. In SIGGRAPH 97 Conference Proceedings, pages 209-216, 1997. Google ScholarDigital Library
- 14.W.W. Gaver. Synthesizing Auditory Icons. In Proceedings of the ACM INTERCHI 1993, pages 228-235, 1993. Google ScholarDigital Library
- 15.D.P. Greenberg, K.E. Torrance, P. Shirley, J. Arvo, J.A. Ferwerda, S. Pattanaik, E.P.F. Lafortune, B. Walter, S. Foo, and B. Trumbore. A Framework for Realistic Image Synthesis. In SIGGRAPH 97 Conference Proceedings, pages 477-494, 1997. Google ScholarDigital Library
- 16.I. Guskov, K. Vidimce, W. Sweldens, and P. Schroder. Normal Meshes. In SIGGRAPH 2000 Conference Proceedings, pages 95-102, 2000. Google ScholarDigital Library
- 17.H. Hoppe, T. DeRose, T. Duchamp, M. Halstead, H. Jin, J. McDonald, J. Schweitzer, and W. Stuetzle. Piecewise Smooth Surface Reconstruction. In SIGGRAPH 94 Conference Proceedings, pages 295-302, 1994. Google ScholarDigital Library
- 18.D.L. James and D.K. Pai. ArtDefo, Accurate Real Time Deformable Objects. In SIGGRAPH 99 Conference Proceedings, pages 65-72, 1999. Google ScholarDigital Library
- 19.D.L. James and D.K. Pai. A Unified Treatment of Elastostatic Contact Simulation for Real Time Haptics. Haptics-e, The Electronic Journal of Haptics Research (www.haptics-e.org), 2001. (To appear).Google Scholar
- 20.J. Lang and D. K. Pai. Estimation of Elastic Constants from 3D Range-Flow. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, 2001.Google ScholarCross Ref
- 21.A. Lee, H. Moreton, and H. Hoppe. Displaced Subdivision Surfaces. In SIGGRAPH 2000 Conference Proceedings, pages 85-94, 2000. Google ScholarDigital Library
- 22.A. Lee, W. Sweldens, P. Schroder, L. Cowsar, and D. Dobkin. MAPS: Multiresolution Adaptive Parameterization of Surfaces. In SIGGRAPH 98 Conference Proceedings, pages 95-104, 1998. Google ScholarDigital Library
- 23.M. Levoy, et al. The Digital Michelangelo Project: 3D Scanning of Large Statues. In SIGGRAPH 2000 Conference Proceedings, pages 131-144, 2000. Google ScholarDigital Library
- 24.D. K. Pai, J. Lang, J. E. Lloyd, and J. L. Richmond. Reality-based Modeling with ACME: A Progress Report. In Proceedings of the Intl . Symp. on Experimental Robotics, 2000. Google ScholarDigital Library
- 25.D. K. Pai, J. Lang, J. E. Lloyd, and R. J. Woodham. ACME, A Telerobotic Active Measurement Facility. In Proceedings of the Sixth Intl . Symp. on Experimental Robotics, 1999. Google ScholarDigital Library
- 26.Z. Popovic and A. Witkin. Physically Based Motion Transformation. In SIGGRAPH 99 Conference Proceedings, pages 11-20, 1999. Google ScholarDigital Library
- 27.C. Rocchini, P. Cignoni, C.Montani, and P. Scopigno. Multiple Textures Stitching and Blending on 3D Objects. In 10th Eurographics Workshop on Rendering, pages 173-180, Granada, Spain, 1999. Google ScholarDigital Library
- 28.G. Roth and E. Wibowoo. An Efficient Volumetric Method for Building Closed Triangular Meshes from 3- D Image and Point Data. In Proc. Graphics Interface, pages 173-180, 1997. Google ScholarDigital Library
- 29.P.J. Rousseeuw. Least Median of Squares Regression. Journal of the American Statistical Association, 79(388):871-880, 1984.Google Scholar
- 30.P.J. Rousseeuw and K. Van Driessen. Computing LTS Regression for Large Data Sets. Technical report, University of Antwerp, 1999.Google Scholar
- 31.H. Rushmeier, F. Bernardini, J. Mittleman, and G. Taubin. Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Piet~ a. Eurographics Rendering Workshop 1998, pages 81-92, 1998.Google ScholarCross Ref
- 32.D.C. Ruspini, K. Kolarov, and O. Khatib. The Haptic Display of Complex Graphical Environments. In SIGGRAPH 97 Conference Proceedings, pages 345-352, 1997. Google ScholarDigital Library
- 33.Y. Sato, M.D. Wheeler, and K. Ikeuchi. Object Shape and Re ectance Modeling from Observation. In SIG- GRAPH 97 Conference Proceedings, pages 379-388, 1997. Google ScholarDigital Library
- 34.H. Spies, B. Jahne, and J.L. Barron. Dense Range Flow from Depth and Intensity Data. In International Conference on Pattern Recognition, pages 131-134, 2000. Google ScholarDigital Library
- 35.K. Steiglitz. A Digital Signal Processing Primer with Applications to Digital Audio and Computer Music. Addison-Wesley, New York, 1996. Google ScholarDigital Library
- 36.K. Steiglitz and L.E. McBride. A Technique for the Identification of Linear System. IEEE Trans. Automatic Control, AC-10:461-464, 1965.Google ScholarCross Ref
- 37.D. Terzopoulos, J. Platt, A. Barr, and K. Fleischer. Elastically Deformable Models. In Computer Graphics (SIGGRAPH 87 Proceedings), volume 21, pages 205- 214, 1987. Google ScholarDigital Library
- 38.T.R. Thomas. Rough Surfaces. Imperial College Press, London, second edition, 1999.Google Scholar
- 39.K. van den Doel, P.G. Kry, and D.K. Pai. FoleyAutomatic: Physically-based Sound Effects for Interactive Simulations and Animations. In SIGGRAPH 2001 Conference Proceedings, 2001. Google ScholarDigital Library
- 40.K. van den Doel and D.K. Pai. The Sounds of Physical Shapes. Presence, 7(4):382-395, 1998. Google ScholarDigital Library
- 41.S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade. Three-dimensional Scene Flow. In International Conference on Computer Vision, pages 722-729, 1999. Google ScholarDigital Library
- 42.M. Yamamoto, P. Boulanger, J.-A. Beraldin, and M. Rioux. Direct Estimation of Range Flow on Deformable Shape from a Video Rate Range Camera. PAMI, 15(1):82-89, 1993. Google ScholarDigital Library
- 43.Y. Zhang and C. Kambhamettu. Integrated 3D Scene Flow and Structure Recovery from Multiview Image Sequences. In Computer Vision and Pattern Recognition, volume 2, pages 674-681, 2000.Google ScholarCross Ref
Index Terms
Scanning physical interaction behavior of 3D objects
Recommendations
FoleyAutomatic: physically-based sound effects for interactive simulation and animation
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesWe describe algorithms for real-time synthesis of realistic sound effects for interactive simulations (e.g., games) and animation. These sound effects are produced automatically, from 3D models using dynamic simulation and user interaction. We develop ...
Scanning physical interaction behavior of 3D objects
SIGGRAPH '05: ACM SIGGRAPH 2005 CoursesWe describe a system for constructing computer models of several aspects of physical interaction behavior, by scanning the response of real objects. The behaviors we can successfully scan and model include deformation response, contact textures for ...
Adaptive local scanning: A comprehensive and intelligent method for fast scanning of indiscrete objects
2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)A pixel-by-pixel scanning that is usually performed by a single point-like sensor or probe is being widely used in the applications such as scanning probe microscopy techniques. Typically, their scanning time is several seconds to minutes long due to a ...
Reviews
Leslie Stephen Jennings
A system for gathering data about, and building mathematical models of, sensory interaction properties of real objects is summarized. The sensory interactive properties are 3D geometry and image, including deformation geometry for touching soft objects, and “touch” of hard objects using surface friction and sound. The data of an object is gathered by a highly automated robotic system built at the University of British Columbia. The sense of touch depends on both the object and the touching probe (soft, hard, pointed, broad, and so forth); the work described uses a hard, somewhat pointed probe, but the ideas are generalizable. The mathematical models discussed are chosen both for the accuracy of representation and for the efficiency of real time reproduction at a later time. The authors present their successes, and suggest where further work is needed. In particular, the modeling of the resonant sound of a hard object when pinged by another small hard object at a point on the object required much processing to find the minimal number of frequencies to adequately represent the sound as it attenuates over time. The paper has a large set of references pointing to similar work elsewhere and to the detail of much of the mathematical modeling. The paper summarizes the system and the modeling adequately for readers with mathematical training. Online Computing Reviews Service
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments