Dextrous manipulation from a grasping pose

Abstract

This paper introduces an optimization-based approach to synthesizing hand manipulations from a starting grasping pose. We describe an automatic method that takes as input an initial grasping pose and partial object trajectory, and produces as output physically plausible hand animation that effects the desired manipulation. In response to different dynamic situations during manipulation, our algorithm can generate a range of possible hand manipulations including changes in joint configurations, changes in contact points, and changes in the grasping force. Formulating hand manipulation as an optimization problem is key to our algorithm's ability to generate a large repertoire of hand motions from limited user input. We introduce an objective function that accentuates the detailed hand motion and contacts adjustment. Furthermore, we describe an optimization method that solves for hand motion and contacts efficiently while taking into account long-term planning of contact forces. Our algorithm does not require any tuning of parameters, nor does it require any prescribed hand motion sequences.

References

1. Albrecht, I., Haber, J., and Seidel, H.-P. 2003. Construction and animation of anatomically based human hand models. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 98--109.
2. Aydin, Y., and Nakajima, M. 1999. Database guided computer animation of human grasping using forward and inverse kinematics. Computers and Graphics 23, 1, 145--154.
3. Bicchi, A. 1992. Optimal control of robotic grasping. In Proc. American Control Con., 778--779.
4. Brost, R. C. 1988. Automatic grasp planning in the presence of uncertainty. Int. J. Robotics Research 7, 3--17.
5. Cai, C., and Roth, B. 1987. On the spatial motion of a rigid body with point contact. In Proc. IEEE Int. Con. Robotics and Automation, 686--695.
6. Cheng, F. T., and Orin, D. E. 1990. Efficient algorithm for optimal force distribution-the compact dual lp method. IEEE Trans. Robot Automat. 6 (Apr.), 178--187.
7. ElKoura, G., and Singh, K. 2003. Handrix: Animating the human hand. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 110--119.
8. Fearing, R. 1986. Simlified grasping and manipulation with dexterous robot hands. IEEE Jour. on Robotics and Automation 2, 188--195.
9. Gill, P., Saunders, M., and Murray, W. 1996. Snopt: An sqp algorithm for large-scale constrained optimization. Tech. Rep. NA 96-2, University of California, San Diego.
10. Huang, Z., Boulic, R., and Thalmann, D. 1995. A multisensor approach for grasping and 3-D interaction. In Computer Graphics International '95.
11. Kerr, J., and Roth, B. 1986. Analysis of multifingered hands. Int. J. Robotics Research 4, 3--17.
12. Kim, J., Cordier, F., and Magnenat-Thalmann, N. 2000. Neural network-based violinists hand animation. In Conference on Computer Graphics International, 37--44.
13. Koga, Y., Kondo, K., Kuffner, J., and Latombe, J.-C. 1994. Planning motions with intentions. In SIGGRAPH, 395--408.
14. Kry, P. G., and Pai, D. K. 2006. Interaction capture and synthesis. ACM Trans. on Graphics 25, 3 (Aug.), 872--880.
15. Liu, C. K., Hertzmann, A., and Popović, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. on Graphics 24, 3 (July), 1071--1081.
16. Liu, C. K. 2008. Synthesis of interactive hand animation. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation.
17. Majkowska, A., Zordan, V., and Faloutsos, P. 2006. Automatic splicing for hand and body animation. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation.
18. Nguyen, V. D. 1986. Constructing force-closure grasps. In Proc. IEEE Int. Con. Robotics and Automation, 1368--1373.
19. Pollard, N. S., and Zordan, V. B. 2005. Physically based grasping control from example. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 311--318.
20. Popović, J., Seitz, S. M., Erdmann, M., Popović, Z., and Witkin, A. P. 2000. Interactive manipulation of rigid body simulations. 209--218.
21. Rosenbaum, D. A., and Jorgensen, M. J. 1992. Planning macroscopic aspects of manual control. Hum. Mov. Sci. 11, 61--69.
22. Safonova, A., Hodgins, J. K., and Pollard, N. S. 2004. Synthesizing physically realistic human motion in low-dimensinal, behavior-specific spaces. ACM Trans. on Graphics 23, 3, 514--521.
23. Sueda, S., Kaufman, A., and Pai, D. K. 2008. Musculotendon simulation for hand animation. ACM Trans. on Graphics 27, 3 (Aug.).
24. Tournassoud, P., Lozano-Perez, T., and Mazer, E. 1987. Regrasping. In Proc. IEEE Int. Con. Robotics and Automation, 1924--1928.
25. Tsang, W., Singh, K., and Fiume, E. 2005. Helping hand: An anatomically accurate inverse dynamics solution for unconstrained hand motion. In Eurographics/SIGGRAPH Symposium on Computer Animation, 1--10.
26. Witkin, A., and Kass, M. 1988. Spacetime constraints. In SIGGRAPH, vol. 22, 159--168.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation