Rapid design of articulated objects

Abstract

Designing articulated objects is challenging because, unlike with static objects, it requires complex decisions to be made regarding the form, parts, rig, poses, and motion. We present a novel 3D sketching system for rapidly authoring concepts of articulated objects for the early stages of design, when designers make such decisions. Compared to existing CAD software, which focuses on slowly but elaborately producing models consisting of precise surfaces and volumes, our system focuses on quickly but roughly producing models consisting of key curves through a small set of coherent pen and multi-touch gestures. We found that professional designers could easily learn and use our system and author compelling concepts in a short time, showing that 3D sketching can be extended to designing articulated objects and is generally applicable in film, animation, game, and product design.

References

1. Rahul Arora, Rubaiat Habib Kazi, Fraser Anderson, Tovi Grossman, Karan Singh, and George Fitzmaurice. 2017. Experimental evaluation of sketching on surfaces in VR. In Proc. CHI '17. 5643--5654.
2. Rahul Arora and Karan Singh. 2021. Mid-air drawing of curves on 3D surfaces in virtual reality. ACM Trans. Graph. 40, 3, Article 33 (Jul 2021), 17 pages.
3. Oscar Kin-Chung Au, Chiew-Lan Tai, and Hongbo Fu. 2012. Multitouch gestures for constrained transformation of 3D objects. Comput. Graph. Forum 31, 2 (2012), 651--660.
4. Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models. In Proc. UIST '08. 151--160.
5. Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2009. EverybodyLovesSketch: 3D sketching for a broader audience. In Proc. UIST '09. 59--68.
6. Ronald M. Baecker. 1969. Picture-driven animation. In Proc. AFIPS '69 (Spring). 273--288.
7. Péter Borosán, Ming Jin, Doug DeCarlo, Yotam Gingold, and Andrew Nealen. 2012. RigMesh: automatic rigging for part-based shape modeling and deformation. ACM Trans. Graph. 31, 6, Article 198 (Nov 2012), 9 pages.
8. Byungkuk Choi, Roger Blanco i Ribera, J. P. Lewis, Yeongho Seol, Seokpyo Hong, Haegwang Eom, Sunjin Jung, and Junyong Noh. 2016. SketchiMo: sketch-based motion editing for articulated characters. ACM Trans. Graph. 35, 4, Article 146 (Jul 2016), 12 pages.
9. Aurélie Cohé, Fabrice Dècle, and Martin Hachet. 2011. tBox: a 3D transformation widget designed for touch-screens. In Proc. CHI '11. 3005--3008.
10. Richard C. Davis, Brien Colwell, and James A. Landay. 2008. K-Sketch: a "kinetic" sketch pad for novice animators. In Proc. CHI '08. 413--422.
11. Pierre Dragicevic, Gonzalo Ramos, Jacobo Bibliowitcz, Derek Nowrouzezahrai, Ravin Balakrishnan, and Karan Singh. 2008. Video browsing by direct manipulation. In Proc. CHI '08. 237--246.
12. Marek Dvorožňák, Daniel Sýkora, Cassidy Curtis, Brian Curless, Olga Sorkine-Hornung, and David Salesin. 2020. Monster mash: a single-view approach to casual 3D modeling and animation. ACM Trans. Graph. 39, 6, Article 214 (Nov 2020), 12 pages.
13. Martin Guay, Rémi Ronfard, Michael Gleicher, and Marie-Paule Cani. 2015. Space-time sketching of character animation. ACM Trans. Graph. 34, 4, Article 118 (Jul 2015), 10 pages.
14. Yves Guiard. 1987. Asymmetric division of labor in human skilled bimanual action. J. Mot. Behav. 19, 4 (1987), 486--517.
15. Devamardeep Hayatpur, Seongkook Heo, Haijun Xia, Wolfgang Stuerzlinger, and Daniel Wigdor. 2019. Plane, ray, and point: enabling precise spatial manipulations with shape constraints. In Proc. UIST '19. 1185--1195.
16. Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + touch = new tools. In Proc. UIST '10. 27--36.
17. Takeo Igarashi and John F. Hughes. 2003. Smooth meshes for sketch-based freeform modeling. In Proc. I3D '03. 139--142.
18. Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: a sketching interface for 3D freeform design. In Proc. SIGGRAPH '99. 409--416.
19. Takeo Igarashi, Tomer Moscovich, and John F. Hughes. 2005. As-rigid-as-possible shape manipulation. ACM Trans. Graph. 24, 3 (Jul 2005), 1134--1141.
20. Ming Jin, Dan Gopstein, Yotam Gingold, and Andrew Nealen. 2015. AniMesh: interleaved animation, modeling, and editing. ACM Trans. Graph. 34, 6, Article 207 (Oct 2015), 8 pages.
21. Thorsten Karrer, Malte Weiss, Eric Lee, and Jan Borchers. 2008. DRAGON: a direct manipulation interface for frame-accurate in-scene video navigation. In Proc. CHI '08. 247--250.
22. Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, and George Fitzmaurice. 2014. Kitty: sketching dynamic and interactive illustrations. In Proc. UIST '14. 395--405.
23. Yongkwan Kim, Sang-Gyun An, Joon Hyub Lee, and Seok-Hyung Bae. 2018. Agile 3D sketching with air scaffolding. In Proc. CHI '18. Article 238, 12 pages.
24. Yongkwan Kim and Seok-Hyung Bae. 2016. SketchingWithHands: 3D sketching handheld products with first-person hand posture. In Proc. UIST '16. 797--808.
25. Joon Hyub Lee, Hyung-Gi Ham, and Seok-Hyung Bae. 2020. 3D sketching for multi-pose products. In CHI EA '20. Article 261, 8 pages.
26. Xiaolong Li, He Wang, Li Yi, Leonidas J. Guibas, A. Lynn Abbott, and Shuran Song. 2020. Category-level articulated object pose estimation. In Proc. CVPR '20. 3706--3715.
27. C. Karen Liu and Zoran Popović. 2002. Synthesis of complex dynamic character motion from simple animations. ACM Trans. Graph. 21, 3 (Jul 2002), 408--416.
28. Daniel Mendes, Fabio Marco Caputo, Andrea Giachetti, Alfredo Ferreira, and Joaquim Jorge. 2019. A survey on 3D virtual object manipulation: from the desktop to immersive virtual environments. Comput. Graph. Forum 38, 1 (2019), 21--45.
29. Andrew Nealen, Takeo Igarashi, Olga Sorkine, and Marc Alexa. 2007. FiberMesh: designing freeform surfaces with 3D curves. In Proc. SIGGRAPH '07. 41--es.
30. Jason L. Reisman, Philip L. Davidson, and Jefferson Y. Han. 2009. A screen-space formulation for 2D and 3D direct manipulation. In Proc. UIST '09. 69--78.
31. Tianjia Shao, Wilmot Li, Kun Zhou, Weiwei Xu, Baining Guo, and Niloy J. Mitra. 2013. Interpreting concept sketches. ACM Trans. Graph. 32, 4, Article 56 (Jul 2013), 10 pages.
32. Sebastian Starke, Norman Hendrich, Dennis Krupke, and Jianwei Zhang. 2017. Evolutionary multi-objective inverse kinematics on highly articulated and humanoid robots. In Proc. IROS '17. 6959--6966.
33. Matthew Thorne, David Burke, and Michiel van de Panne. 2004. Motion doodles: an interface for sketching character motion. ACM Trans. Graph. 23, 3 (Aug 2004), 424--431.
34. Benjamin Walther-Franks, Marc Herrlich, Thorsten Karrer, Moritz Wittenhagen, Roland Schröder-Kroll, Rainer Malaka, and Jan Borchers. 2012. DRAGIMATION: direct manipulation keyframe timing for performance-based animation. In Proc. GI '12. 101--108.
35. Lumin Yang, Jiajie Zhuang, Hongbo Fu, Xiangzhi Wei, Kun Zhou, and Youyi Zheng. 2021. SketchGNN: semantic sketch segmentation with graph neural networks. ACM Trans. Graph. 40, 3, Article 28 (Aug 2021), 13 pages.
36. Emilie Yu, Rahul Arora, Tibor Stanko, J. Andreas Bærentzen, Karan Singh, and Adrien Bousseau. 2021a. CASSIE: curve and surface sketching in immersive environments. In Proc. CHI '21. Article 190, 14 pages.
37. Xue Yu, Stephen DiVerdi, Akshay Sharma, and Yotam Gingold. 2021b. ScaffoldSketch: accurate industrial design drawing in VR. In Proc. UIST '21. 372--384.
38. Robert C. Zeleznik, Kenneth P. Herndon, and John F. Hughes. 1996. SKETCH: an interface for sketching 3D scenes. In Proc. SIGGRAPH '96. 163--170.
39. He Zhang, Sebastian Starke, Taku Komura, and Jun Saito. 2018. Mode-adaptive neural networks for quadruped motion control. ACM Trans. Graph. 37, 4, Article 145 (Jul 2018), 11 pages.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction techniques