Data-Driven Simulation Methods in Computer Graphics: Cloth, Tissue and Faces
In recent years, the field of computer animation has witnessed the invention of multiple simulation methods that exploit pre-recorded data to improve the performance and/or realism of dynamic deformations. Various methods have been presented concurrently, and they present differences, but also similarities, that have not yet been analyzed or discussed. This course focuses on the application of data-driven methods to three areas of computer animation, namely dynamic deformation of faces, soft volumetric tissue, and cloth. The course describes the particular challenges tackled in a data-driven manner, classifies the various methods, and also shares insights for the application to other settings.
The explosion of data-driven animation methods and the success of their results make this course extremely timely. Up till now, the proposed methods have remained familiar only at the research context, and have not made their way through computer graphics industry. This course aims to fit two main purposes. First, present a common theory and understanding of data-driven methods for dynamic deformations that may inspire the development of novel solutions, and second, bridge the gap with industry, by making data-driven approaches accessible. The course targets an audience consisting of both researchers and programmers in computer animation.
Miguel A. Otaduy
Miguel A. Otaduy is an associate professor in the Department of Computer Science at Universidad Rey Juan Carlos (URJC Madrid). His main research areas are physically based computer animation and haptic rendering. He obtained his BS (2000) on electrical engineering from Mondragon University, and MS (2003) and PhD (2004) on computer science from the University of North Carolina at Chapel Hill. From 2005 to 2008 he was a research associate at ETH Zurich, and then he joined URJC Madrid. He has published over 50 papers in computer graphics and haptics, and has recently co-chaired the program committees for the ACM SIGGRAPH / Eurographics Symposium on Computer Animation (2010) and the Spanish Computer Graphics Conference (2010). He also leads the ERC Starting Grant Animetrics, on measurement-based modeling of complex mechanical phenomena
Bernd Bickel is a part-time visiting professor at TU Berlin and a post-doctoral researcher at Disney Research Zurich. His research interests include computer graphics and its applications in animation, biomechanics, material science,and computational design for digital fabrication. Recent work includes next generation 3D surface scanner devices, performance capture, measuring and modeling the deformation behavior of soft tissue, and animation tools. Bernd received a M.Sc. in Computer Science in 2006 and spent nine month at Mitsubishi Electric Research Laboratories under the supervision of Prof. Hanspeter Pfister. He wrote his PhD thesis at ETH Zurich in the Computer Graphics Lab headed by Prof. Markus Gross and defended in November 2010.
Derek Bradley is a postdoctoral researcher at Disney Research Zurich. He completed his Bachelor of Computer Science in 2003 and Master of Computer Science in 2005, both at Carleton University in Canada. In 2010, Derek obtained a PhD from the University of British Columbia in Canada, and then started with Disney Research Zurich in September 2010. Derek’s main research interest is real-world modeling and animation, primarily through computer vision techniques. He works on various 3D reconstruction projects including multiview stereo, facial performance capture, and data-driven simulation.
Huamin Wang is an assistant professor in the department of Computer Science and Engineering, at the Ohio State University. Previously, he was a postdoctoral researcher in the EECS department, at the University of California, Berkeley. He received his Ph.D. from Georgia Institute of Technology in 2009, M.S. from Stanford University in 2004 and B.Eng. from Zhejiang University in 2002. His research interests are in computer graphics, computer vision, and image processing techniques that are related to graphics and visualization applications. He is particularly interested in incorporating real-world data into physically based simulation techniques, so animations can be efficiently and realistically generated.
Tentative schedule. Final date and times TBA.
- 09:00 -- Introduction and overview of methods (Otaduy)
- 09:20 -- Tissue and Cloth Mechanics (Bickel/Otaduy)
- 09:50 -- Capturing Deformation Examples (Bradley)
- 10:30 -- Break
- 10:45 -- Facial Animation (Bickel)
- 11:25 -- Cloth Animation (Wang)
- 12:05 -- Conclusion / Q & A (All)
- 12:15 -- Close
High resolution (142Mb) [PDF]
Low resolution (15Mb) [PDF]
- Bickel, B., Lang, M., Botsch, M., Otaduy and Gross, M.
Pose-space animation and transfer of facial details.
Proc. of the ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 57-66, July 2008.
- Bickel, B., Bächer, M., Otaduy, M.A., Matusik, W., Pfister, H. and Gross, M.
Capture and modeling of non-linear heterogeneous soft tissue
ACM Transactions on Graphics, 28, 3, pp. 89:1-89:9, July 2009.
- Bickel, B., Bächer, M., Otaduy, M.A., Lee, H.R., Pfister, H., Gross, M and Matusik, W.
Design and fabrication of materials with desired deformation behavior.
ACM Transactions on Graphics, 29, 4, pp. 63:1-63:10, July 2010.
- Bradley, D., Boubekeur, T., and Heidrich, W.
Accurate multi-view reconstruction using robust binocular stereo and surface meshing.
Proc. CVPR 2008.
- Bradley, D., Popa, T., Sheffer, A., Heidrich, W and Boubekeur, T.
Markerless garment capture.
ACM Transactions on Graphics (Proc. of SIGGRAPH) 27, 3, 99:1-99:9, 2008.
- Bradley, D., Heidrich, W., Popa, T. and Sheffer, A.
High resolution passive facial performance capture.
ACM Transactions on Graphics (Proc. of SIGGRAPH) 29, 4, 41:1-41:10, 2010.
- Miguel, E., Bradley, D., Thomaszewski, B., Bickel, B., Matusik, W., Otaduy, M. A. and Marschner, S.
Data-driven estimation of cloth simulation models.
To appear in Computer Graphics Forum (Proc. of Eurographics) 31, 2, May 2012.
- Wang, H., Hecht, F., Ramamoorthi, R. and O'Brien, J.
Example-based wrinkle synthesis for clothing animation.
ACM Transactions on Graphics 29, 4, 107:1-107:8, July 2010.
- Wang, H., Ramamoorthi, R. and O'Brien, J.
Data-driven elastic models for cloth: modeling and measurement.
ACM Transactions on Graphics (Proc. SIGGRAPH) 30, 4, 71, 2011.
- Zurdo, J. S., Brito, J. P. and Otaduy, M. A.
Animating Wrinkles by Example on Non-Skinned Cloth.
To appear in IEEE Trans. on Visualization and Computer Graphics, 2012.
Modeling Nonlinear Soft Tissue from Captured Mechanical Data
Data-Driven Modeling of Nonlinear Elasticity in Cloth
Animation of Faces with Data-Driven Wrinkles
Clothing Animation with Wrinkle Synthesis from Examples
Capturing Geometry and Forces in Real Deformation Examples