Research Smart Materials Complex Assemblies Computational Design Computational Caustics Past Projects

Human Modeling and Tracking

Performance capture is about bringing digital characters to life by capturing the geometry and motion of real human performances.

Short Summary

Our research covers the full pipeline for data-driven modeling and animation of virtual avatars, which includes real-time markerless acquisition, tracking in non-rigid partial data, deformable shape completion, motion-retargeting, and automatic character rigging.

 

Publications

 

Online Generative Model Personalization for Hand Tracking

Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2017

Paper Webpage

Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization

Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly

International Conference on Computer Vision (ICCV), 2017

Paper Webpage

Phace: Physics-based Face Modeling and Animation

Alexandru-Eugen Ichim, Petr Kadlecek, Ladislav Kavan, Mark Pauly

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2017

Paper Webpage

Sphere-Meshes for Real-Time Hand Modeling and Tracking

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2016

Paper Webpage

Reconstructing Personalized Anatomical Models for Physics-based Body Animation

Petr Kadlecek (*), Alexandru-Eugen Ichim (*), Tiantian Liu, Ladislav Kavan, Jaroslav Krivanek
(* joint first authors)

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2016

Paper Webpage

Building and Animating User-Specific Volumetric Face Rigs

Alexandru-Eugen Ichim, Ladislav Kavan, Merlin Nimier-David, Mark Pauly

ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA), 2016

Paper Webpage

Robust Articulated-ICP for Real-Time Hand Tracking

Andrea Tagliasacchi, Matthias Schroder, Anastasia Tkach, Sofien Bouaziz, Mario Botsch, Mark Pauly

Eurographics Symposium on Geometry Processing 2015

Paper Webpage

Realtime Face Tracking and Animation

Sofien Bouaziz, Mark Pauly (Dir.)

EPFL PhD Thesis No. 6666

Thesis Webpage

Dynamic 3D Avatar Creation from Hand-held Video Input

Alexandru Eugen Ichim, Sofien Bouaziz, Mark Pauly
ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2015

Paper Webpage

Online Modeling For Realtime Facial Animation

Sofien Bouaziz, Yangang Wang, Mark Pauly
ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2013

Webpage Paper

Realtime Performance-Based Facial Animation

Thibaut Weise, Sofien Bouaziz, Hao Li, Mark Pauly
ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2011

Webpage Paper

Example-Based Facial Rigging

Hao Li, Thibaut Weise, Mark Pauly
ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2010

Paper Webpage

Face/Off: Live Facial Puppetry

Thibaut Weise, Hao Li, Luc Van Gool and Mark Pauly
ACM Siggraph/Eurographics Symposium on Computer Animation 2009, best paper award

Paper

Dynamic 2D/3D Registration

Sofien Bouaziz, Andrea Tagliasacchi, Mark Pauly
Eurographics 2014 Tutorial Notes

Webpage Paper Code

Robust Single-View Geometry and Motion Reconstruction

Hao Li, Bart Adams, Leonidas Guibas, Mark Pauly
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 2009

Webpage Paper

Global Correspondence Optimization for Non-Rigid Registration of Depth Scans

Hao Li, Robert W. Sumner, Mark Pauly
Computer Graphics Forum (Proceedings of SGP) 2008

Webpage Paper

 

Faceshift is an LGG/EPFL spin-off based in Technopark Zurich. Their software analyzes the face motions of an actor, and describes them as a mixture of basic expressions, plus head orientation and gaze. This description is then used to animate virtual characters for use in movie or game production. They have astonishing real time tracking and a high quality offline post-processing in a single, convenient application.

Webpage