FaceBaker: Baking Character Facial Rigs with Machine Learning

Sarah Radzihovsky, Fernando de Goes, Mark Meyer

Abstract:

Character rigs are procedural systems that deform a character's shape driven by a set of rig-control variables. Film quality character rigs are highly complex and therefore computationally expensive and slow to evaluate. We present a machine learning method for approximating facial mesh deformations which reduces rig computations, increases longevity of characters without rig upkeep, and enables portability of proprietary rigs into a variety of external platforms. We perform qualitative and quantitative evaluations on hero characters across several feature films, exhibiting the speed and generalizability of our approach and demonstrating that our method out performs existing state-of-the-art work on deformation approximations for character faces.

Paper (PDF)

Video