Emoca Versions Save

Official repository accompanying a CVPR 2022 paper EMOCA: Emotion Driven Monocular Face Capture And Animation. EMOCA takes a single image of a face as input and produces a 3D reconstruction. EMOCA sets the new standard on reconstructing highly emotional images in-the-wild

EMOCA-v2.0.0

1 year ago

Release of EMOCA v2

New retrained of EMOCA that performs much better. Compared to the original model it produces:

  1. Much better lip and eye alignment
  2. Much better lip articulation

This is achieved by:

  1. Using a subset of mediapipe landmarks for mouth, eyes and eyebrows (as opposed to FAN landmarks that EMOCA v1 uses)
  2. Using absolute landmark loss in combination with the relative losses (as opposed to only relative landmark losses in EMOCA v1)
  3. Incorporating perceptual lip reading loss. Inspired by spectre. Big shout-out to these guys!

You will have to upgrade to the new environment in order to use EMOCA v2. This includes:

  • switching to Python 3.8
  • updating pytorch and pytorch3d
  • upating minor packages

Please follow the steps in the README

EMOCA-v1.0

1 year ago

The release of the code and model published in the original paper.