[Official FaceRig Guide] Advanced Face Tracking Calibration Tutorial

This guide describes the basic principles of video face tracking in FaceRig and it teaches you how to calibrate it for a better experience. Keep in mind that FaceRig uses video and audio tracking for lip movement, so for a better understanding of this tutorial we suggest turning audio Lipsync off.

Expression Units explained. Calibration in general.

Face Tracking is based on Expression Units mapped to specific face features and also to the avatar's gesture animation. They are basically defined by a numeric value which changes as you gesture. This value covers a slightly different interval from person to person, that means the minimum and maximum values you reach for each Expression Unit must be configured accordingly for your own face. FaceRig's default Expression Units intervals were configured such that it should work for each of our team members with a 70-90% accuracy.

The Expression Units are used to fine tune the tracking based on your appearance
and/or preferences. For example, if you want your avatar to keep his eyes half closed, here's
where you can adjust the values to get that result.
All expression units have a disable option so you can choose if you want the avatar to
completely ignore certain actions (for example pursed lips).
Tracker Input Range shows the minimum and maximum values for different
expressions. Min white bar means minimum value and has a certain action linked with it (e.g.
closed mouth), Max white bar represents the maximum value and has the opposite action
from the Max white bar linked to it (e.g. open mouth), and the black bar is the actual value that
the tracker outputs based on the user's actions.
To adjust the interval just pull the sliders.

You should drag the min and max markers such that the tracked value (the black marker) could reach both of them while doing specific face expressions (like moving your eyebrows up and down). Note that you cannot move the min marker on the right of the max one, and the max one to the left of the min one.


The Smoothing slider in the window interface. The Smoothing value filters the tracked value (the black marker) to reduce jitter/noise caused by various reasons (webcam image resolution, fps, image blurriness, bad lighting etc). Configuring Smoothing slider can achieve:

• with higher smoothing values - reduced uncontrollable avatar movements and also smoothed movements, but you will also delay the avatar reaction (it will seem like a lag)
  
• with lower smoothing values - responsive avatar movements, but the animation may be a little jittery

You can also disable a specific Expression Unit by pressing the Disable button if you are not satisfied with the tracking after calibrating it, but we recommend to try to make it work for you for a complete FaceRig experience :).

How to calibrate Jaw Drop

How to calibrate Purse Lips

How to calibrate Lip Stretch

How to calibrate Upper Lip Raiser

How to calibrate Eye Brows

How to calibrate Eye Pupil Position

How to calibrate Eye Closing (Fixing Lazy Eye Bug)

Pursed Lips Left/Right

[HeliosTXG]

I actually have a problem with the jaw derping to the left, hopefully these help me figure that one out, lol

[cocoayoc]

where'd the videos go?

[Noldo]

why your content is empty?

[76561198162644749]

@spigias Awesome! Feel free to post on the forums if you have any questions ;)

[spigias]

great help thank you!

[Vropoliz5]

How do you fix the tracker feed. My one just froze completely, is there a way to fix it. I assume when re-opening it it should fix it self. Ii just wanting to know if there is anyway to fix delays/lag in the tracker. Sometimes (before it froze just then) it would be delayed and glitch up the character abit. Is there a way to resolve this lag tracker issue with the camera?

[Tryyton]

nice guide, thanks

[TrueChaoS]

@Din85:

http://steamcommunity.com/app/274920/discussions/2/613935404221245524/

This thread might help you fix a few of your issues.

[Din Fox Girl]

Is there a fix for glasses users? It appears that the reflection from my glasses makes everything mess up.