Face Tracking Comparison
Compare face-tracking parameter support by tracking source.
TLDR
Facial Motion Capture result:
iOS >> Android = PC
In a short word, use iOS device for best Facial Tracking result!
PS: You could get a second-handed iPhone with FACEID for a fair price
Method Overview
| Method | Platform | Hardware | App | Blendshapes | FPS |
|---|---|---|---|---|---|
| iPhone — Standard | iOS | Any Face ID iPhone | VTube Studio iOS | Up to 52 | 60 |
| iPhone — VParamix | iOS | Face ID iPhone (A12+) | iFacialMocap / Facemotion3d/ VTube Studio | Full 52 ARKit | 60 |
| iPhone — NizimaLIVE | iOS | iPhone X+ | nizima LIVE TRACKER + NizimaLIVE | Full 52 ARKit | 60 |
| Android — ARCore | Android | Any Android phone | Meowface | 40+ | 30 |
| Webcam — MediaPipe | PC | Any webcam | VTube Studio (built-in) | 12 + | 10+ |
| Webcam — NVIDIA | PC | RTX GPU | VTube Studio (built-in) | 12 + | 10+ |
| Webcam — NizimaLIVE | PC | Any webcam | NizimaLIVE (built-in) | Good range | 30+ |
Parameter Capability Matrix
✓ Full support ✗ Not supported - Limited
Face ID is required on an iOS device for ARKit BlendShape motion capture (minimum: iPhone XR)
| Parameter | Webcam (MediaPipe) | Webcam (NVIDIA) | Meowface(Android) | Arkit(iOS) |
|---|---|---|---|---|
| Eye blink L/R | ✓ | ✓ | ✓ | ✓ |
| Eye gaze X/Y | ✓ | ✓ | ✓ | ✓ |
| Brow up/down | ✓ | ✓ | ✓ | ✓ |
| Brow inner up | ✗ | ✗ | ✓ | ✓ |
| Eye squint | ✗ | ✗ | ✓ | ✓ |
| Eye wide | ✗ | ✗ | ✓ | ✓ |
| Jaw open | ✓ | ✓ | ✓ | ✓ |
| Jaw left/right | ✗ | ✗ | ✓ | ✓ |
| Jaw forward | ✗ | ✗ | - | ✓ |
| Mouth open Y | ✓ | ✓ | ✓ | ✓ |
| Mouth form (smile/frown) | ✓ | ✓ | ✓ | ✓ |
| Mouth pucker | ✗ | ✗ | ✓ | ✓ |
| Mouth funnel | ✗ | ✗ | ✓ | ✓ |
| Mouth widen | ✗ | ✗ | - | ✓ |
| Mouth press L/R | ✗ | ✗ | ✓ | ✓ |
| Lip roll upper/lower | ✗ | ✗ | ✓ | ✓ |
| Lip shrug upper/lower | ✗ | ✗ | - | ✓ |
| Mouth dimple L/R | ✗ | ✗ | - | ✓ |
| Cheek puff | ✗ | ✗ | ✓ | ✓ |
| Cheek squint L/R | ✗ | ✗ | ✓ | ✓ |
| Nose sneer L/R | ✗ | ✗ | - | ✓ |
| Tongue out | ✗ | ✗ | ✓ | ✓ |
| Head rotation X/Y/Z | ✓ | ✓ | ✓ | ✓ |
| Head position X/Y/Z | ✓ | ✓ | ✓ | ✓ |