Face Tracking Comparison
Compare face-tracking parameter support by tracking source.
Summary
Facial Motion Capture result:
iOS >> Android >= PC
In a short word, use iOS device for best Facial Tracking result!
You can get a second-hand iPhone with Face ID at quite a reasonable price.
iPhone and iPad models that support Face ID
Method Overview
| Method | Platform | Hardware | App | Blendshapes | FPS |
|---|---|---|---|---|---|
| iPhone — VTS | iOS | Any Face ID iPhone | VTube Studio iOS | 52 (Full) | 60 |
| Android — VTS | Android | Any Android phone | VTube Studio Android | 40+ | 60 |
| Webcam — VTS | PC | Any webcam | VTube Studio PC | 20+ | 10+ |
| Webcam — MediaPipe | PC | Any webcam | VTube Studio PC | 20+ | 10+ |
| Webcam — NVIDIA | PC | RTX GPU | VTube Studio PC | 20+ | 10+ |
Parameter Capability Table
✓ Supported ✗ Not supported - Partial (inaccurate)
Face ID is required on an iOS device for ARKit BlendShape motion capture.
| Parameter | iOS | Android | Webcam |
|---|---|---|---|
| Eye blink L/R | ✓ | ✓ | ✓ |
| Eyeball X/Y | ✓ | ✓ | ✓ |
| Brow up/down | ✓ | ✓ | ✓ |
| Brow inner up | ✓ | ✓ | - |
| Eye squint (smile) | ✓ | ✓ | - |
| Eye wide | ✓ | ✓ | ✓ |
| Jaw open | ✓ | ✓ | ✓ |
| Jaw left/right | ✓ | ✓ | ✓ |
| Jaw forward | ✓ | ✗ | ✓ |
| Mouth open | ✓ | ✓ | ✓ |
| Mouth form (smile/frown) | ✓ | ✓ | ✓ |
| Mouth pucker | ✓ | ✓ | - |
| Mouth funnel | ✓ | ✓ | - |
| Mouth stretch L/R | ✓ | ✗ | ✗ |
| Mouth press L/R | ✓ | ✗ | ✗ |
| Lip roll upper/lower | ✓ | - | ✗ |
| Lip shrug upper/lower | ✓ | - | ✗ |
| Mouth dimple L/R | ✓ | ✗ | ✗ |
| Nose sneer L/R | ✓ | ✓ | - |
| Cheek puff | ✓ | ✗ | ✗ |
| Cheek squint L/R | ✓ | ✗ | ✗ |
| Tongue out | ✓ | ✓ | ✗ |
| Head rotation X/Y/Z | ✓ | ✓ | ✓ |
| Head position X/Y/Z | ✓ | ✓ | ✓ |
Last updated on