iFacialMocap captures your facial expressions with the front camera of your Android device and sends them in real time to 3DCG software on your PC over Wi-Fi.
[What you can do]
- Create face animations by communicating in real time with Maya, Unity, 3ds Max and Blender. In Maya and Blender, animations created in real time can also be baked.
- Use it with VRM apps on the PC that support iFacialMocap, such as VMagicMirror, Luppet and HANA_APP. The PC-side software can also load VRM models.
- Record your facial motion in the app, play it back, and export it as FBX (ASCII or Binary) or TXT. Exported files are shared with the Android share sheet or saved to the device.
- Up to 52 blend shapes with the same names as the iOS version, so your existing models, scripts and add-ons keep working.
- Import VRM 0.x or VRM 1.0 avatars and animate their expressions in the app. Turn off the long-time streaming optimization mode to display avatars.
- Send to compatible receivers using iFacialMocap v1/v2 and Face Motion v3 over UDP/TCP. Bluetooth (BLE) transmission requires support on both your Android device and the receiver.
[How to use]
1. Start this app.
2. Start the receiving software "iFacialMocap to SoftWare app" on your PC and enter the IP address of your device shown in the app. Download the PC software from:
https://ifacialmocap.com/download/
3. Create up to 52 morph targets (BlendShape or ShapeKey) according to the naming convention.
4. Load the script / add-on in your 3DCG software and press the connection button.
Detailed usage is available at:
https://ifacialmocap.com/
Please use the latest version of the PC software.
[Requirements]
- Android 8.0 or later with a front camera.
- For Wi-Fi streaming, your device and your PC must be connected to the same router (the PC may use a wired connection).
- Face tracking runs on the device with Google MediaPipe. The result depends on the camera and the lighting; a bright, evenly lit face works best.
[Free version and purchase]
The app is free to download. The free version shows ads, and the streaming time may be limited. A one-time in-app purchase removes the ads and the time limits. Recording, playback and export are also available in the free version.
[Privacy]
Camera images are used only for face tracking on your device and are never stored or sent. Face data (blend shape values, head rotation and position, and eye rotation) is sent to receivers you configure or connect over UDP/TCP or supported Bluetooth. A configured IP address can be on a local network or the internet. Recorded audio is stored on your device. The ads in the free version are provided by Google AdMob, which uses the advertising ID. Google SDKs also send usage and diagnostic information separately from face motion data. PRO stops new ad requests but does not stop all SDK communications. See the privacy policy for details.
[Note]
Purchases and settings of the iOS version are not carried over to the Android version.
FacialMocap & Send to PC