Add live face capture to avatars in real-time.
Record, review, edit facecap or export to Blender.
Compatible with all Apple ARKit blendshapes.
AR head tracker (tabletop head tracking) mode.
Download the Sidekick App
blendshape_retargeting.mp4A new Blendshape Retargeting menu has been added that allows animators to use custom blendshapes on any avatar with any blendshape names, even while facecap is connected and running you can adjust the mapping! Then save the retargeting maps as a .json file so you can reuse them mapping later.
Note blendshape nams order does not matter when using the retargeting since the mapping is a purely blendshape names-to-name mapping.
It should be possible to quickly apply the saved retargeting files on any number of avatars that share the same blendshape names!!
Download the Sidekick Addon for Blender:
Download the LATEST Sidekick Addon For Blender v9.5.4b includes the new Blendshape Re-Targeting menu
Or click here to download the legacy Sidekick Addon For Blender version v7.0.4
Install For Blender
Install the SidekickBlenderAddon.py add-on script by selecting it from the install menu in Blender.
Activate the add-on in Blender by opening Preferences>Add-Ons and selecting the SidekickBlenderAddon.py that was downloaded above.
Ensure the checkbox is enabled for the APS Sidekick Addon.
Locate the menu bar for the Sidekick app that includes the connectivity, retargeting and recording options.
That's it! The Sidekick addon is installed and you can now use the Sidekick app to stream face capture directly to avatars in Blender live!!
More Information
Truedepth sensor required.
iPhone X or higher is required when installing the APS Sidekick Face Capture App
Sidekick App
App for iOS devices
Vive Pro Eye
Vive Face Tracking
See Also:
iOS Sidekick facecap with UE live-link plugin:
Unreal Engine live production.
See Also:
AR Sidekick video recording:
Blender3D live action camera.