disguise announces its partnership with markerless motion capture technology provider Move.ai.
With a vision to democratise virtual production and metaverse experiences, the partnership aims to marry advanced markerless motion capture with superior graphics processing for film & episodic TV, broadcast and extended reality studios around the world, enabled by a custom-developed technology solution driven by disguise and Move.ai’s real-time markerless motion capture software, Invisible.
The integration of Invisible with the disguise platform aims to redefine real-time motion capture by removing the need for restrictive and costly mocap suits. The technology works by extracting natural human motion from video using advanced AI, computer vision, biomechanics, and physics to automatically retarget the data to a character rig, and creating a virtual character that can mirror human motion in real-time.
“When it comes to virtual characters and real-time effects, movement needs to be translated into data,” says disguise Chief Product and Technology Officer, Raed Al Tikriti. “Motion capture and re-creation are key pieces of the puzzle. We want to make this technology as accessible and scalable as possible, enabling our community of partners to enhance shared experiences, entertainment and storytelling.”
Invisible integrates with the scalable processing capabilities of disguise hardware. No compromises need be made to creative vision, with motion capture data directly integrated into creative workflows in the disguise Designer software. Meanwhile, disguise’s RenderStream protocol ensures the transfer of skeleton data across the disguise Unreal Engine rendering cluster, allowing for greater synchronicity of content and tracking data across the production workflow and the seamless merging of the physical and virtual world.
With this partnership in place, more creative and technical teams can use virtual characters without experiencing common motion capture and graphics rendering challenges like latency, sensor drift, interference, and extensive data clean-up. The combined solution can be used to:
- power avatars in metaverse experiences,
- digital characters in virtual productions, and AR players in broadcasts.
- realistic shadow casting for talent on stage
- gesture-triggered 3D graphics and scene changes
- movement-triggered particle effects, such as smoke and fire
“We’re excited to be working with Move.ai, who have undoubtedly been making waves in this space for the past year,” says Fernando Kufer, disguise CEO. “As we continue to explore the intersection of physical and virtual here at disguise, a partnership with a team as forward thinking as the Move.ai team, and as innovative and accessible as their product, is a no-brainer. The future of entertainment is on the horizon and together, we can play a big part in delivery.”
Niall Hendry, Move.ai Head of Partnerships says: “Creatives and technologists use disguise technology to deliver the most spectacular virtual and live productions. This strategic symbiosis will add the noiseless, real-time, markerless motion capture technology of Invisible to their arsenal. We can’t wait to see what users create with these tools.”
The worldwide network of disguise-powered extended reality stages, along with disguise’s around-the-clock global support and advanced training services, will be available to train and support any team looking to explore the opportunities of the Invisible solution, which is scheduled to become publicly available in May 2023.
disguise and Move.ai will be showcasing the new Invisible solution at the NAB Show in Las Vegas on 16-19 April, with multiple daily demo sessions on the disguise stand. Visitors will also be able to speak with experts from both teams on the disguise stand all throughout the event and see the technology in action across a variety of use cases.
