AI Body Swapper: Mimo by Alibaba
Alibaba’s got a new AI tool called MIMO that can swap out people in videos using just a single photo reference.
This tool changes the game for video editing by removing the need for complicated stuff like multi-camera setups or motion capture.
How MIMO Works
Given a reference image, MIMO can synthesize animatable avatars via few-minute inference.
Mimo breaks down a video into three layers:
- the main person,
- the background,
- any stuff in the foreground.
It then divides the main person’s data into their look and how they move. When a new photo of someone else is provided, Mimo codes it and uses it to switch out the original person in the video seamlessly.
One of Mimo’s standout features is how it handles complex scenes and high-action moments. It can replace a person dribbling a basketball and still keep the hand and leg movements and the ball’s path looking natural. That’s pretty crazy considering it just needs one photo to pull this off.
Mimo isn’t just for swapping people. It can also take someone’s motion from one video and put it into another. This opens up a lot of creative options. Users can even swap out backgrounds, making Mimo a great tool for content creators, filmmakers, and others in the entertainment business.
MIMO is not Released to the Public Yet
Sadly, only the paper has been published for now https://github.com/menyifang/MIMO We have to wait and see when the demos come out.
Potential Impact
Mimo could shake up industries like film, gaming, and virtual reality by making realistic body swaps easier and cheaper. It could open up creative opportunities and give more people access to advanced video editing tools.
In short, Mimo by Alibaba is a big step forward for video editing. It can replace characters using just a single photo, handle complex scenes, and extract motion for other creative uses.
With how easy it is to create realistic body swaps, it could obviously also be used to make deepfakes. But it wouldn't be the only one out there.
Last modified 02 October 2024 at 15:50
Published: Sep 30, 2024 at 2:54 AM
