Meet X-Portrait 2: ByteDance’s Cutting-Edge AI Facial Expressions Tool

ByteDance is shaking up AI-powered face animation with X-Portrait 2, their latest tool for creating hyper-realistic animated portraits. 

ByteDance, the company behind TikTok and CapCut, is a global tech leader that built its name on using AI to personalize content. With apps that connect millions daily, they’ve changed how people make and enjoy digital media.

What Makes X-Portrait 2 Special?

 Building on the earlier version, X-Portrait 2 uses smarter AI that doesn’t just copy facial landmarks—it analyzes subtle movements like eye shifts and smiles. It works through a blending system called a “diffusion model” combined with ControlNet, which tracks a wider range of motions and applies them accurately. The result? Smoother, more lifelike animations.

One big upgrade is how it separates the look of the reference image from the motions it picks up in the source video. Other tools sometimes mix features from the video into the animation, creating awkward results. X-Portrait 2 avoids this by training the AI to focus on keeping the original face consistent while adding expressions. This tech doesn’t just match lips—it captures emotions, small expressions, and even handles quick movements or side profiles. Whether it’s a subtle smile or a full head turn, X-Portrait 2 makes it look natural.

X-Portrait 2 Availability

For now, X-Portrait 2 isn’t public, but the earlier version (X-Portrait 1) is available on GitHub for anyone curious to try. ByteDance also shares detailed videos showing off its capabilities, so you can see the tech in action.

Currently, the full X-Portrait 2 model isn’t yet released on GitHub, but ByteDance has made X-Portrait 1 available here (and an official overview of the X-Portrait project can be found in a ByteDance video), so users can explore its functionality and get an idea of the technology’s potential.

👉If you're interested to play with some existing facial expressions models, check out this article.

Bottom Line

X-Portrait 2 highlights ByteDance’s focus on creating AI tools that don’t just copy movements but also bring out the individuality and personality of each animated face. By handling both big expressions and tiny details in real time while keeping identity intact, this tool has wide uses in film, social media, and interactive media. It’s changing how we create and share animated content.

And let’s not forget—we’re still waiting for an AI video generator from ByteDance. The demos they’ve shared so far? Amazingly good.

Last modified 15 January 2025 at 22:37