How AI is Transforming Hollywood’s Visual Effects

The New York Times today dug into AI’s expanding role in Hollywood, using the movie Here—starring Tom Hanks and Robin Wright—as a prime example. In this Robert Zemeckis-directed film, AI from Metaphysic makes it possible to show the actors at ages ranging from 18 to 80. Normally, achieving this effect with traditional CGI would’ve been wildly expensive, but AI is slashing those costs.

The article titled "What if A.I. Is Actually Good for Hollywood?" breaks down several ways AI is shifting Hollywood, but it’s more of a helping hand than a replacement. Right now, AI tools are great for specific tasks like de-aging, stunt photography, and dubbing in other languages, saving studios a lot of money and time. For instance, Here cost about $50 million—far less than if traditional CGI had been used.

The author mentions that AI isn’t taking over, but it’s becoming an important tool in Hollywood. It’s most effective for streamlining smaller tasks, so artists can focus more on creative work. With some seeing AI as an exciting tool, while others worrying about job loss and ethical issues. Concerns like using deceased actors’ likenesses and securing proper consent are major considerations, and the article suggests the industry may need regulatory guidelines.

Tom Hanks himself sees AI as just another tool, like better film stock or updated projection techniques. However, he agrees that there’s a need for legal and ethical rules around actors’ digital likenesses.

Clear benefits of AI in VFX

• Reduced Costs: AI cuts down on repetitive tasks like background removal, freeing up budgets. Using AI can seriously cut down on the costs of visual effects, as seen with The Mandalorian, where AI-driven de-aging made a young Luke Skywalker possible without tons of makeup and reshoots.
• Boosted Creativity: Automating the mundane allows artists to push creative boundaries.
• Improved Realism: AI algorithms create lifelike textures, lighting, and movements, pulling viewers deeper into the story. This was evident in Ready Player One, where AI recreated the Overlook Hotel from The Shining with striking realism.
• Faster Production: AI speeds up the VFX process, ideal for meeting tight deadlines.
• Greater Accessibility: Independent filmmakers now have access to high-quality effects, leveling the playing field.

Although today’s AI tools don’t yet offer the precise control that traditional CGI can. They’re great for concept development and quick iterations but not always for final production.

MovieGen and Bloomhouse

We've covered just recently that Meta has partnered with Blumhouse Productions, focusing on its new AI tool, Movie Gen, which creates high-quality 1080p video and audio from text prompts. It’s a clear sign of how technology is becoming a collaborator in Hollywood, not just a tool.

The film industry’s relationship with AI is growing beyond traditional VFX studios, as tech giants like Meta, Facebook’s parent company, step into Hollywood’s creative space. With these tools, AI isn’t replacing creativity but rather reshaping how Hollywood tells its stories, blending practical benefits with new possibilities for artists and filmmakers.

Disney Expands its Use of AI

Walt Disney Co. is setting up a new team, called the Office of Technology Enablement, to ramp up its use of emerging tech like artificial intelligence (AI) and mixed reality across film, TV, and theme parks.

Alan Bergman, Co-Chairman of Disney Entertainment, stressed that rapid advances in AI and extended reality (XR) will impact customer experiences and Disney’s business for years, making it essential to stay ahead. Read more: https://www.reuters.com/technology/artificial-intelligence/walt-disney-forms-business-unit-coordinate-use-ai-augmented-reality-2024-11-01/