Meta Launches New AI Model “Movie Gen” for Realistic Video

Meta, the parent company of Facebook, announced on Friday the development of a new AI model called Movie Gen, designed to create realistic video and audio clips based on user prompts. Meta claims the tool can compete with media generation platforms like OpenAI and ElevenLabs.

Movie Gen can generate lifelike clips, including footage of animals swimming and surfing, or using real photos to depict people performing actions like painting. It also produces background music and sound effects synchronized with the video content and can be used for video editing.

For example, Meta demonstrated how Movie Gen inserted pom-poms into a runner’s hands in the desert and transformed a dry parking lot into one with a puddle as a man skateboarded. The model can create videos up to 16 seconds long and audio clips up to 45 seconds, with blind tests suggesting it performs well against competitors like Runway, OpenAI, ElevenLabs, and Kling.

The announcement arrives as Hollywood grapples with the impact of generative AI on filmmaking, with Microsoft-backed OpenAI previously demonstrating how its AI model Sora can create movie-like videos from text prompts.

Also Read: Meta Launches Subscription Service In US

While some in the entertainment industry are keen on AI for streamlining production, concerns over copyright infringement and the use of AI for deepfakes remain prevalent, especially in election contexts across countries like the U.S., Pakistan, India, and Indonesia.

Meta clarified that it does not plan to release Movie Gen widely to developers, unlike its Llama language models, due to potential risks. Instead, the company is working with the entertainment industry and content creators to integrate Movie Gen into its products by next year.

The model was trained on a combination of licensed and publicly available datasets.

Meanwhile, OpenAI has been meeting with Hollywood figures to discuss possible partnerships with Sora, although no agreements have been announced yet.

Concerns over AI use intensified after actor Scarlett Johansson accused OpenAI of using her voice without permission for its chatbot.

Lions Gate Entertainment, known for franchises like “The Hunger Games” and “Twilight,” recently partnered with AI startup Runway to allow the company to use its film library for AI training in exchange for access to its tools for enhancing productions.