Meta Showcased Its "Breakthrough" AI

The battle for AI supremacy has started and Meta wants to lead the way by releasinga new AI video-generating tool last 4 October.

"Today, we're excited to premiere Meta Movie Gen, our breakthrough generative AI research for media, which includes modalities like image, video, and audio," the company said in a press release. "Movie Gen outperforms similar models in the industry across these tasks when evaluated by humans."

In its press release, Meta called Movie Gen the "most advanced and immersive storytelling suite of models," including video generation, audio generation, personalized video generation, and video editing. The models were trained using publicly available data and licensed data, the company said.

With a text prompt, Movie Gen can develop videos up to 16 seconds long at 16 frames a second while reasoning "about object motion, subject-object interactions, and camera motion." Users can upload a picture of themselves to be incorporated into personalized videos, and Movie Gen can edit videos with text instructions from the user.

Meta's example video shows an underwater perspective of a baby hippo happily swimming around in a serene aquatic scene.

Another shows a koala on a surfboard and the accompanying prompt: "A fluffy koala bear surfs. It has a gray and white coat and a round nose. The surfboard is yellow. The koala bear is holding onto the surfboard with its paws. The koala bear's facial expression is focused. The sun is shining."

With audio generation, users can "create and extend sound effects, background music or entire soundtracks" up to 45 seconds long, the press release said. An example clip of a snake slithering through a wooded area includes the prompt: "Rustling leaves and snapping twigs, with an orchestral music track."

Meta is a little late to the audio- and video-generation game as top competitors like OpenAI and Google have already claimed a foothold in the space. OpenAi launched Sora, its video generator, in February, and Google followed suit with Veo in May.

Meta, however, has given OpenAI a run for its money in the AI arms race. Though OpenAI's ChatGPT debuted first and launched the company to worldwide fame, recent iterations of Meta's Llama model have been well received. Many viewed Llama 3.1, which came out in July, as superior to OpenAI's GPT-4o, which came out shortly before.