google’s veo 3 generates AI videos from text with dialogues, voice-overs and sound effects

Text to AI videos using Google’s veo 3

 

It’s not quiet anymore in the text-to-AI-generated video world since Google’s Veo 3 can produce them with audio, dialogues, voice-overs, and sound effects. The model comes from Google’s very own Deepmind, and the company says that with Veo 3, users can produce videos from text prompts with ‘improved quality’ as well as speech and audio. It’s a step ahead in the AI video race since OpenAI’s Sora has yet to add the sound feature into its software. 

 

Aside from dialogues and sound effects, users can also apply ambient noise and background music to their AI videos with Google’s Veo 3. The company says that its model follows the text prompts and series of actions with ‘greater accuracy.’ For example, the prompt ‘a paper boat sets sail in a rain-filled gutter’ generates the exact clip in a close-up shot. The water flows, and the boat even tilts as it ends up in the gutter. Unlike the previous versions, the Google Veo 3 has a distinct sharpness that makes it less of an AI video. In some ways, that’s quite alarming.

all images courtesy of Google Deepmind

 

 

The company also releases AI-powered filmmaking app

 

With the boom of the AI videos and apps like Google’s Veo 3, some might take advantage of it to spread disinformation, or the intentional misleading of the public. At the present time, spotting whether a video is AI or not is still fairly easy to do. Usually, the movement of the lips and voice-overs tends to be more delayed than the actors’ facial expressions. There’s also an uncanny feeling to the way the subjects move and blink. They seem slower or smoother, which isn’t the same way in movies and shows shot on cameras.

 

In terms of video quality, the AI videos, even some that have been produced by the company’s Veo 3, have a blurry background that makes the subjects stand out more. It looks as if the software is using the ‘portrait’ mode that’s similar to smartphone cameras. Google has also released Flow, which is an AI-powered filmmaking app tailored to Veo 3. Here, the creatives can control the camera motion, angles, and perspectives of the AI videos. They can also extend the existing shots and add transitions from one angle to another. At the moment, only those with Google AI Ultra subscription, which is around 125 USD per month, can fully access all of Google’s tools, including Veo 3.

the new version can also expand the video size and match the missing parts

with a descriptive prompt, the recent model can produce the exact request

from the previous version, the new model can still embed characters in a defined setting

 

a paper boat sets sail in a rain-filled gutter

users can also control the camera movement

so far, users can fully access the tools via AI Ultra subscription

 

project info:

 

name: Veo 3

company: Google | @google

The post google’s veo 3 generates AI videos from text with dialogues, voice-overs and sound effects appeared first on designboom | architecture & design magazine.

Scroll to Top