Post Thumbnail

Revolution in content creation: Veo 3 generates dialogues and sound effects

Google has introduced Veo 3 — the latest video generation model, which deservedly can be called a real breakthrough in this field. The main feature of this technology is full sound support. If previously generative videos were predominantly silent or required separate audio processing, now the system creates videos with sound effects, background noises, and even full-fledged dialogues between characters.

Users can give Veo 3 a request with a description of characters and environment, as well as suggest dialogues with an indication of how exactly they should sound. As noted during the press briefing by Demis Hassabis, CEO of Google DeepMind, I quote – “For the first time, we are leaving the silent era of video generation.”

I am pleasantly shocked! The uniqueness of Veo 3 lies in its ability to understand the original pixels from generated videos and automatically synchronize created sounds with them. Although tools for generating sound based on artificial intelligence are not new, it is such integration of video and audio that distinguishes Google’s development among competitors.

There are already many tools for video generation on the market from companies such as Runway, Lightricks, Genmo, Pika, Higgsfield, Kling, Luma, as well as OpenAI and Alibaba. However, the ability to automatically generate synchronized sound gives Veo 3 a serious competitive advantage.

The new technology will be available to users through the Gemini application, presumably by subscription.

It seems that Veo 3 is a full-fledged transition from a fragmented approach to media content generation, where video and audio were created separately, to an integrated model of creating full-fledged audiovisual content with synchronized sounds, dialogues, and images. Which radically simplifies the workflow of video creation. Bravo.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
Nvidia head believes there is no AI bubble

Nvidia founder Jensen Huang dispelled concerns about a bubble in the AI market. And according to him, the company's latest chips are expected to bring 0.5 trillion dollars in revenue.

Sam Altman is tired of money questions

Sam Altman is tired of questions about OpenAI's money. And this became obvious during a joint interview with Satya Nadella on the Bg2 podcast.

Number of forward deployment engineer vacancies grew by 800%

AI companies invented a new profession. We're talking about forward deployment engineers.

OpenAI promises to create full-fledged AI scientist by 2028

OpenAI promised to create a full-fledged AI-based scientist by 2028. Company CEO Sam Altman also stated that deep learning systems will be able to perform functions of research scientists at intern level by September next year. And the level of an autonomous full-fledged AI researcher could be achieved by 2028.

Jobs for young IT specialists in Britain collapsed by 46%

You know what's happening in the job market for young IT specialists in Great Britain? Over the last year, the number of jobs for young specialists collapsed by 46%. And a further drop of 53% is forecast, reports The Register. Citing statistics from the Institute of Student Employers.