YouTube opens the door to more users to try AI dubbing

Would you like to watch videos in other languages and be able to understand them? YouTube wants to make it possible with AI-generated automatic dubbing. This feature, which was announced in June 2023, will now be available for “hundreds of thousands of channels” within the YouTube Partner Program.

YouTube DOWNLOAD

From its official blog, Google has also explained how exactly this automatic dubbing works. For now, videos spoken in English can be dubbed into French, German, Italian, Hindi, Spanish, Indonesian, Japanese, and Portuguese. If the original video is in any of the languages listed above, YouTube will only allow us to “dub” it into English.

The process is very simple: to start, you just have to upload your video as you normally would. Then, YouTube will automatically detect the language used in the video and dub it into other languages. You can see the result from YouTube Studio in the Languages section.

Once the video is published, the audience will be able to decide whether to watch the video in its original language or listen to the dubbed version through the audio selector. YouTube explains that the user’s language choice “will be considered for future videos.”

Although the voices do not yet sound very natural, YouTube clarifies that it continues to work in collaboration with Google DeepMind and Google Translate to improve this technology and make “the dubbing even more accurate, expressive, and natural.” YouTube also promises that, in future updates, the voices will be able to “emulate the tone, emotion, and even the atmosphere of the environment” of the videos.

In June 2023, the company already announced that it was working to make “the translated audio tracks sound like the creator’s voice” and that they also have “lip synchronization.” It is yet to be confirmed whether we will see it in the near future or not.

YouTube DOWNLOAD