Revolutionising content creation: YouTube tests AI-powered dubbing tool, Aloud

shutterstock 1130311517 Large

YouTube has unveiled plans to trial a pioneering tool aimed at enabling creators to effortlessly dub their videos into multiple languages using artificial intelligence. The announcement was made at the highly anticipated VidCon conference last Thursday. In an exciting development, YouTube has collaborated with AI-powered dubbing service, Aloud, a promising start-up nurtured by Google‘s in-house incubator, Area 120.

This year saw YouTube augment its platform with support for multi-language audio tracks, an innovation that empowers creators to dub their new and pre-existing videos. The introduction of this feature has significantly broadened creators’ reach, facilitating the transmission of their content to an expansive international audience. The company reported to TechCrunch that as of June 2023, creators have dubbed over 10,000 videos in more than 70 languages, reflecting the immense potential of this ground-breaking feature.

Before the introduction of Aloud, creators had to painstakingly collaborate with third-party dubbing providers to craft their audio tracks—a process often bogged down by high costs and time constraints. The advent of Aloud eliminates these hurdles, enabling creators to dub their videos free of additional charges.

Aloud was initially launched by Google in 2022. The ingenious product works by transcribing a video, translating the content, and subsequently generating a dubbed version. Creators are afforded the opportunity to scrutinise and edit the transcription prior to the creation of the dubbed version, ensuring maximum accuracy and authenticity.

In a statement to VidCon attendees, YouTube’s VP of Creator Products, Amjad Hanif, revealed that the tool is currently being tested by hundreds of creators. YouTube plans to expand the usage of this innovative tool to its entire creator community in the near future. Although Aloud currently supports English, Spanish, and Portuguese, plans are underway to incorporate more languages, including Hindi and Bahasa Indonesian.

Hanif noted that YouTube is committed to enhancing the audio translation experience. The company intends to create translated audio tracks that closely mimic the creator’s voice, complete with rich expression and accurate lip sync.

In confirmation to TechCrunch, YouTube disclosed future plans to leverage generative AI technology. This would enable Aloud to roll out advanced features such as voice preservation, improved emotion transfer, and lip reanimation, thus elevating the dubbing experience to unprecedented levels.

More from Qonversations

Tech

2024 01 17T140311Z 2071601485 RC2PJ5ATPUE9 RTRMADP 3 APPLE SMARTPHONE SAMSUNG ELEC

Is Apple ‘monopolising’ the smartphone market?

Tech

2024 01 24T000205Z 1176313067 RC2VR0AD7JU5 RTRMADP 3 BRITAIN CYBER AI

Who are the people urging the world to stop AI and climate “catastrophe”?

Tech

2024 01 30T082224Z 418236526 RC2ZVZ9I9FG3 RTRMADP 3 PAKISTAN POLITICS KHAN

Imran Khan’s jail speech shows AI’s peril

Tech

2024 02 12T032837Z 1210727327 RC2RY5AVZ54J RTRMADP 3 TIKTOK BIDEN

Biden launches official TikTok account

Front of mind