This story was first published on the Benzinga India portal.
Have you ever found yourself trying to watch a YouTube video, but it's not in a language you understand? A solution has been developed for that issue. A developer, using AI, has translated the audio of Lex Fridman's interview with Meta Platforms Inc META CEO Mark Zuckerberg from English to Hindi, complete with lip synchronization.
What Happened: A developer named Prady has posted a translated version of Fridman's conversation with Zuckerberg. He translated the audio from English to Hindi using ChatGPT, prompt engineering, voice training and speech-to-text tools from 11labs, and a lip synchronization API.
See Also: Rare Sealed Original iPhone Fetches A Whopping $190,000 At Auction
I built the simplest way to convert your video to other languages.
— Prady (@therealprady) July 16, 2023
all you need is a youtube link. no install required.
curious? check out @lexfridman + zuck talking about @elonmusk in hindi. pic.twitter.com/nZBi4ZtRde
Prady used a combination of these AI tools to bring together different aspects of a video, like audio, visuals, and lip synchronization. This also shows how accessible audio and video editing has become thanks to AI, something that would have otherwise required an experienced editor to accomplish.
In fact, Prady says that if you want a YouTube video in any language, all you need to do is send him the link to the video along with the language of your choice, and he'll send you the translated version.
Revolutionary Or Creepy? While AI tools are making tasks easier and more accessible, Prady's example also shines the light on just how easy it has become now to manipulate audio and video recordings.
There is an increasing risk of these tools being misused to spread misinformation. With further improvements, video alterations could be carried out subtly, escaping detection by many viewers.
Check out more of Benzinga's Consumer Tech coverage by following this link.
Read Next: Google Doodle Salutes First Scientist To Discover Greenhouse Effect
Photo: Shutterstock
© 2024 Benzinga.com. Benzinga does not provide investment advice. All rights reserved.
Comments
Trade confidently with insights and alerts from analyst ratings, free reports and breaking news that affects the stocks you care about.