Meta has announced an interesting tool that uses AI to automatically dub Reels into other languages with lip syncing. The feature was unveiled at the annual Meta Connect livestream event and introduced by CEO Mark Zuckerberg.
Zuckerberg showed it off during his keynote, and everything seemed to work perfectly: Meta says that the tech can not only translate content, but also “simulate the speaker’s voice in another language and lip-sync it to match.” It’s worth noting, though, that this doesn’t seem to have been a live demo, but it was still pretty impressive.
As for the rollout, the company said the feature will first be available to “select creators’ videos” in English and Spanish in the U.S. and Latin America. Meta didn’t reveal a timeline here, saying only that the U.S. and Latin America will get the feature first, suggesting that it will be limited to English and Spanish at launch. The company said other languages will be coming soon.
These weren’t the only AI tools highlighted at Meta Connect: the company’s AI platform will also enable voice chat, with a range of celebrity voices to choose from. Meta AI will also add new image features, allowing users to modify and edit photos based on instructions in text chats within Instagram, Messenger and WhatsApp.
