AI-Assisted Language Translation of Speaking, Including Mouth Movements

Ok, this is a little bit bonkers: HeyGen’s Video Translate tool will convert videos of people speaking into videos of them speaking one of several different languages (incl. English, Spanish, Hindi, and French) with matching mouth movements. Check out their brief demo of Marques Brownlee speaking Spanish & Tim Cook speaking Hindi or this video of a YouTuber trying it out:

The results are definitely in the category of “indistinguishable from magic”.

• artificial intelligence
• HeyGen
• language
• video