New Microsoft AI Animates Faces From Photos

The Mona Lisa can now do more than smile, thanks to new artificial intelligence (AI) technology from Microsoft, as reported by Clare Duffy for CNN.

Outputs from Microsoft's AI model, called VASA-1, are both entertaining and a bit jarring in their realness. I Image: Microsoft

Last week, Microsoft researchers detailed a new AI model they've developed that can take a still image of a face and an audio clip of someone speaking and automatically create a realistic-looking video of that person speaking.

The videos, which can be made from photorealistic faces as well as cartoons or artwork, are complete with compelling lip-syncing and natural face and head movements.

In one demo video, researchers showed how they animated the Mona Lisa to recite a comedic rap by actress Anne Hathaway.

Outputs from the AI model, called VASA-1, are both entertaining and a bit jarring in their realness.

Microsoft said the technology could be used for education or "improving accessibility for individuals with communication challenges," or potentially to create virtual companions for humans. But it's also easy to see how the tool could be abused and used to impersonate real people.