Microsoft Patents an AI That Can Literally Put Words in People’s Mouths in Real Time
Microsoft has filed a patent for an AI system that modifies a speaker's words and facial movements in live video broadcasts. The technology uses AI agents to identify, remove, or alter specific words while reshaping the speaker's mouth to match the new audio in near real time. The system processes audio and video signals with minimal latency to ensure smooth transitions. It can potentially customize content based on individual viewer preferences while maintaining the original footage as a ground truth.
Listen to Live Briefing
Real-time synthesized voice briefing · Live Feeds Desk
- ✓ Microsoft filed a patent for an AI product that alters speakers' words and faces in live video in real time.
- ✓ The system uses AI agents to identify and alter or remove specific words while editing the speaker's mouth to match.
- ✓ The technology is described by inventors as a near real-time AI enhancement of video or augmented reality presentations of live events.
- ✓ The system processes video and audio signals with minimal latency to create smooth transitions.
What changed
Microsoft filed a patent for an AI tool that transforms live video to alter speaker words and faces.
Live updates
-
Microsoft Patents AI to Alter Speech and Faces in Real Time
Microsoft has filed a patent for an AI system that modifies a speaker's words and facial movements in live video broadcasts. The technology uses AI agents to identify, remove, or alter specific words while reshaping the speaker's mouth to match the new audio in near real time. The system processes audio and video signals with minimal latency to ensure smooth transitions. It can potentially customize content based on individual viewer preferences while maintaining the original footage as a ground truth.
Why it matters
This technology allows for the manipulation of live events and augmented reality presentations. It introduces a capability to change what a person appears to say on live television. The patent was first identified by the tracker Patentlyze.
What is confirmed
- Microsoft filed a patent for an AI product that alters speakers' words and faces in live video in real time.
- The system uses AI agents to identify and alter or remove specific words while editing the speaker's mouth to match.
- The technology is described by inventors as a near real-time AI enhancement of video or augmented reality presentations of live events.
- The system processes video and audio signals with minimal latency to create smooth transitions.
Still unconfirmed
- The system could be customized to suit individual viewers' preferences.
- The technology could personalize broadcasts while preserving original footage as ground truth.
What to watch next
- Confirmation of a commercial product release
- Public demonstration of the AI agents in a live broadcast
- Regulatory responses to real-time speech manipulation technology
confidence 90%Sources used for this update (11)
- Futurism — Microsoft Patents an AI That Can Literally Put Words in People’s Mouths in Real Time
- www.techtimes.co.uk — Microsoft's New AI Could Change What People Say on Live TV, Then Make Their Lips Match
- India Today — Microsoft patents AI that can change people's words and faces in live videos
- WION — Microsoft AI tool changes live words and shapes lips to match
- players.com.ua — Microsoft Patents an AI That Can Literally Put Words in People’s Mouths in Real Time
- futurism.com — Microsoft Patents an AI That Can Literally Put Words in ...
- www.timesnownews.com — Microsoft Patents AI That Can Change Your Speech And Face In ...
- article.wn.com — Microsoft Patents an AI That Can Literally Put Words in ...
- aiweekly.co — Microsoft patents real-time AI that rewrites speakers' words
- www.computerworld.com — Microsoft files patent for AI that can alter what people say ...
- www.indiatoday.in — Microsoft patents AI that can change people's words and faces ...
Community Sentiment: How do you assess this situation?
Voice your perspective · Real-time aggregated sentiment from the Live Feeds community