Creative Generation

Reviewed and published by trentmaziarz, April 22, 2026. Discovered and drafted by our automated research pipeline.

Sony AI, a research subsidiary of Sony Group Corporation whose work spans Sony Pictures Entertainment's entertainment assets, is developing AI systems for dubbing and translating entertainment content, including a lip-sync synchronization method called DubWise and an emotional voice conversion framework called EmoReg. These tools are at the research stage and have not been confirmed as deployed in SPE productions.

Details

Sony AI's 'AI for Creators' research project includes work on dubbing, translation, and voice synthesis aimed at the entertainment sector. DubWise, presented in a June 2024 research paper, is a method that uses large language models and visual cues from video (such as lip movements) to synchronize dubbed audio with on-screen performance. EmoReg, presented at AAAI 2025, is a diffusion-based emotional voice conversion framework designed to replicate and control emotional intensity in AI-generated speech for dubbing applications. The CASAT framework was also presented at AAAI 2025 for context- and style-aware machine translation for Indian-language entertainment. These are active research projects; deployment in commercial SPE productions has not been confirmed by primary sources.

Products affected

Sony AI research platform

Sources & Evidence

Company Disclosure

Company DisclosureVerified

Sony AI's Contributions at AAAI 2025

Sony AI·Feb 2025

https://ai.sony/blog/Sony-AIs-Contributions-at-AAAI-2025/

Company DisclosureVerified

Translation and Dubbing – Sony AI

Sony AI·Jan 2024

https://ai.sony/projects/translation_and_dubbing/

Original link unavailable.

News Article

Sony's DubWise Uses Visual Cues from the Video to Improve AI Dubbing

Slator·Jun 2024

https://slator.com/sonys-dubwise-uses-visual-cues-from-video-to-improve-ai-dubbing/

Cite this record

Trace Foundation. (2026). Sony AI: Sony AI, a research subsidiary of Sony Group Corporation whose work spans Sony Pictures Entertainment's entertainment assets, is developing AI systems for dubbing and translating entertainment content, including a lip-sync synchronization method called DubWise and an emotional voice conversion framework called EmoReg. These tools are at the research stage and have not been confirmed as deployed in SPE productions (data as of 2026-04-22) [Data set record]. AI Trace. https://www.aitrace.org/r/practice/659966e4-c661-40bc-a7cf-4d91041dbb75. Accessed September 6, 2026.

Stable link: https://www.aitrace.org/r/practice/659966e4-c661-40bc-a7cf-4d91041dbb75
Data as of: April 22, 2026
Last verified: Not recorded

How to cite AI Trace

Have evidence about Sony AI's AI practices? Submit a report.

Report a Sighting →