Electronic Arts (EA): EA built a machine learning tool called Voice2Face that automatically creates realistic lip-sync and facial animation for game characters from a voice recording alone — in almost any language. It has been used in Battlefield 6 cinematics and EA Sports FC 25 crowd scenes, replacing the need for manual animation work. | AI Trace
Creative GenerationAugments Human LaborVerified
EA built a machine learning tool called Voice2Face that automatically creates realistic lip-sync and facial animation for game characters from a voice recording alone — in almost any language. It has been used in Battlefield 6 cinematics and EA Sports FC 25 crowd scenes, replacing the need for manual animation work.
Details
Developed by EA's SEED research lab and presented at the ACM Symposium on Computer Animation in 2022, Voice2Face uses a type of generative AI model (a conditional Variational Autoencoder) to generate a character's facial mesh animation from speech audio, then maps it to whatever rig the character uses. The system won Fast Company's "Next Big Things in Tech" award in 2023. In prior workflows, animators keyframed every facial movement by hand; Voice2Face automates this entirely from audio input.
