Short Bytes: The developers from the University of Erlangen-Nuremberg, the Max Planck Institute for Informatics, and the Stanford University have published an online video and a research paper named “Facial reenactment”. This technology uses a software that is used to put all your gestures in real time, onto someone else’s face.
The research paper named “Facial reenactment” describes a software that is used to put all your gestures in real time onto someone else’s face. In the video ahead, it’s researchers show what’s called “Real-time Expression Transfer for Facial Reenactment”.
With this technology, you can plaster someone else’s facial features on your face. “To achieve this, we accurately capture the facial performances of the source and target subjects in real-time using a commodity RGB-D sensor,” the paper states.
In the video, you can see the actor on the right side pulling some exaggerated facial expressions like frowning, raised eyebrows and crazy smiles. These gestures are then mapped in real time onto the face of the person sitting.
For the transfer of expressions, researchers calculate the difference between the target and source’s expressions and the software modifies the target’s expressions. This is done by tracking the geometry, reflectance and texture of both faces.
The software layers the elements on target’s face and then enhances it using various artificially animated CGI renders.
Watch this amazing video animation below and share your views in the comments below: