Barrier Function to Skin Elasticity in Talking Head
Journal Publication ResearchOnline@JCUAbstract
In this paper we target the problem of generating facial expressions from a piece of audio. This is challenging since both audio and video have inherent characteristics that are distinct from the other. Some words may have identical lip movements and speech impediments may prevent lip-reading in some individuals. Previous approaches to generating such a talking head suffered from stiff expressions. This is because they focused only on lip movements and the facial landmarks did not contain the information flow from the audio. Hence, in this work we employ spatio-temporal independent component analysis to accurately sync the audio with the corresponding face video. Proper word formation also requires control over the face muscles that can be captured using a barrier function. We first validated the approach on diffusion of salt water in coastal areas using a synthetic finite element simulation. Next, we applied it to 3D facial expressions in toddlers for which training data is difficult to capture. Prior knowledge in the form of rules is specified using Fuzzy logic and multi-objective optimization is used to collectively learn a set of rules. We observed significantly higher F-measure on three real world problems.
Journal
Cognitive Computation
Publication Name
N/A
Volume
N/A
ISBN/ISSN
1866-9964
Edition
N/A
Issue
N/A
Pages Count
12
Location
N/A
Publisher
Springer
Publisher Url
N/A
Publisher Location
N/A
Publish Date
N/A
Url
N/A
Date
N/A
EISSN
N/A
DOI
10.1007/s12559-024-10344-7