Modeling and Synthesis of Realistic Visual Speech in 3D - 3D Modeling and Animation: Synthesis and Analysis Techniques for the Human Body - page 266

Chapter VIII
Modeling and Synthesis
of Realistic Visual
Speech in 3D
Gregor A. Kalberer
BIWI - Computer Vision Lab, Switzerland
Pascal Müller
BIWI - Computer Vision Lab, Switzerland
Luc Van Gool
BIWI - Computer Vision Lab, Switzerland and VISICS, Belgium
Abstract
The problem of realistic face animation is a difficult one. This is hampering
a further breakthrough of some high-tech domains, such as special effects
in the movies, the use of 3D face models in communications, the use of
avatars and likenesses in virtual reality, and the production of games with
more subtle scenarios. This work attempts to improve on the current state-
of-the-art in face animation, especially for the creation of highly realistic
lip and speech-related motions. To that end, 3D models of faces are used
and — based on the latest technology — speech-related 3D face motion will
be learned from examples. Thus, the chapter subscribes to the surging field
of image-based modeling and widens its scope to include animation. The
exploitation of detailed 3D motion sequences is quite unique, thereby