Camera Calibration for 3D Reconstruction and View Transformation - 3D Modeling and Animation: Synthesis and Analysis Techniques for the Human Body - page 116

Telepresence
Camera information is also needed in a telepresence application. An IBR
toolbox, which explicitly employs camera calibration results, has been developed
for producing arbitrary virtual views of the human body, face, and hands, of
which detailed 3-D models are difficult to acquire. In this section, a brief
introduction is given to this IBR toolbox. Detailed discussions can be found in Lei
& Hendriks (2002).
Set-up and processing framework
Figure 5 shows the infrastructure of a three-party telepresence system, in which
participants are given a 3-D perception via a 2-D display that provides the motion
parallax cue. For example, when participant A moves his head, he should be able
to perceive different views of participant B and his (virtual) environment. The
virtual environment can be easily built by current available 3-D graphics
techniques. Since the 3-D modeling of a realistic human body and face is still
quite difficult, if not impossible, the arbitrary virtual views of the participants are
synthesized efficiently in the 2-D image space, ignoring the intermediate 3-D
model (Lei & Hendriks, 2002). For instance, the virtual view of participant C can
Figure 5. Illustration of a three-party telepresence video-conferencing
system.