PerformingNon-Rigid Structure fromMotion - Deformable Surface 3D Reconstruction from Monocular Images - page 74

Frame 5 Frame 30 Frame 60

Figure 6.13: Reconstruction of a deforming cushion Llado et al. [ 2010 ]. The approach relies on the
rigid chair to constrain the motion estimation. On the second and third rows, the reconstructed surface
is shown from two different viewpoints. Courtesy of A. Del Bue.

The segmented rigid points are then used to compute the motion parameters. Finally, the non-
rigid structure is estimated via a nonlinear optimization procedure. In this case, the surface is still
computed as a linear combination of basis shapes. This assumption of rigidly moving points proved
valid for face reconstruction, or when several objects are moving with respect to each other, as shown
in Fig. 6.13 . However, this does not generalize to arbitrary non-rigid objects.