French Face-to-Face Interaction: Repetition as a Multimodal Resource - Coverbal Synchrony in Human-Machine Interaction - page 148

⎡
⎣

⎤
⎦

GestureUnit
Symmetry

⎡
⎣

⎤
⎦

Phase
Phrase
Lexicon
HandShape
HandOrientation
GestureSpace
Contact

Hands Type

⎡
⎣

⎤
⎦

MovementT rajectory
MovementVelocity
MovementAmplitude

Movement

Figure 1. Formal model for the annotation of hand gesture.

in Figure 1 also enables us to annotate gesture lemmas (Kipp, 2004:237),
the shape and orientation of the hand during the stroke, suppress
gesture space (where the gesture is produced in space in front of
the speaker's body, McNeill, 1992:89), and contact (hand in contact
with the body of the speaker, of the addressee, or with an object). We
added three tracks to code the hand trajectory (adding the possibility
of a left-right trajectory to encode two-handed gestures in a single
Hand_Type, and thus save time in the annotation process), gesture
velocity (fast, normal or slow) and gesture amplitude (small, medium
and large). A gesture may be produced away from the speaker in the
extreme periphery, while having a very small amplitude if the hand
was already in this part of the gesture space.
Head and eyebrow movements, as well as gaze direction and
global facial expressions (laughters and smiles) were annotated as well,
although not all the items projected in the coding scheme provided
in Figure 2 were noted.
⎡
⎣

⎤
⎦

⎡
⎣

⎤
⎦

⎡
⎣

⎤
⎦

⎡
⎣

⎤
⎦

Figure 2. Formal model for the annotation of head and eyebrow movements, gaze and
facial expressions.