French Face-to-Face Interaction: Repetition as a Multimodal Resource - Coverbal Synchrony in Human-Machine Interaction - page 167

the different modalities, for them to be repeated or not independently
from each other.
We saw as well that timing between model and repetition is of
extreme relevance in terms of convergence. When two gestures are
produced in complete overlap (and therefore cannot be termed model
and repetition), convergence between interactants is at its highest.
These particular occurrences of gesture match between participants
are also generally accompanied by verbal and prosodic matches.
Beyond the study of repetition, we presented here the more global
perspective of the OTIM project which aims to create resources in terms
of multimodal corpus and annotations. Thanks to the annotations now
available we can investigate numerous phenomena in conversation,
that we can compare and that we hope to be able to analyze shortly
in a more systematic way, thanks to the adaptation of tools, and
automatization in gesture annotation.
Acknowledgements
This research is supported by the French National Research Agency
(Project number: ANR BLAN0239). The OTIM project is referenced on
the following webpage: http://aune.lpl.univ-aix.fr/~otim/.
REFERENCES
Allwood, J. , L. Cerrato, L. Dybkjaer, K. Jokinen, C. Navarretta and P. Paggio.
2005. The MUMIN Multimodal Coding Scheme, NorFA yearbook 2005.
HYPERLINK “http://www.ling.gu.se/~jens/publications/B%20files/
B70.pdf”
Allwood, J., M. Bjornberg, L. Gronqvist,. E. Ahlsén and C. Ottesjö. 2000. The
Spoken Language Corpus at the Department of Linguistics, Göteborg
University. Forum: Qualitative Social Research , 1(3): 1-20.
Anderson, A.H., M. Bader, E. Gurman Bard, E. Boyle, G. Doherty, S. Garrod,
S. Isard, J. Kowtko, J. McAllister, J. Miller, C. Sotillo, H.S. Thompson
and R. Weinert. 1991. The HCRC map task corpus. Language and Speech ,
34: 351-366.
Barth-Weingarten, D. 2011. Double sayings of German JA—More observations
on their phonetic form and alignment function. Research on Language &
Social Interaction , 44(2): 157-185.
Bavelas, J.B., L. Coates and T. Johnson. 2000. Listeners as co-narrators. Journal
of Personality and Social Psychology , 79: 941-952.
Bertrand, R., G. Ferré, R. Espesser, S. Rauzy and P. Blache. 2007. Backchannels
revisited from a multimodal perspective. In Proceedings of AVSP (Auditory
Visual Speech Processing) , Hilvenbareek, Pays-Bas, [On CD-rom].