Information Technology Reference
In-Depth Information
Fig. 22.11 The ICSRiM conducting interface showing a conducting gesture with 3D visualisation
also provides a multimodal recording (and playback) interface to capture/measure
detailed conducting gesture in 3D for the preservation of the performance.
A portable motion capture system composed by multiple Nintendo Wiimotes is
used to capture the conductor's gesture. The Nintendo Wiimote has several advan-
tages as it combines both optical and sensor based motion tracking capabilities, it is
portable, affordable and easily attainable. The captured data are analyzed and pre-
sented to the user highlighting important factors and offer helpful and informative
monitoring for raising self-awareness that can be used during a lesson or for self-
practice. Figure 22.11 shows a screenshot of the Conducting System Interface with
one of the four main visualization mode.
22.5.5 Preservation with Ontology Models
The preservation of these IMP systems is of great importance in order to allow future
re-performance, understanding and analysis. The multimodal recordings of these
systems offer an additional level of detail for the preservation of musical gesture
and performance (style, interpretation issues and others) that may be vital for the
musicologist of the future.
Preserving an interactive multimedia performance is not easy. Preserving the sin-
gle digital media object for a longer term is already a challenging issue. However,
putting all the necessary digital objects together does not reconstruct the full system
to allow a re-performance. For the preservation of IMP, we proposed to preserve the
whole production process with all the digital objects involved together with their
Search WWH ::




Custom Search