Information Technology Reference
In-Depth Information
The information
uie
2
is expressed by the picture modality on the screen (restitution
of the map).
The multimodal presentation
pm
corresponding to
i
is the temporal parallel and
semantic complementary combination of the elementary multimodal presentations
pme
1
and
pme
2
:
pm
=(
Pl
,Cp
)((
speech
,
loud-speaker
)(
uie
1
)
compl
(
facial expression
,
screen
)
(
uie
1
))
,
(
picture
,
screen
)(
uie
2
))
.
4.6. Conclusion
This chapter has dealt with the design of HCI, and in particular multimodal HCI.
They are increasingly present in transport systems, particularly critical systems, and
few works have concerned themselves with their formal validation.
We focused on the formal modeling of these HCIs. The benefit of approaches
put forward is twofold. On one hand, these approaches enable us to,
apriori
,
master the complexity of the development process of the interface. This complexity
is accentuated by the presence of synchronization primitives and of semantic
reference between information, which come from the particularities introduced by the
multimodal nature of these HCIs. On the other hand, once the formal model has been
established, these approaches enable us to establish or verify certain properties of
usability of the interface
beforehand
. We have made sure to present formal modeling
of these properties in the same model, which served to describe the multimodal HCI
studied.
Furthermore, the approach proposed enables us to define the multimodal
HCI models in a progressive and iterative manner by introducing the different
characteristics throughout the modeling phase. Finally, we made a special case study
to define a generic model, taking into account different design spaces and enabling
the processes of both input and output multimodality. This enables us to target
different validation techniques that support the verification of the desired properties.
Several extensions of these works can be envisaged. We gave two. With regards
to the definition of HCIs, it seems important to us to define other instantiations
of the model proposed on other design spaces or approaches of multimodal HCI
descriptions, both in input and output. With regards to formal verification, it is a
matter of defining generic properties guaranteeing the quality of HCIs modeled and
transformations, preserving the semantics of the system modeled, which extend a
modelization following the model put forward in a target formal technique which
supports the verification of properties.
This work has partially been addressed in the case of input multimodality but must
be dealt with in the case of output multimodality.
