Information Technology Reference
In-Depth Information
mtype = {parole, manipulation, nil}; %
modalities of the system
byte state, random;
mtype action; %
variable designating the modality used
proctype
exclusive()
{ random=1;
%
initialization of the system at state 1. The modality is initialized
%
either by speech or by direct handling
if
::random==1 ->
atomic
{action=speech; state=1};
::random==1 ->
atomic
{action=handling; state=1};
fi
;
goto
E1;
%
first transition to state 2. The modality either goes to speech
%
or direct handling in a random way
E1 :
ยทยทยท
Figure 4.2.
Promela code corresponding to the exclusive type multimodal HCI
4.5.1.1.
Bernsen's design space
In [BER 94], Bernsen specifies the outputs of the multimodal system by a
generative approach that consists of combining the elementary or pure modalities in
order to get more complex representations. The modalities are classed according to
four criteria:
- static or dynamic: expresses the intervention of the time factor in the evolution
of the modality, a text displayed is a static modality whereas speech is a dynamic
modality;
- linguistic or non-linguistic: highlights the existence of linguistic components
in the modality, a text displayed is a linguistic modality whereas a sound beep is a
non-linguistic modality;
- analog or non-analog: gives the correspondence of the modality with objects
of the real world, a photograph is an analog modality unlike a histogram that is a
non-analog modality;
- arbitrary or non-arbitrary: expresses whether it is necessary or not for the user
to learn a new semantic system to be able to interpret the modality. For example,
the photograph modality is non-arbitrary since the user does not need to learn a
particular semantic system to identify what a photograph represents (interpretation
of the modality), whereas the modality symbol is arbitrary as it requires the user to