Information Technology Reference
In-Depth Information
mtype = {parole, manipulation, nil}; % modalities of the system
byte state, random;
mtype action; % variable designating the modality used
proctype exclusive()
{ random=1;
% initialization of the system at state 1. The modality is initialized
% either by speech or by direct handling
if
::random==1 -> atomic {action=speech; state=1};
::random==1 -> atomic {action=handling; state=1};
fi ;
goto E1;
% first transition to state 2. The modality either goes to speech
% or direct handling in a random way
E1 :
ยทยทยท
Figure 4.2. Promela code corresponding to the exclusive type multimodal HCI
4.5.1.1. Bernsen's design space
In [BER 94], Bernsen specifies the outputs of the multimodal system by a
generative approach that consists of combining the elementary or pure modalities in
order to get more complex representations. The modalities are classed according to
four criteria:
- static or dynamic: expresses the intervention of the time factor in the evolution
of the modality, a text displayed is a static modality whereas speech is a dynamic
modality;
- linguistic or non-linguistic: highlights the existence of linguistic components
in the modality, a text displayed is a linguistic modality whereas a sound beep is a
non-linguistic modality;
- analog or non-analog: gives the correspondence of the modality with objects
of the real world, a photograph is an analog modality unlike a histogram that is a
non-analog modality;
- arbitrary or non-arbitrary: expresses whether it is necessary or not for the user
to learn a new semantic system to be able to interpret the modality. For example,
the photograph modality is non-arbitrary since the user does not need to learn a
particular semantic system to identify what a photograph represents (interpretation
of the modality), whereas the modality symbol is arbitrary as it requires the user to
 
Search WWH ::




Custom Search