Information Technology Reference
In-Depth Information
expression gives a number (“these three objects”, “these four shapes”, “this
object, this one and this one”) and the ambiguity has disappeared, or it has
not. The ambiguity is then confirmed and the system must decide between
choosing one of the alternatives or generating a clarification question for the
user [LAN 06].
Other ambiguities and analyses can be considered. Within the frame of an
MMD relying on an MMI, any gesture is thus first considered as ambiguous,
being either a conversational gesture meant for the dialogue system or a direct
manipulation gesture meant for the MMI. At the analysis level, there are other
approaches that consist, for example, of the gesture module not suggesting
any hypotheses when faced with ambiguity [MAR 06], which can lead the
dialogue manager, if the linguistic module cannot find the referent on its own,
to decide on a reaction without having any hypothesis (and thus to query the
referent's identity). Kopp et al.'s [KOP 08] approach, for gesture generation
but the idea can be applied to automatic understanding, consists of
implementing a gesture formulator that reasons based on a set of features with
values translating localization, trajectory meaning, direction of each digit
(when the hand configuration is tracked by a camera or a pointing glove), the
palm orientation or even the hand's general shape. In general, the processes to
be implemented depend on the modalities recorded in input: where the
camera tracking requires many parameters to rebuild the meaning of an iconic
gesture (or of a gesture in sign language), the use of a touch screen lowers the
gesture interaction to be processed to simple trajectories, such as the classic
interaction with a mouse.
6.1.4. Reference resolution depending on determination
The analysis of the visual context and that of gestures happens in parallel
with linguistic analyses. As we saw in the previous chapter, they collaborate
with each other to achieve a formal representation of the utterance's meaning
that takes into account the prosodic, lexical, syntactic and semantic meanings
of it. In “how long with this itinerary which seems shorter?”, the prosody
indicates, for example, a slight accentuation of the demonstrative referring
expression “this itinerary”. Syntax and semantics conclude with this prosody
that “which seems shorter” is not a restrictive relative that could help identify
the reference. The semantic lexicon allows the system to create a link
between “itinerary” and the concept of travel described in the application's
Search WWH ::
Custom Search