Information Technology Reference
Adaptive and intelligent HCI technologies and
This paragraph is devoted to artificial intelligence (AI) technologies and
methodologies used in adaptive intelligent interfaces for UC devices .
The general adaptation process is described in Figure 1.
The main modules in the Figure 1 are
cognitive comprehension and
In this framework the user interacts with an interface that changes with
respect to the mental state. The processing modules receive as input some
pieces of information regarding the user's sensory status.
The perceptual module processes images of the user's face and eye
(eye position, pupil size and so on). Moreover, it analyses the body and its
The behavioural module analyses the actions performed on the interface:
pressed keys and the force exerted in pressing them, mouse movements,
clicks number and position, and so on.
Both modules provide data that are merged in a unique sub-symbolic
representation to allow a learning algorithm to recognize some emotional
states like confusion, stress, mental fatigue and so on.
Symbol grounding to perceptual data has been discussed for a long time
in several disciplines like cognitive sciences, AI, computer vision and
robotics. Percepts can be represented as a set of signals that are continuous
Figure 1: Adaptation process in AI that is used for intelligent interfaces.