Information Technology Reference
In-Depth Information
the addition of a rendezvous. This task has the uniqueness of requiring the
consultation of at least three application interfaces.
- A test phase of the model: the evaluator presents the chosen tasks to the
subjects as well as the evaluation criteria and their definition, and asks them to
select the most important criteria according to their needs and preferences. Then the
subjects evaluate the system according to the defined criteria, during the execution
of tasks, with a mark representing their level of satisfaction. Forms allowing the
possible problems to be noted are also available. Twenty-three people participated
in this evaluation (two evaluators-experts, 20 students-subjects and one technician).
The length of an evaluation period was around three hours per subject.
- An analysis phase: the evaluator calculates the level of satisfaction of each
user relatively to each criterion, and their average levels of satisfaction.
The system is evaluated according to seven criteria, of which three are linked to
content and four are to the container:
-
Personalization of the content
(see Figure 3.25): 47% of users are very
satisfied, 41% are satisfied, 6% not very satisfied and 6% of users are not at all
satisfied. Figure 3.25 shows that the subjects are favorable to the quality of
personalization linked to preferences and to the experiment (average > 0.6).
Concerning the experiment, subjects spoke of the lack of help during first use. The
consideration of interests (professional or personal) is less satisfying.
Figure 3.25.
Average satisfaction levels according to criteria linked to content
-
Personalization of the container
(see Figure 3.26): the satisfaction rate is 33%
for very satisfied subjects, 17% for satisfied subjects and 50% for not very satisfied
subjects. After having tested the application using two different interactive media
(PC and PDA), the subjects gave a favorable opinion for adaptation of the system to
the interactive platform. As for the adaptation to behavior (adaptation to the goals
