Information Technology Reference
In-Depth Information
Figure 1. MapMobile device (on the left), and the user with the facilitator and the cameraman in one of
the building corridors (on the right)
the users. Our hypothesis was that the two obser-
vations techniques had a similar power of detec-
tion of usability problems. The comparison used
a blind test. The analyses of the two kinds of re-
corded data were performed separately. No com-
munications were allowed between the evaluators.
Once both finished analysis, another evaluator
crosschecked and compared the two sets of results,
and in case of mismatch, verified the exactness
of the usability problems detected thanks to the
video records.
In summary, the meta-evaluation concluded
that usability problems detected via classic obser-
vations techniques (without ecological context)
were more numerous. The second observation
technique (with ecological context) could only
detect usability problems that alter -deviate or
delay- a reference sequence of user interactions
and interface feedbacks. However, the main
critical usability problems were detected via the
two observation techniques (Jambon, Golanski,
et al., 2007).
E-skiing experiment. The objective of the E-
skiing experiment was to test the Trojan Horse
technique in-vivo. The device under test imple-
mented a proactive service that aimed at improving
the skier's experience. The system carried by the
skiers (Figure 2) was composed of a set of sen-
sors (video, acceleration, and geo-localization)
associated with recorders and a user interface
(smartphone). During the skiing day, the data from
the sensors were recorded and analyzed after each
ski run. The skiers were informed proactively, via
SMS, that new information on their preceding
ski runs was available. Thanks to the hyperlink
provided in the SMS, the skiers could consult via
the smartphone their performances: the course, the
distance crossed, the run duration, the maximum
speed, the acceleration, and the video of the run.
Since it was only a technical test, only one group
of four skiers used the system. As a consequence
we did not try to conclude about the usability of
the system.
The hypothesis was that the Trojan Horse
technique could be used in an ecological context
and that the observation of user interactions was
possible. This experiment was preceded by many
technical tests, in laboratory, outside, and in the
ski resort. In spite of these tests, the video records
were almost not exploitable for the usability
analysis: the weak visual angle of the mini-
cameras and displacements of the helmets during
the runs resulted in bad framing. Moreover, be-
cause of accelerations during jumps, three of the
Search WWH ::
Custom Search