Information Technology Reference
In-Depth Information
CHAPTER 4
Performance Metrics
63
CONTENTS
4.1 TASK SUCCESS
65
4.1.1 Binary Success
66
4.1.2 Levels of Success
70
4.1.3 Issues in Measuring Success
73
4.2 TIME ON TASK
74
4.2.1 Importance of Measuring Time on Task
75
4.2.2 How to Collect and Measure Time on Task
75
4.2.3 Analyzing and Presenting Time-on-Task Data
78
4.2.4 Issues to Consider When Using Time Data
81
4.3 ERRORS
82
4.3.1 When to Measure Errors
82
4.3.2 What Constitutes an Error?
83
4.3.3 Collecting and Measuring Errors
84
4.3.4 Analyzing and Presenting Errors
84
4.3.5 Issues to Consider When Using Error Metrics
86
4.4 EFFICIENCY
86
4.4.1 Collecting and Measuring Efficiency
87
4.4.2 Analyzing and Presenting Efficiency Data
88
4.4.3 Efficiency as a Combination of Task Success and Time
90
4.5 LEARNABILITY
92
4.5.1 Collecting and Measuring Learnability Data
94
4.5.2 Analyzing and Presenting Learnability Data
94
4.5.3 Issues to Consider When Measuring Learnability
96
4.6 SUMMARY
96
Anyone who uses technology has to interact with some type of interface to accom-
plish their goals. For example, a user of a website clicks on different links, a user
of a word-processing application enters information via a keyboard, or a user of
a video game system pushes buttons on a remote control or waves a controller in
the air. No matter the technology, users are behaving or interacting with a prod-
uct in some way. These behaviors form the cornerstone of performance metrics.
Every type of user behavior is measurable in some way. Behaviors that achieve
a goal for a user are especially important to the user experience. For example,
Search WWH ::
Custom Search