Determining What to Study - Evaluation Methods in Biomedical Informatics - page 58

TABLE 3.2. Factors distinguishing the nine generic study types.
Version

Study Study of the Sampled Sampled

type setting resource users tasks What is observed

1. Needs Field None, or pre- Anticipated Actual User skills,

assessment existing resource tasks knowledge,

resource to users decisions, or

be replaced actions; care

processes, costs,
team function or
organization;
patient outcomes

2. Design Development None None None Quality of design

validation lab method or team

3. Structure Lab Prototype or None None Quality of resource

validation released structure,

version components,

architecture

4. Usability Lab Prototype or Proxy, real Simulated, Speed of use, user

test released users abstracted comments,

version completion of

sample tasks

5. Laboratory Lab Prototype or Proxy, real Simulated, Speed and quality

function released users abstracted of data collected or

study version displayed; accuracy

of advice given, etc.

6. Field Field Prototype or Proxy, real Real Speed and quality

function released users of data collected or

study version displayed; accuracy

of advice given, etc.

7. Lab user Lab Prototype or Real users Abstracted, Impact on user

effect study released real knowledge,

version simulated/pretend

decisions or actions

8. Field user Field Released Real users Real Extent and nature

effect study version of resource use.

Impact on user
knowledge, real
decisions, real
actions

9. Problem Field Released Real users Real Care processes,

impact version costs, team

study function, cost

effectiveness