Information Technology Reference
In-Depth Information
repeated measurement design (random order)
interview
questionnaire
BPM intro sample
t.BPM modeling
conditioning
experimental task
data collection
Fig. 3.
Experiment Setup for this study
randomly assigned to do either interviews or model with t.BPM. The topic is
randomly chosen between buying expensive equipment and running a call for
tender. Two persons operate the experiment. One guides the subjects in the
role of an interviewer, the other one observes the situation and ensures a stable
treatment throughout the experiment. They randomly swap roles.
During the experimental task data is collected using video recording. After-
wards, a questionnaire is to be filled in by the subjects. In every step of the
experiment, the time is tracked but time constrains are not imposed on subjects.
After the first run, subjects rerun the experimental task using the other method
and the other process to report on.
In other words, we use a randomized balanced single factor design with re-
peated measurements [25] also known as a within-subjects design. All subjects
get both treatments assigned in different order. All subjects do interviews and
process modeling. Finally, all subjects are rewarded for their participation with
a chocolate bar and a cinema voucher.
3.3 Experimental Material
We briefly outline and explain the printed material used in this experiment. The
original documents are appended to the technical report [15]. Like the experi-
ment, the experimental material is in German.
•
BPM introduction: Two pages explaining the terms Business Process Man-
agement, Business Process Modeling and process models.
•
Sample model: One page depicting the process of ”Making Pasta” and four
pragmatical hints on process modeling such as verb-object style labeling.
•
2x task sheet: One paragraph explaining the process to report on. It explicitly
sets the context, the start and the end-point of the process.
•
Interview guide (for experimenter): Experimenters read out the same six
questions in each experimental task. The sheet also contains standardized
answers to potential questions from participants.
•
Questionnaire: Items to be rated on a 5-point Likert scale. Details are ex-
plained in Section 3.5.
