Information Technology Reference
In-Depth Information
report a glorified self-image. Thus, we suggest to mix measurement instruments
for each measured concept. In other words, complement perceived measures with
external measures such as video codings. But we also had to learn that rigor video
analysis is the most time-consuming evaluation task.
Besides all that, we think that the compact on-site experiment was a good
idea. Instead of spreading it out over various weeks with changing conditions,
we could collect the data in a compact week with a stable setup. Moreover, the
two experimenters to review each others work did ensure a stable setup.
7Conluon
This paper reports on a controlled experiment which was conducted with 17
student clerks at a trade school. We investigate the process elicitation method
as an independent variable. Subjects did structured interviews and t.BPM in
a repeated measurement design. We claim that t.BPM enables more ecient
process elicitation. We argue that ecient elicitation is not about the amount
of information but about user engagement and validated results. We decompose
these aspects into nine operationalized hypotheses. Three hypotheses did hold.
Three more might hold with a larger sample set.
The results show strong support for user engagement through activation of
participants and validated results through more feedback from participants. We
think that these findings are reproducible with other tangible system modeling
approaches when compared with interviews.
Our findings are limited by the measurement instruments and the small sam-
ple size (N=17). A future experiment with a larger group and better tested
instruments might re-enforce our findings and also support
H
1
,
H
3
and
H
6
.In
other words, it would extend our rigor findings to more talking, more fun and
more reviews with tangible media. For now we only showed significantly more
thinking time (
H
2
), more corrections (
H
7
) and more insights into modeling (
H
9
)
when using tangible media instead of interviews.
Acknowledgements
We are grateful to the students that helped setting up, running, and evaluating
this experiment, namely Karin Telschow, Markus Guntert and Carlotta Mayolo.
We'd also like to thank the reviewers for their valuable feedback. It led to a
substantial revision of Sections 3.1 and 6.
References
1. Byrd, T., Cossick, K., Zmud, R.: A synthesis of research on requirements analysis
and knowledge acquisition techniques. MIS Quarterly, 117-138 (1992)
2. Cooper, D., Schindler, P.: Business Research Methods, 10th edn. McGraw-Hill
Higher Education, New York (2008)
