Information Technology Reference
In-Depth Information
P
:
Don't think so? Then I will use Ms Remerink. You can still call me Bill, if
you have any questions you can do it like that...eh...eh...Ms Remerink.
One of the observers wrote down:
The suspect is
invited to call the police officer Bill
, even though she
insists
that he calls
her Ms Remerink. He is trying to
be nice
, but he might give away
power
.Nowthere
is
asymmetry
in the way they
address
each other (officer has to say “u” while she can
say “je”
3
).
This description provides six descriptive terms for the fragment:
tutoyer
,
4
insist
,
be nice
,
power
,
asymmetry
, and
address
. A subgroup of the observers watched all
the interesting fragments and also reported as many terms as possible to describe
these fragments using a “think-aloud” strategy (step 3 in Fig.
16.1
). In the example
above, they added the terms
status
and
cold
to the terms selected by the original
observer.
The subgroup of observers added fewer new terms to the entire collection of
terms with every successively interview fragment. The first observed fragment
yielded over 50 unique terms while only 3 new terms were added to the existing
collection after observation of the annotations of the final interview. From this we
conclude that we have obtained a sufficiently complete collection of terms necessary
to describe the interviews included in our corpus: a
semantic frame
(Allan
2001
).
Eventually, the collection converged on a total of 251 unique terms.
16.2.3
Rating and Factoring Fragments
Based on the semantic frame of 251 terms, we created 227 questions with variations
of the format
“To what extent is [term] the case?”
(step 4 from Fig.
16.1
).
We excluded terms that were not suited to create meaningful questions, for example,
“fact” was a term that is too general to yield a sensible question or every question
would have to be specific to the scenario. Example questions that were included are
“To what extent is aggressive behaviour the case?”, “To what extent is the speaker
indifferent?”, and “To what extent is there an uncomfortable posture?”
The original six observers rated fragments from the corpus on a five-point Likert
scale for every question (step 5 from Fig.
16.1
). The observers scored 14 fragments
(with a total running time of 19 min) of the corpus on the 227 questions. The
rated fragments were randomly selected from the fragments that were selected at
3
In Dutch there is a difference between the second person pronouns “u” (formal) and “je”
(familiar), both are translated to “you” in English.
4
The (French) term for “to thee and thou”, to be familiar, based on the description “[..] invited to
call the police officer Bill.”
Search WWH ::
Custom Search