Information Technology Reference
In-Depth Information
Ta b l e 4 .
Questions referring to the text, generated for the specification in Table 1
Specification
Generated Question
Sentence:
the unit for detection of the level of
steam is defective - that is , when v is not equal
to zero - the program enters the emergency stop
mode.
Unspecified source state:
transition “the unit
for detection of the level of steam is defective -
that is , when v is not equal to zero - the pro-
gram enters” to state “emergency stop mode”.
Sentence:
the program realizes a failure of the
water level detection unit it enters the emer-
gency stop mode.
Unspecified source state:
transition “the pro-
gram realizes a failure of the water level de-
tection unit it enters” to state “emergency stop
mode”.
Sentence:
as soon as this signal has been re-
ceived , the program enters either the mode nor-
mal all the physical units operate correctly the
mode degraded any physical unit is defective.
Unspecified source state:
transition “all the
physical units operate correctly” to state “mode
normal”.
Sentence:
as soon as this signal has been re-
ceived , the program enters either the mode nor-
mal all the physical units operate correctly the
mode degraded any physical unit is defective.
Unspecified source state:
transition “any phys-
ical unit is defective.” to state “mode degraded”.
Sentence:
a transmission failure puts the pro-
gram into the mode emergency stop.
Unspecified source state:
transition “a trans-
mission failure puts” to state “mode emergency
stop”.
4.1
Experiment Setting
In order to evaluate the generated feedback questions, the following evaluation hypoth-
esis was put forward:
H
: The automatically generated questions address deficiencies of the specification that
would be overseen by human analysts.
In total, 9 PhD candidates/postdocs in computer science participated in the evalua-
tion. The evaluation took place in the following way:
1. First, the experiment subjects were given the chapter of the Steam Boiler Specifica-
tion [7] that refers to the system behavior (2 pages). Each subject was asked to read
Ta b l e 5 .
Questions referring to the model, generated for the specification in Table 1
Source Target Condition
unknown state
emergency stop mode the unit for detection of the level of steam is defective
- that is , when v is not equal to zero - the program
enters
unknown state
emergency stop mode the program realizes a failure of the water level de-
tection unit it enters
unknown state
mode normal all the physical units operate correctly
unknown state
mode degraded any physical unit is defective .
unknown state
mode emergency stop a transmission failure puts
