Game Development Reference
In-Depth Information
Aren't you glad you didn't have to do that by hand! The “case�? and “pairings�? columns
are added to the output by the Allpairs tool. “Case�? is a sequential number uniquely
identifying each test case. The “pairings�? number indicates how many necessary para-
meter pairs are represented by the set of values in each row. For example, the “pair-
ings�? value in row 18 is 4. You can check for yourself that row 18 produces four new
pairs: Easy-Largest, Easy-60, 1-Largest, and 1-60. The Largest-60 pair was satisfied ear-
lier in the table at row 17, and the Easy-1 pair first appears in row 13.
Values that begin with the “~�? symbol are wildcards. That is, any value of that para-
meter could be placed there without removing one of the necessary pairings to com-
plete the table. The tool arbitrarily chooses but you, the knowledgeable tester, can
replace those with more common or notorious values, such as defaults or values that
have caused defects in the past.
The output from Allpairs also produces a Pairing Details list, which is an exhaustive
list of each necessary pair and all of the rows that include that pair. One of the pair-
ings listed for the DOA3 table is
MatchPoint
Difficulty
1
Easy
2
13, 18
which means that the pair Match Point = 1 and Difficulty = Easy occurs 2 times—in
rows 13 and 18 of the table.
In the same list, the entry
RoundTime
LifeGauge
60
Largest
4
17, 18, 19, 20
traces the RoundTime = 60 and LifeGauge = Largest pair to rows 17-20 of the com-
binatorial table. This kind of information is especially useful if you want to limit your
testing to all the instances of a particular pair. One reason for doing that would be to
limit verification testing of a release that fixed a bug caused by one specific pair.
Another use for the Pairing Details information is to quickly narrow down the possi-
ble cause of a new defect by immediately testing the other entries in the table that had
the same pairs as the test that just failed. For example, if the test in row 13 fails, search
the Pairing Details list for other pairs that were included in row 13. Then run the tests
on any rows listed in addition to row 13. Here are the pairs that are satisfied by row 13:
RoundTime
MatchPoint
50
1
1
13
RoundTime
LifeGauge
50
Large
1
13
RoundTime
Difficulty
50
Easy
1
13
MatchPoint
LifeGauge
1
Large
2
13, 30
MatchPoint
Difficulty
1
Easy
2
13, 18
LifeGauge
Difficulty
Large
Easy
2
13, 34
Search WWH ::




Custom Search