Game Development Reference
In-Depth Information
While the Tests Are Running
The CTS divides each test into three sections comprising one or more steps and runs them one after the other to
minimize loading time for the target application. The steps, which correspond to the operations Import, Render,
Export, and Validate in the order you set them up, are numbered 0 through 5; the test grid shows which number goes
with which operation. In Figure 6-2 , the scripts for steps 0, 1, and 2 have been created and executed; steps 3, 4, and 5
will run when the first batch has completed.
Figure 6-2. The suite displays simple progress messages while the tests are running
When a test crashes, the CTS attempts to locate the last test that completed and reruns the suite from there until
it finds the test that crashed. Once you have fixed the issue that caused the test to crash, CTS will eventually manage to
continue past the failing test. You can set crash detection to yes or no and specify the timeout value in the config file.
Canceling Tests
When you cancel the tests, the CTS waits until it reaches the next section before performing the cancel operation.
Use the Task Manager to quit the CTS. Note that if you cancel, the suite ignores the entire run, and you have to start over.
As a safeguard, you might want to run small groups of tests to begin with.
Reading the Results
When evaluating the results of a test, the most important columns to check are Results and the three badge columns.
The Results column tells you whether the test worked as expected. Green means yes; red means that the test failed in
some way. The three badge columns tell you whether the COLLADA files meet expectations. If they do, the column(s)
will be green; if not, they will be red. It is possible for a Results column to be green and one or more badge columns
to be red. This means that the test worked but a badge was not achieved because the target application failed to meet
expectations, because it didn't handle the COLLADA documents properly, didn't render correctly, and so on.
When a test passes, you get messages that look like Figures 6-3 to 6-7 .
 
Search WWH ::




Custom Search