Software Testing Project Reporting - Software Testing as a Service - page 101

per working day). Review efficiency is measured in terms of the number of defects
detected per hour. Testing efficiency is measured in terms of the total number
of defects detected by the testing team compared to the total number of defects
detected by end users after the application goes into production.
But again no measurement is complete unless you also specify the context in
which the measurement was done.
In our case, some of the context could be the following:

1. Experience of test engineers

2. Qualification of test engineers

3. Size of application under test (remember, complexity and number of defects
increase exponentially more compared to increase in application size)

4. Application design complexity

5. Application design robustness (better design → fewer defects in the application)

6. Clarity in requirements (less clear requirements → more defects)

7. Coding standards (better coding standards → fewer defects)

All of these contexts themselves are subjective. In a nutshell, it is impossible
to get objective test metrics and we can never achieve 100% absolutely objective
test metrics. So, when you create your metrics, be sure to provide the context.
Otherwise the metrics will be meaningless.

8.3.1 Metrics and Reports
Then there is the story of the village lad who cried wolf when none existed just to
play a prank on his mates. But when a real wolf came along, nobody came to his res-
cue, as they thought he was again playing a prank on them. But this time the wolf
ate his sheep. his applies to your project reporting as well. Never give false reports
about your project. Otherwise, when you really are in danger, nobody will listen to
you. Shout only when you need to. It is also important that when you need help, you
must shout loud and clear so that it can be heard properly by those who matter.
So when you have solid metrics in your hand and you see problems, do not
delay in sending the report (Figure 8.2 and Figure 8.3) . Reports with solid metrics
will always be welcomed.

Productivity
(TC Creation)
TCPs/Hours

Productivity
(TC Execution)
TCPs/Hours

Effort
Variation

Schedule
Variation

Defect Density
(Defects/Hour)

Load
Factor

Review
Efficiency

Testing
Efficiency

Project

Figure ..2 Elements of test metrics.