Information Technology Reference
In-Depth Information
ff
For each di
erent load of users carrying out document management activities, the table
shows the average memory usage and CPU usage across the whole execution together
with an indication of system duration.
% users
Average Mem Average % Total Sys Time (mins)
monitored
(Kb)
CPU
None
MOP
poly
10
13.8
31.3
1.6
1.7
1.7
50
24.3
32.9
3.2
3.3
3.3
100
27.2
33.5
3.4
3.5
5.7
The monitoring overheads are non-trivial in these scenarios and the analysis allows
an understanding of how monitoring a
ff
ects the overall system execution.
5
Related Work
While industry-calibre tools (e.g., jMock 5 ) exist for mocking parts of a system under
test, to the best of our knowledge, no tools exist which enable one to mock a whole
system. Another significant di
erence of SMock from existing mocking tools is that
these do not explicitly support the specification of CPU and memory usage. SMock, not
only provides this through a dedicated language, but also provides constructs for the
specification of probability distributions over such resources. These di
ff
ff
erences make
SMock ideal to test systems which act upon other systems, e.g., monitoring systems
and testing systems.
Another area of somewhat related work is the area of tra
c generators (e.g., Apache
JMeter 6 ) for performance testing. However, such tools assume the existence of a system
on which tra
c is generated. Since the load on a runtime verification tool occurs by
proxy , i.e. as a consequence of the load of another system, performance testing tools
cannot be used directly for the performance testing of runtime verification tools.
6
Conclusions and Future Work
With the significant advancements in the area of runtime verification in recent years, the
availability of mature tools is crucial for the increased adoption in industry. To facilitate
the testing and profiling of runtime verification tools we have presented SMock 7 ,a
mock system generator coupled with replay and profiling capabilities. The tool has
been successfully applied to two state of the art tools showing the overheads in terms
of time taken, memory consumption, and processing resources.
Future improvements to SMock will focus on providing more advanced profiling fea-
tures such as power consumption measurement and automatic measurement repetition
5 http://jmock.org/
6 http://jmeter.apache.org/
7
The tool can be downloaded from http://www.cs.um.edu.mt/svrg/Tools/SMock
 
Search WWH ::




Custom Search