Environmental Engineering Reference
In-Depth Information
of components was tested. In the case of quantitative tools the evaluation relies first
on the classical evaluation of numerical models (like the well-developed methods
for ecological and agronomical models) to ensure that the outputs are valid.
The second aspect is to check that each component delivers the right outputs in
the right format to the other components of the modelling chain, to ensure that the
framework as a whole derives indicators as output from scenarios as input.
Evaluation of the individual components is case-specific since it depends on the
modelling concepts used by the discipline from which they originate. Continuing with
the example of APES, agronomic validation methods were used to assess the validity
of the results. In addition the programming of the model was tested (programming
bugs, rapidity, RAM and ROM requirement) as well as its compatibility with
multiple operating systems. The latter requirement was essential for the objective
to integrate APES in the SEAMLESS-IF framework. The testing itself was split
into qualitative and quantitative tests.
The qualitative tests consisted of expert appraisals of results. Given the known
reaction of crops to modification of soil, weather or management (e.g. reduced yield
with no N fertilization or less rain) it was analyzed if the model could reproduce
this trend.
The quantitative tests then proceeded by more in depth study of the precision,
robustness and sensitivity of the APES model. These tests took place through
workshops in which mini-applications typical of the agricultural activities to be
simulated by APES in SEAMLESS-IF were simulated. These workshops involved
three types of participants:
-
Mini-applications experts with broad knowledge of the soil, crops and
agro-management and able to provide data for calibration and evaluation
(both data from test cases regions and field experiments were used)
Component developers of all components combined in the APES configuration
-
required for the mini-application (e.g. the soil water component, the arable crops
component, etc.); and
Software experts able to change equations and parameters in the code version
-
during the workshop
This combination of participants allowed several iterations between evaluation and
model development. The quantitative evaluation revealed that the availability of
suitable detailed data needed for quantitative testing is hard to obtain for the range
of situations representative of Europe. This requirement limits the scope for a full
evaluation in line with the agronomic standards, but seems inherent to the development
of an integrated framework of the size and scale of SEAMLESS-IF.
Technical Evaluation of the User Interface
The technical evaluation of the GUI addresses issues like ease of use, rapidity,
ergonomics related to the use of the system through the interface. In addition the
