Civil Engineering Reference
In-Depth Information
Output
criteria (sometimes referred to as 'short-term outcomes') tend to
include:
O
the extent of agreement on some or all key issues
O
adequacy of the information stakeholders can understand and accept as
accurate
O
the making of feasible proposals.
Outcome
criteria, also referred to as second and third-order effects, can be
categorised as direct and indirect. They include:
O
a plan that serves the interests of all stakeholders
O
a plan that is flexible enough to be adapted to new conditions
O
the success with which public values are incorporated into decision-making
O
the extent to which engagement achieved its purpose
O
resolution of conflict
O
improved working or personal relationships (e.g. increased trust in public
agencies)
O
the widespread perception that outcomes are just or serve the public
interest.
Impact
(or influence) criteria might include:
O
the degree to which the public influenced the final decision or outcome
O
the extent to which decision-making is delegated
O
commitment to implementing the outcome (Baldwin and Twyford 2007).
Two different methods are generally used to assess participation effectiveness:
a) statistics and document analysis - the number of meetings, percentage of
identified stakeholders attending; comparing participant suggestions with
final outcomes; uptake or compliance with decision; and
b) surveys of participants or external others to gain an impression of satis-
faction with the process and impressions of the extent to which it achieved
the outcomes and had an impact.
Ideally the evaluation process should be determined at the outset of the process
and if possible have independent oversight (Baldwin and Twyford 2007). A
sound logic frame can assist. For example, if goals of engagement were to
encourage social learning, build trust, change practices, or resolve a particular
conflict, indicators and methods need to be appropriately incorporated.
Rigorous assessment of the effectiveness of engagement is a challenge
given the limited budgets of most organisations for planning. In addition,
the complexity of water resource management leads to challenging and
contestable issues, with its wide range of stakeholders; large geographical
