Constructing and Evaluating Your Design Solution - Data Visualization: A Successful Design Process - page 169

• Peer review : Sometimes the most important and constructive evaluation
can come from peers, perhaps expert practitioners or thought leaders. In the
visualization field, there are many examples of bloggers who will conduct a
review and critique of new work. Getting visitor hits is one thing but receiving
a positive review and mention from a peer is worth its weight in gold.
• Unstructured feedback : This type of evidence might come via online
comments forms, reaction on social media, or through anecdotal channels
(e-mails, in-person conversations, perhaps overheard comments) to add a
layer of qualitative reaction and evidence of success or failure.
• Invite user assessment : Rather than placing value on anecdotal or
reactionary and opportune feedback, you could be more proactive
by offering simple mechanisms for users to provide more structured
qualitative responses, perhaps through small-scale questionnaires.
• Formal case studies : Taking things to a more advanced level of evaluation
(almost academic in its nature), case studies can take many forms using
techniques such as interviews, observations, and controlled experiments,
where you might set tasks, manipulate conditions, and record responses.
These will often be undertaken by an independent observer to offer that
degree of integrity.
No matter through which of these methods you obtain your evaluation feedback,
you should be prepared for and accept criticism. Of course, in this digital age
everyone is a critic—and too often anonymous—but you should always welcome
constructive feedback and use this to fuel your development.
Finally, from your personal point of view, how effective did you think it went?
Your own satisfaction is very important because this is what also drives your future
decisions and development. Often we'll know best whether something could be
considered to be an effective outcome and a satisfying process. Even if the results
are very positive, there may be many things you thought could have gone better:
• Did you accomplish the outcomes you wanted?
• Did you create something you were satisfied with?
• Were you satisfied with how you rationalized the choices?
• Maybe you hated the project, the client, or the subject matter
• Perhaps you spent far too long on the work and you haven't been paid or
rewarded sufficiently for the time you invested
• Maybe you regret consuming so much caffeine late at night