Performing Subjectivist Studies in the Qualitative Traditions Responsive to Users - Evaluation Methods in Biomedical Informatics - page 275

locations of two known points a fixed distance apart. Triangulation was orig-
inally used in the social sciences to describe multiple data collection tech-
niques employed to measure a single concept. The definition of the term
has expanded to include the use of multiple theories, multiple researchers,
and multiple methods, or combinations of these, to obtain a “fix” on a spe-
cific issue. In qualitative studies, triangulation means the weaving together
of different data gathering techniques, data elements, or investigators 10 to
help ensure that the resulting descriptions and interpretations are as useful
as they can be. Comparing and contrasting data from these varying sources
verifies and strengthens the results that emerge.
Member Checking
Member checking employs the actual subjects in the study, at various points,
to confirm that the investigator's findings are reasonable. 11 This can be
based on brief, individual contacts (“Did I get the main point from the
meeting yesterday?”) or on repeated contact with an intact group within
the organization that will serve this function progressively throughout the
study. The investigator asks if his/her notes and arguments are logical and
to the point. To the extent that these informants confirm that the argument
makes sense, this constitutes an important kind of support for it. Member
checking can be used both to validate and sharpen preliminary hunches at
the early stages of a study, and to confirm an almost-finalized argument
toward the end.
Data Saturation
At some point in the life of the study, the next cycle in the field seems like
it will be repetitive. During the analysis process, little that is new emerges.
The search for confirmation and contradiction only supports the interpre-
tation that has already been done. During interviews, answers given are
similar to those offered by prior interviewees. During periods of observa-
tion in the field, observers find themselves taking fewer notes because they
are seeing nothing new. It is hard to predict how much time a study will
take before this point of data saturation is reached. Often the constraints
of the resources available and the investigator's other roles limit the project
and bring it to an end sooner than the end might come through a natural
sense of saturation. However, if saturation is reached first, the fieldwork can
stop at that point.
Audit Trail
The audit trail is a record of the study, one sufficiently detailed to allow
someone else to follow the study's history and determine if the investiga-
tion and the resulting data provided an adequate basis for the argument