Information Technology Reference
In-Depth Information
4.2 The Evaluation Method
4.2.1 The Evaluation Framework PERSIVA
The used evaluation framework PERSIVA (Chrysafiadi and Virvou 2013a) assesses:
•
Students' satisfaction
about the e-learning program. More concretely, infor-
mation about the feelings, thoughts and satisfaction of the learners' about
the adaptivity and effectiveness of the e-learning education environment was
gathered.
•
Students' performance
on the knowledge domain.
• The changes that were caused on the
individual state
of the students.
• The
results
of the e-learning program to students' progress.
• The
validity of the conclusions
drawn by the student model concerning the
aspects of the students' characteristics.
• The
validity of the adaptation
decision making of the student model.
4.2.2 The Evaluation Criteria
The evaluation of an adaptive educational system is a complex process. It includes
evaluation of two different educational aspects. The first aspect concerns the effec-
tiveness of the educational program, and the other aspect concerns the effectiveness
of the student model. Therefore, the presented evaluation includes the following
two levels:
•
Level 1: Evaluation of the educational impact
. This level includes assess-
ment of the learners' performance and satisfaction; evaluation of the effect of
the e-learning program on the behavior and thoughts of students about computer
programming and distance learning; evaluation of the effects of the particular
e-learning program to students' progress on their further studies and assessment
of how it helped the students to learn other programming languages.
•
Level 2: Evaluation of adaptation
. This level is responsible to give answers in
the following questions:
- How satisfied are the learners about the system's adaptive responses to their
needs?
- How important and essential is to model the particular student's characteris-
tics (prior knowledge, knowledge level, type of errors etc.)?
- How valid are the conclusions drawn by the student model concerning the
aspects of the students' characteristics (i.e. their background)?
- The decisions for adaptivity are valid and effective?
Search WWH ::
Custom Search