Framework for Evaluation of Programming Language Examinations - Computational Intelligence Techniques for Comparative Genomics - page 116

or gray box testing. SQLify (2007) [ 9 ] is to assist students learn SQL. It facilitated
writing test queries against databases; receive immediate feedback which is more
informative than what can be offered by DBMS. In 2010, Zhang and Ke [ 10 ] also
proposed a design for SQL Paperless Examination System.
In 2008, Farrow and King [ 11 ] used an online programming examination to
assess undergraduates who had learned Java for two terms. It uses BLUEJ and
JUnit software. In 2010, Skupas [ 12 ] wrote a paper on feedback improvement in
automatic program evaluation systems. He says that some programming errors
should not in

nal score heavily. Black box testing alone cannot ensure
this. A typical approach is to use semi-automatic systems for programming test
evaluation. It proposes two grading steps. The

fl uence the

rst step is responsible for student
program output format checking. The second step relates to output correctness. In
2011, Fern

n[ 13 ] proposed an automated assessment tool for pro-
gramming courses. It extends the functionality of Mooshak by adding an external
static marker.
In paper by Zhenming et al. [ 14 ] and later extended by Zhang et al. [ 15 ], tool
was developed to measure operating skills of the students and their pro

á ndez-Alem á

ciency in
using software like MS Word, MS Excel, MS Power Point, and Internet familiarity.
An overview of features required by practical evaluation tools is given in [ 16 ]. For
Evaluation of GUI-based student programs English [ 17 ] proposed a tool called
JEWL for Java GUI programs.
The available practical evaluation tools are used for different purposes. Some
tools are used for assignment evaluation and classroom teaching. Some are used for
conducting online programming contests and evaluating contestants

programs.
Programming languages evaluated by these tools are C, C++, FORTRAN, SQL,
Pascal, and Java (all tools do not evaluate all languages). The technique used in all
the tools for evaluation is black box testing. A more holistic approach is required
for evaluating the student programs. Apart from black box testing, the program
quality and semantic similarity of program with the algorithm needs to be
established.

'

3 Practical Evaluation Framework

The students submit their programs to the server where they are stored in a data-
base. Then, each program is read from the database and it passes through the
following four stages.

(a) Compilation stage: In the rst stage, the syntax of the program needs to be

checked. The students who pass in this stage will go to next stage. The syntax
is already checked by the programming language compilers. However, there is
a problem in the output. If the programmer makes a small mistake like missing
semicolon, missing bracket, or something similar, then the compiler shows