The Manual Revision of the TERENCE Italian Smart Games - 2nd International Workshop on Evidence-Based Technology Enhanced Learning - page 32

3Conluion
Most of the revisions were of a formal nature, e.g. correct the letters for the names,
verbs tenses. The main effort was in connection with reviewing the text: the phrases
generated were incomplete or inconsistent, so it was necessary to continue to work
on accents, the verb tenses and sentence length. A quantitative revision analysis
showed a good level of automatic generation: in only 15 cases it was necessary to
change the fixed automatically generated event. Mostly wrong type solutions were
changed, with 54 change made necessary primarily to ensure a consistent level of
difficulty in finding this solution.
Therefore, important and crucial improvements shall be directed towards the an-
notations of causal links (absent in this release), the text generation task, and the
heuristic that takes care of the distractors (i.e., the wrong choices, and especially
when the annotations are poor).
Acknowledgements. This work was supported by the TERENCE project, funded by the EC
through FP7 for RTD, ICT-2009.4.2.
Special Thanks to the Team: A. Carbonelli, M.R. Cecilia, G. Cofini, G. D'Ascanio, M.
Palmerio, J. Ranieri, M. Santucci, G. Sementilli, F. Zazzara.
References
1. Cofini, V., Di Giacomo, D., Di Mascio, T., Vittorini, P.: Evaluation Plan of TERENCE:
when the User-centred Design Meets the Evidence-based Approach. In: Proc. of the
ebTEL 2012 Workshop co-located with PAAMS 2012. Springer (2012)
2. Cofini, V., de la Prieta, F., Di Mascio, T., Gennari, R., Vittorini, P.: Design Smart Games
with requirements, generate them with a Click, and revise them with a GUIs. Advances
in Distributed Computing and Artificial Intelligence Journal 1(3), 59-68 (2012)
3. Cofini, V., Di Mascio, T., Gennari, R., Vittorini, P.: The TERENCE smart games revision
guidelines and software tool. In: Vittorini, P., Gennari, R., Marenzi, I., Di Mascio, T., De
la Prieta, F. (eds.) 2nd International Workshop on Evidenced-Based TEL. AISC, vol. 218,
pp. 17-24. Springer, Heidelberg (2013)
4. De La Prieta Pintado, F., Di Mascio, T., Gennari, R., Marenzi, I., Vittorini, P.: Playing for
Improving the Reading Comprehension Skills of Primary School Poor Comprehenders.
In: 1st International Workshop on Pedagogically-driven Serious Games (September 1,
2012)
5. De La Prieta Pintado, F., Di Mascio, T., Gennari, R., Marenzi, I., Vittorini, P.: The TER-
ENCE Smart Games: Automatic Generation and Supporting Architecture. In: 1st Inter-
national Workshop on Pedagogically-driven Serious Games (September 1, 2012)
6. Gennari, R.: Deliverable 4.1: M.State of the Art and Design of Novel Intelligent Feed-
back Deliverable 4.1. Tech. rep., TERENCE project (2011)
7. Gennari, R.: Deliverable 4.2: Automated Reasoning Module. Tech. Rep. D4.2, TER-
ENCE project (2012)
8. Hedberg, S.R.: Executive Insight: Smart Games: Beyond the Deep Blue Horizon. IEEE
Expert 12(4), 15-18 (1997)
9. Moens, S.: Deliverable 3.1: State of the Art and Design of Novel Annotation Languages
and Technologies. Tech. Rep. D3.1, TERENCE project (2012)
10. TERENCE Consortium: TERENCE web site, http://www.terenceproject.eu