Stakeholder Groups in Computational Creativity Research and Practice - Computational Creativity Research: Towards Creative Machines - page 28

Table 1.2 Percentile rankings for ANGELINA-5's two games entered into Ludum Dare 28, and
its single entry to Ludum Dare 29 (Jet Force Gemini)
To That Sect Stretch Bouquet Point Jet Force Gemini
Overall 36 29 23
Fun 34 30 26
Audio 73 43 74
Graphics 43 33 36
Mood 77 39 80
Innovation 64 33 59
Theme 32 30 26
Humour 48 59 51
Note that higher percentile rankings indicate higher achievements. There were 780 submissions in
the LD28 track, and 1,004 entries in the LD29 track
origin of the game, or anything to connect the game with a digital author. The ratings
process for Ludum Dare takes place in the 22 days following the contest, and is
conducted as a peer review system, where each entrant is asked to rate and review
games by other entrants. Ratings are given as marks out of five for eight categories:
Audio, Graphics, Mood, Theme, Humour, Fun, Innovation and Overall.
The results for the two entries by ANGELINA-5 can be seen in Table 1.2 . While
we were unable to get specific vote data, we do know that 70 people rated To That
Sect , the non-anonymised submission, while 26 people rated Stretch Bouquet Point . 5
While it is impossible to calculate confidence intervals for these ratings without the
vote data, we can see that they differ by hundreds of positions for some categories
such as Mood and Audio. We can also see a noticeable difference in the comments
left by some of the reviewers underneath both submissions, in terms of their tone
and attitude when dealing with each game. Many commentators indirectly criticise
the anonymised game, with comments such as “You made me feel something there.
Don't make me put it into words though”. Other commentators made more obvious
statements of criticism or praise, such as “This was a rather annoying experience”
or “This game feels dreamy. The audio is intense.” Only one comment included
both praise and criticism. We attribute the indirect or sarcastic comments to an
unwillingness to potentially criticise a person for performing poorly, even though
other reviewers were less tactful. Ludum Dare is often used as a learning experience
for amateur developers, and many children enter using simple game creation tools.
We believe many reviewers felt uncomfortable with direct criticism for this reason.
By contrast, comments on To That Sect were more balanced in nature, often
offering both praise and criticism in equal amounts, e.g., “Angelina seems really good
at creating an atmosphere with both sound and visuals. But the game part of it seems
a bit lacking still”. In the description of the game, we asked people to rate it as they
would any other Ludum Dare entry, hoping to dissuade people from reviewing the
5 This is due in part to ANGELINA-5's small following on the internet, which promoted the non-
anonymised submission more than normal.