Stakeholder Groups in Computational Creativity Research and Practice - Computational Creativity Research: Towards Creative Machines - page 29

concept of ANGELINA-5 rather than the game itself. Nevertheless, many reviewers
suggest that their scores were influenced by their appraisal of ANGELINA-5 as a
novel system, rather than what it was capable of creating, e.g., “creating a program
to create your game [is] certainly not something you see every day. On that front

alone, this gets a lot of points for innovation”. These results suggest that reviewers
were unable to separate the creator from the artefact, and were incapable of reviewing
the game as if created by a person. For instance, To That Sect rated 282nd of 780 for
Innovation. These ratings are subjective, and it is hard for us to objectively assess
them. However, we do not believe there is anything particularly innovative about
To That Sect . As such, we must attribute this high ranking to reviewers assessing
the game as a product of ANGELINA-5. It seems that reviewers projected (human)
innovation in the ANGELINA project onto the game it produced.
We can compare the results of ANGELINA-5's debut in Ludum Dare with the
results garnered from a second entry to the game jam in April 2014, Ludum Dare 29.
This time ANGELINA-5 was only entered into the game jam once, with the game
Jet Force Gemini , created in response to the theme “Beneath The Surface”. As with
the non-anonymised entry in Ludum Dare 28, Jet Force Gemini was entered with
a commentary describing some of the decisions contributing to the design process.
Table 1.2 's rightmost column shows the results for Jet Force Gemini in contrast to
the entries in Ludum Dare 28. The number of entries in Ludum Dare 29 was nearly
30% larger than Ludum Dare 28; ANGELINA's percentile scores drop for four of
seven specialised categories, and fall dramatically in the Overall rating.
We believe this is evidence of the relationship between the observers and
ANGELINA shifting over time. While some of the comments underneath Jet Force
Gemini indicate that the reviewer is encountering ANGELINA-5 for the first time
(which is unsurprising, since the number of reviewers account for less than 1%of total
Ludum Dare entrants) others explicitly note that they are reviewing ANGELINA-5's
games for a second time. One states that 'I'm sorry to say that I can't really see
improvements from last time', indicating that there is either an expectation of growth
on the part of the software, or an expectation that the software's author will grow the
software over time. Despite many of the other comments being generally positive, the
drop in ratings suggests that people perhaps feel less compelled to rate ANGELINA-
5 highly for novelty value alone. Given that Ludum Dare is a community built on the
idea of improving creative skills through regular practice, it is interesting to note the
expectation of growth shown by some reviewers. We hypothesise that this may be a
factor which is particularly important for creative individuals in assessing creativity,
as opposed to other types of observer.
We can also examine reactions to particular elements of ANGELINA-5's work
and compare it to critiques of similar games. One comment on To That Sect states “If
it [had] added shooting at the statues that you must avoid and a goal how much ships
you have to collect, it would have been better. It felt like playing [an] 'art-message'
type of game”. LITH 6 is a game entered into the competition by a human designer,
where the player navigates a maze and collects bags of gold coins, while avoiding

...

6 LITH game: www.tinyurl.com/lith-ludum .