Game Development Reference
In-Depth Information
Chapter 5
PexAce: A Method for Image Metadata
Acquisition
Abstract
In this chapter, we present a semantics acquisition game for image tag
acquisition, called PexAce. In this game, the player's task is to (consecutively, in
turns) disclose and conceal card pairs laid down on the game board, remember
images on them and correctly identify identical image pairs. The game acquires the
image descriptions through a game mechanics, which allows the players to make
textual notes on what they see on the images. Acquired annotations are processed
to tags by basic NLP and collaborative filtering. Experiments validating the game's
output with a general domain image dataset are presented. Furthermore, we present
amodification of the game targeted on the acquisition of specificmetadata for specific
images: personal photography, which is otherwise a very complicated task for either
automated or crowd-based approaches.
To address the need for multimedia metadata, we devised
PexAce
1
—a semantics
acquisition game for image tag acquisition [
2
]. It is based on the popular memory
game
Concentration
(or
Pexeso
), where the player's goal is to find pairs of cards
(images) by continuously inverting cards on a game board. In PexAce, the players
are allowed to “take notes” on the featured images to support their memory and thus
provide raw-text image annotations, which, after game, are automatically processed
to tags through various text processing methods. Our approach serves as a means for:
multimediametadata authoring via collecting and evaluating player assigned anno-
tations into metadata,
dynamic interactive presentation of multimedia content (typically photo albums,
but it can also be extended to videos and audio),
entertainment by engaging players by mental challenges and friendly competition.
We originally devised the approach for general domain images and metadata. As
we experimented with it, we explored its potential for using it also for personal
imagery, where specific metadata are needed (while there is much less approaches
1
The authors wish to thank the bachelor student, Balázs Nagy, for creation of the initial concept of
the game part of the method and participation on the implementation.
Search WWH ::
Custom Search