State-of-the-Art: Design of the Semantics Acquisition Games - Semantic Acquisition Games: Harnessing Manpower for Creating Semantics - page 110

Social
experience Self-challenge Competition Discovery

Restrictive rules 9 4 2 1 10 5 2 1

Mutual supervision 1 1 1 1 1 1

Anomaly detection 7 2 2 1 7 2 2 1

A posteriori
N/A 4 4 5 5

Restrictive rules 1 1

Mutual supervision
Anomaly detection

1 1 1

A posteriori
N/A 1

Restrictive rules 2 1 2 1 1

Mutual supervision
Anomaly detection 1 1 1 1

A posteriori
N/A
Restrictive rules
Mutual supervision
Anomaly detection 2 2

A posteriori
N/A
Restrictive rules

1 1 1 1 1 1

Mutual supervision
Anomaly detection
A posteriori 1 1 1 1 1 1

N /A

Fig. 7.3 Coverage of SAG “design space” by individual SAGs. The more populous combinations
are colored darker

One more interesting distribution of patterns we found the purpose encapsulation.
Some games, especially those that require typing or working with texts disclose
their purpose more obviously (having low purpose encapsulation). For multimedia
description SAGs, the music description games perform relatively better. Best results
in encapsulating however, are characteristic for games with unique game mechanics
or games where designers spent much more time polishing the game aesthetics.
What does the SAG experience mean to the general crowdsourcing? Could some
of SAG ideas be useful for other types of crowdsourcing approaches? Some of the
SAG issues (design dimensions) are common for crowdsourcing field (more or less,
SAGs inherit these issues from crowdsourcing). These include:

￿ Malicious behavior detection . Just as for SAGs, it is equally important for “con-

ventional” crowdsourcing approaches likeMechanical Turkwheremicro-payments