Information Technology Reference
In-Depth Information
97.50%
97%
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Two independent tasks
Using Quality Control Method in PDCCP
Fig. 10.
Accuracy Comparison
The above data in Fig.10 shows that the accuracy of crowdsourcing task using quality
control method is 97.5% while the two crowdsourcing tasks got 97% accuracy.
Thus, the quality control method does not have direct influences on the task quality
and might due to following reasons: (1) With static distribution strategy, we didn't make
use of the feedback of quality control method. (2) In this experiment, task attendants are
all college students that have some knowledge of cloud computing, thus the average
quality is too high to show whether quality control method affects the task quality or not.
6.3
Efficiency Influence of Task Distribution Strategy in PDCCP
As we mentioned in previous section, we tried static strategy and competency strategy
for this experiment. The static strategy give fixed number of words to task attendants
each time and only updated the new words after the former words are all done. The
competency strategy gives task attendants opportunities to choose the easiest words
from a set of words every time. The earlier they finish the easier words they may
choose from, thus created a competency between task attendants.
As before, we randomly picked 560 words from database twice for the static and
competency strategy experiments. Task attendants are the same for these two
experiments. In these two experiments, we start calculating time after the first
translation submitted, and update the amount of finished subtasks per hour. In the
following figure, the red means translators' work performance using static strategy
and the blue indicates translators' work performance with competency strategy.
In the above Fig. 11, task attendants under competency strategy worked mostly
during the beginning of the task time while task attendants' work performance
distributing evenly under static strategy. Thus demonstrated the efficiency advantage
of competency strategy. To analysis the efficiency more clearly, we use the
calculative work performance in the following figure. The green line shows the task
