Information Technology Reference
In-Depth Information
3
Results
Figure 1 shows how the we
percentage of the N-best ar
and when npub = 40 out o
increasing the weight giv
proportion of best articles p
in each of the eight lines a
declines in percentage of b
the weight given track re
publications per journal iss
best articles published only
This can be seen by compar
Figure 1 also reveals
weight up to about 0.4 slig
when the correlation betwe
between true and judged ar
green lines. Second, the pa
and green lines, cross whe
indicates that track record h
correlations is varied than w
found no immediate explan
further exploration. Howev
moderate, increasing the w
articles published.
eight given to track record (X-axis) influences the aver
rticles published when npub = 20 out of 100 (dashed lin
of 100 (solid lines). The figure reveals three trends. Fi
ven to track record results in a general decline of
published. This can be seen in consistent drop of about 2
as track record weight increases from 0.0 to 0.9. Seco
best articles published reach a minimum asymptote w
cord reaches about 0.7. Third, doubling the number
sue from 20 to 40 increases the proportion of the 20 (
y 10 to 20%, more as the weight for track record increa
ring a solid line with the dashed line of the same colour.
two unexpected findings. First, increasing track-rec
ghtly increases in the percentage of best articles publis
een talent and article quality is higher than the correlat
rticle quality; this is revealed by the slight hump in the t
air of solid red and green lines, and the pair of dashed
en the weight given track record reaches about 0.5. T
has a somewhat different effect when the talent/true-qua
when true-quality/judged-quality correlation is varied.
nation for these results; their effects are small but worthy
ver, the general trend remains: When the correlations
weight given track record decreases the proportion of b
rage
nes)
irst,
the
20%
ond,
when
r of
(40)
ses.
.
cord
hed
tion
two
red
This
ality
We
y of
are
best
90%
80%
20,.75,.75
20,.75,.50
70%
60%
20,.50,.75
20,.50,.50
40,.75,.75
40,.75,.50
40,.50,.75
40,.50,.50
50%
40%
30%
20%
10%
0%
0 .1 .2 .
30.40.50.60.70.80.9
legend: npub,rttq,rtjq (num
manuscript quality, correlat
ber of articles published, correlation between talent and tru
tion between true and judged manuscript quality)
ue
Fig. 1.
Average percentage of
track record (0.0 - 0.9)
the npub = 20 (40) best articles published for different weight
ts of
