The Semantics of Search - Social Semantics: The Search for Meaning on the Web - page 157

Tabl e 6. 2 Results of hypertext and semantic web search relevance
judgments: raw numbers followed by percentages. The top two row
percentages are with respect to all queries, while the latter two
columns are with respect to the total of resolved queries
Results

Hypertext Semantic web

Resolved 197 (98%) 132 (66%)

Unresolved 3 (2%) 68 (34%)

Top relevant 121 (61%) 76 (58%)

Top non-relevant 76 (39%) 56 (42%)

Fig. 6.5 Results of querying
the hypertext Web

Non−Top Relevant

Unresolved

Top Relevant

Fig. 6.6 Results of querying
the Semantic Web

Non−Top Relevant

Unresolved

Top Relevant

For the queries, much of the data is summarized in Table 6.2 . Resolved queries
are queries that return at least one relevant result in the top 10 results, while
unresolved queries are queries that return no relevant queries in the top 10 results .
'Hypertext' means that the result was taken only over the hypertext Web results and
'Semantic Web' indicates the same for the Semantic Web results. The percentages
for resolved and unresolved for 'hypertext' and 'Semantic Web' were taken over
all the hypertext and Semantic Web relevancy corpora in order to allow direct
comparison. On the contrary, the percentages for 'Top Relevant' and 'Top Non-
Relevant' were computed as percentages over only resolved queries, and so exclude
unresolved queries. For ease of reference, a pie-chart for the hypertext relevancy is
given in Fig. 6.5 and for the Semantic Web relevancy in Fig. 6.6 .