Information Technology Reference
In-Depth Information
SG Verb Encodings
Y
SG Noun Encodings
Y
ate
7.50
kitchen
7.00
26.00
spoon
consumed
6.50
ice_cream
24.00
someone
6.00
schoolgirl
22.00
adult
gave
5.50
busdriver
20.00
place
5.00
finger
18.00
kissed
utensil
4.50
crackers
16.00
soup
4.00
food
hit
14.00
spot
3.50
dog
12.00
steak
3.00
knife
drank
2.50
10.00
jelly
park
2.00
8.00
iced_tea
bus
spread
1.50
6.00
child
something
1.00
4.00
pitcher
stirred
living_room
0.50
2.00
kool_aid
X
teacher
0.00
10.00
20.00
0.00
X
0.00
10.00
20.00
30.00
40.00
Figure 10.29:
Cluster plot of the encoding layer representa-
tions of the unambiguous verbs.
Figure 10.30:
Cluster plot of the encoding layer representa-
tions of the unambiguous nouns.
cluster plot of the similarity structure for these verbs
(which should look like figure 10.29). There is actually
not much of interest here, except for the similarity of
ate
and
consumed
, which are the only two verbs that have a
close (synonymous) relationship.
After another short delay, the cluster plot for the un-
ambiguous nouns will show up (figure 10.30). Here,
there is much greater potential for useful similarity re-
lationships because of the similar roles of some of the
nouns, and it is clear that the network has encoded
words that appear together in the training sentences as
more similar.
Of course, the most important layer in the network is
the
Gestalt
layer. To probe the nature of the gestalt
representations, we present the sentences shown in ta-
ble 10.16, and record the final gestalt layer activation
pattern after the last word is presented. These sentences
systematically vary the agents, patients, and verbs to re-
veal how these are represented.
Code
Sentence
bu at so
The busdriver ate soup.
te at so
The teacher ate soup.
pi at so
The pitcher ate soup.
sc at so
The schoolgirl ate soup.
bu at st
The busdriver ate steak.
te at st
The teacher ate steak.
pi at st
The pitcher ate steak.
sc at st
The schoolgirl ate steak.
bu dr ic
The busdriver drank iced tea.
te dr ic
The teacher drank iced tea.
pi dr ic
The pitcher drank iced tea.
sc dr ic
The schoolgirl drank iced tea.
bu st ko
The busdriver stirred Kool-Aid.
te st ko
The teacher stirred Kool-Aid.
pi st ko
The pitcher stirred Kool-Aid.
sc st ko
The schoolgirl stirred Kool-Aid.
Table 10.16:
Probe sentences used to assess the nature of the
gestalt representation. The code is used in the corresponding
cluster plot (figure 10.31).
Press
SentClust
on the overall control panel.
After all the sentences have been processed, a clus-
ter plot will appear (figure 10.31).
This plot clearly
Search WWH ::
Custom Search