Information Technology Reference
In-Depth Information
Table 1.
Ψ
values in the cases
{
+1
,
0
, −
1
}
for
J
and
H
J
+1 +1 +1 0 0 0
−
1
−
1
−
1
H
+1 0
−
1 +1 0
−
1 +1 0
−
1
Ψ
+1
+
2
0 0 0
−
1
−
2
0
0
(a) Function
S
as a time sequence (interpo-
lated with a degree 1 polynomial).
(b) Function
κ
as a sequence (
k
0
=
0
.
8).
Fig. 2.
Two of the most significant SoWelL functions
Using the
Ψ
function now we define the satisfaction function
S
as a sequence
which depends on the last value obtained for
S
and the evaluation of
Ψ
:
2
1+
e
−e
(
Ψ
+
S
t
)
−
S
t
+1
=
1
(1)
Following the OCC model, “satisfaction” is computed taking into account the
temporal proximity
of the emotions “joy” and “hope”. The convergence of this
sequence cannot be expressed in terms of fundamental algebraic functions, but
figure 2(a) shows its behavior.
It is to notice that the sequence at step 500 behaves almost exactly as at
5000, so it can be considered
infinite
at practical means. Some discussion can
be made regarding this sequence: the point (0
,
0) converges to 0, which means
no satisfaction and either no disappointment. This case is peculiar due to the
fact that to evaluate
S
at that point would mean that the agent had no feeling
regarding satisfaction before, and does not experience
joy
(according to the
definition of the
Ψ
function). This is unlikely if the agent has spent some time
in the environment and executed actions in there; it can only happen if the
Ψ
function returns exactly the same opposed value as the “satisfaction” in the step
before (
S
0
)makes
the sequence very sensitive. This can be adjusted via weighting the exponent
e
−e
(
Ψ
+
S
t
−
1
)
with an scalar 0
S
t−
1
=
−Ψ
t
). Also there is the fact that the initial value of
S
(
2intheform
e
−e
(
αΨ
+(2
−α
)
S
t
−
1
)
,sothemass
of the exponent can be more dependent of
Ψ
≤ α ≤
sequence.
Recalling the equation for
Ψ
and table 1 it is observable that this agent is
somewhat pessimistic. It will only give positive feedback when it feels joy and
hope. As the joy tends to distress, it will start giving negative feedback, accord-
ingly to the hope that it has about the future.
or of the past of the
S
