GENERALIZATION OF LINEAR REGRESSION PROBLEMS - Neural-based Orthogonal Data Fitting: The EXIN Neural Networks - page 182

2

domain of
convergence

1.5

1

0.5

0

− 0.5

− 1

− 1.5

− 2

2 1.5 1 0.5 0

w1

0.5 1 1.5 2

− − − −

Figure 5.16 Evolution map of a sequential TLS EXIN for the first nongeneric TLS benchmark
problem. The initial conditions for the converging trajectories are in red; the others are in
black. The straight line passing through the red points contains the saddle/solution locus.
The thick dark blue line is the divergence line. ( See insert for color representation of the
figure .)

Figure 5.17 Plot of the weights of TLS EXIN and TLS GAO for the first nongeneric TLS
benchmark problem. The initial conditions are null. The two learning laws stop at different
iterations. ( See insert for color representation of the figure .)