GENERALIZATION OF LINEAR REGRESSION PROBLEMS - Neural-based Orthogonal Data Fitting: The EXIN Neural Networks - page 202

TLS : SCG(solid), BFGS(dashed)

1.8

1.6

1.4

1.2

1

x1 x1

0.8

0.6

0.4

x2 x2

0.2

0

− 0.2

0 2 4 6 8 10 12 14 16

epochs

Figure 5.31 Plot of the weights of SCG and BFGS EXIN for the TLS benchmark problem.
( See insert for color representation of the figure .)

DLS : SCG(solid), BFGS(dashed)

1.2

x1 x1

1

0.8

0.6

0.4

x2

x2

0.2

0

0 5 10 15

epochs

20 25 30 35

Figure 5.32 Plot of the weights of SCG and BFGS EXIN for the DLS benchmark problem.
( See insert for color representation of the figure .)