Decision Forests - Data Mining with Decision Trees: Theory and Applications - page 123

Unlabeled
Tuples

Predicted
Labels Classifiers Composer

Classifier 1 Classifier 2 Classifier T

Inducer 1 Inducer 2

...

Inducer T

Dataset 1 Dataset 2 Dataset T

Dataset
Manipulator

Dataset
Manipulator

Dataset
Manipulator

Training Set

Fig. 9.10 Independent methods.

Fig. 9.11 The bagging algorithm.

replacement from the training set. Usually each sample size is equal to the
size of the original training set.
Note that since sampling with replacement is used, some of the original
instances of S may appear more than once in S t and some may not be
included at all. To classify a new instance, each classifier returns the class