Java Reference
In-Depth Information
,
and
then
reflect
.
These tokenizers support the tokenization of "normal" text. In the next section, we will
demonstrate how a tokenizer can be trained to deal with unique text.
