public class WordTokenFactory extends java.lang.Object implements LexedTokenFactory<Word>
| Constructor and Description |
|---|
WordTokenFactory() |
| Modifier and Type | Method and Description |
|---|---|
Word |
makeToken(java.lang.String str,
int begin,
int length)
Constructs a token (of arbitrary type) from a String and its position
in the underlying text.
|
public Word makeToken(java.lang.String str, int begin, int length)
LexedTokenFactorystr.)makeToken in interface LexedTokenFactory<Word>str - The String extracted by the lexer.begin - The offset in the document of the first character
in this string.length - The number of characters the string takes up in
the document.