public class LexerTokenizer extends AbstractTokenizer<java.lang.String>
Tokenizer designed to work with
Lexer implementing classes. Throw in a Lexer on
construction and you get a Tokenizer.nextToken| Constructor and Description |
|---|
LexerTokenizer(Lexer l) |
LexerTokenizer(Lexer l,
java.io.Reader r) |
| Modifier and Type | Method and Description |
|---|---|
protected java.lang.String |
getNext()
Internally fetches the next token.
|
static void |
main(java.lang.String[] args)
for testing only
|
hasNext, next, peek, remove, tokenizepublic LexerTokenizer(Lexer l)
public LexerTokenizer(Lexer l, java.io.Reader r)
protected java.lang.String getNext()
getNext in class AbstractTokenizer<java.lang.String>public static void main(java.lang.String[] args)
throws java.io.IOException
java.io.IOException