Package com.cburch.editor.tokens

Contains Tokenizer and related classes for tracking the sequence of tokens in a document.

See:
Description

Interface Summary

TokenizerListener<T extends BasicToken>

The interface that classes can implement in order to listen to modifications made to the list of tokens maintained by a tokenizer.

Class Summary

BasicToken	Represents a token in the stream, holding minimal information necessary for the tokenizer to work.
MutableTokenList<T extends BasicToken>	Maintains a list of tokens, just as with TokenList, except that modifications are allowed here.
Tokenizer<T extends BasicToken>	The class that implements the basic functionality behind tracking the tokens within a document and notifying other classes about the changes.
TokenizerEvent<T extends BasicToken>	Describes information about a modification to the list of tokens maintained by the tokenizer.
TokenList<T extends BasicToken>	Maintains the list of tokens.

Package com.cburch.editor.tokens Description

Contains Tokenizer and related classes for tracking the sequence of tokens in a document. Maintaining a token sequence is essential to many features in programmers' editors.

These classes are generally intended for the support of features associated with an editor; they are not necessary to understand for the sake of using the features.

Version:

0.1.1 2005-07-05

Author:

Carl Burch