org.exist.storage.analysis
Interface Tokenizer

All Known Implementing Classes:

SimpleTokenizer

public interface Tokenizer

Method Summary

TextToken	nextToken()
TextToken	nextToken(boolean allowWildcards)
void	setStemming(boolean stem)
void	setText(CharSequence text)
void	setText(CharSequence text, int offset)

Method Detail

setText

void setText(CharSequence text)

setText

void setText(CharSequence text,
             int offset)

nextToken

TextToken nextToken()

nextToken

TextToken nextToken(boolean allowWildcards)

setStemming

void setStemming(boolean stem)