Uses of Class
org.apache.lucene.analysis.TokenStream

Packages that use TokenStream
org.apache.lucene.analysis API and code to convert text into indexable tokens. 
org.apache.lucene.analysis.de Support for indexing and searching of German text. 
org.apache.lucene.analysis.ru Support for indexing and searching Russian text. 
org.apache.lucene.analysis.standard A grammar-based tokenizer constructed with JavaCC. 
 

Uses of TokenStream in org.apache.lucene.analysis
 

Subclasses of TokenStream in org.apache.lucene.analysis
 class CharTokenizer
          An abstract base class for simple, character-oriented tokenizers.
 class LetterTokenizer
          A LetterTokenizer is a tokenizer that divides text at non-letters.
 class LowerCaseFilter
          Normalizes token text to lower case.
 class LowerCaseTokenizer
          LowerCaseTokenizer performs the function of LetterTokenizer and LowerCaseFilter together.
 class PorterStemFilter
          Transforms the token stream as per the Porter stemming algorithm.
 class StopFilter
          Removes stop words from a token stream.
 class TokenFilter
          A TokenFilter is a TokenStream whose input is another token stream.
 class Tokenizer
          A Tokenizer is a TokenStream whose input is a Reader.
 class WhitespaceTokenizer
          A WhitespaceTokenizer is a tokenizer that divides text at whitespace.
 

Fields in org.apache.lucene.analysis declared as TokenStream
protected  TokenStream TokenFilter.input
          The source of tokens for this filter.
 

Methods in org.apache.lucene.analysis that return TokenStream
 TokenStream WhitespaceAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
           
 TokenStream StopAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Filters LowerCaseTokenizer with StopFilter.
 TokenStream SimpleAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
           
 TokenStream PerFieldAnalyzerWrapper.tokenStream(java.lang.String fieldName, java.io.Reader reader)
           
 TokenStream Analyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Creates a TokenStream which tokenizes all the text in the provided Reader.
 TokenStream Analyzer.tokenStream(java.io.Reader reader)
          Deprecated. use tokenStream(String, Reader) instead.
 

Constructors in org.apache.lucene.analysis with parameters of type TokenStream
TokenFilter(TokenStream input)
          Construct a token stream filtering the given input.
StopFilter(TokenStream in, java.lang.String[] stopWords)
          Constructs a filter which removes words from the input TokenStream that are named in the array of words.
StopFilter(TokenStream in, java.util.Hashtable stopTable)
          Deprecated. Use StopFilter.StopFilter(TokenStream, Set) instead
StopFilter(TokenStream in, java.util.Set stopWords)
          Constructs a filter which removes words from the input TokenStream that are named in the Set.
PorterStemFilter(TokenStream in)
           
LowerCaseFilter(TokenStream in)
           
 

Uses of TokenStream in org.apache.lucene.analysis.de
 

Subclasses of TokenStream in org.apache.lucene.analysis.de
 class GermanStemFilter
          A filter that stems German words.
 

Methods in org.apache.lucene.analysis.de that return TokenStream
 TokenStream GermanAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Creates a TokenStream which tokenizes all the text in the provided Reader.
 

Constructors in org.apache.lucene.analysis.de with parameters of type TokenStream
GermanStemFilter(TokenStream in)
           
GermanStemFilter(TokenStream in, java.util.Hashtable exclusiontable)
          Deprecated. Use GermanStemFilter.GermanStemFilter(org.apache.lucene.analysis.TokenStream, java.util.Set) instead.
GermanStemFilter(TokenStream in, java.util.Set exclusionSet)
          Builds a GermanStemFilter that uses an exclusiontable.
 

Uses of TokenStream in org.apache.lucene.analysis.ru
 

Subclasses of TokenStream in org.apache.lucene.analysis.ru
 class RussianLetterTokenizer
          A RussianLetterTokenizer is a tokenizer that extends LetterTokenizer by additionally looking up letters in a given "russian charset".
 class RussianLowerCaseFilter
          Normalizes token text to lower case, analyzing given ("russian") charset.
 class RussianStemFilter
          A filter that stems Russian words.
 

Methods in org.apache.lucene.analysis.ru that return TokenStream
 TokenStream RussianAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Creates a TokenStream which tokenizes all the text in the provided Reader.
 

Constructors in org.apache.lucene.analysis.ru with parameters of type TokenStream
RussianStemFilter(TokenStream in, char[] charset)
           
RussianLowerCaseFilter(TokenStream in, char[] charset)
           
 

Uses of TokenStream in org.apache.lucene.analysis.standard
 

Subclasses of TokenStream in org.apache.lucene.analysis.standard
 class StandardFilter
          Normalizes tokens extracted with StandardTokenizer.
 class StandardTokenizer
          A grammar-based tokenizer constructed with JavaCC.
 

Methods in org.apache.lucene.analysis.standard that return TokenStream
 TokenStream StandardAnalyzer.tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Constructs a StandardTokenizer filtered by a StandardFilter, a LowerCaseFilter and a StopFilter.
 

Constructors in org.apache.lucene.analysis.standard with parameters of type TokenStream
StandardFilter(TokenStream in)
          Construct filtering in.
 



Copyright © 2000-2005 Apache Software Foundation. All Rights Reserved.