Field Detail

• STOP_WORDS

  public static final java.lang.String[] STOP_WORDS

  An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

Constructor Detail

• CJKAnalyzer

  public CJKAnalyzer()

  Deprecated. Use CJKAnalyzer(Version) instead
  Builds an analyzer which removes words in STOP_WORDS.

• CJKAnalyzer

  public CJKAnalyzer(org.apache.lucene.util.Version matchVersion)

  Builds an analyzer which removes words in STOP_WORDS.

• CJKAnalyzer

  public CJKAnalyzer(java.lang.String[] stopWords)

  Deprecated. Use CJKAnalyzer(Version, String[]) instead
  Builds an analyzer which removes words in the provided array.

  Parameters:

  stopWords - stop word array

• CJKAnalyzer

  public CJKAnalyzer(org.apache.lucene.util.Version matchVersion,
                     java.lang.String[] stopWords)

  Builds an analyzer which removes words in the provided array.

  Parameters:

  stopWords - stop word array

Method Detail

• tokenStream

  public final org.apache.lucene.analysis.TokenStream tokenStream(java.lang.String fieldName,
                                                                  java.io.Reader reader)

  Creates a TokenStream which tokenizes all the text in the provided Reader.

  Specified by:

  tokenStream in class org.apache.lucene.analysis.Analyzer

  Parameters:

  fieldName - lucene field name

  reader - input Reader

  Returns:

  A TokenStream built from CJKTokenizer, filtered with StopFilter

• reusableTokenStream

  public final org.apache.lucene.analysis.TokenStream reusableTokenStream(java.lang.String fieldName,
                                                                          java.io.Reader reader)
                                                                   throws java.io.IOException

  Returns a (possibly reused) TokenStream which tokenizes all the text in the provided Reader.

  Overrides:

  reusableTokenStream in class org.apache.lucene.analysis.Analyzer

  Parameters:

  fieldName - lucene field name

  reader - Input Reader

  Returns:

  A TokenStream built from CJKTokenizer, filtered with StopFilter

  Throws:

  java.io.IOException