org.apache.lucene.analysis.cn

Home » lucene-3.0.1-src » org.apache » lucene » analysis » cn »

org.apache.lucene.analysis.cn

Sub Packages:

org.apache.lucene.analysis.cn.smart	Analyzer for Simplified Chinese, which indexes words.
org.apache.lucene.analysis.cn.smart.hhmm	SmartChineseAnalyzer Hidden Markov Model package.

Classes:

ChineseAnalyzer	An Analyzer that tokenizes text with ChineseTokenizer and filters with ChineseFilter	code \| html
ChineseAnalyzer.SavedStreams		code \| html
ChineseFilter	A TokenFilter with a stop word table.	code \| html
ChineseTokenizer	Tokenize Chinese text as individual chinese characters.	code \| html

Three analyzers are provided for Chinese, each of which treats Chinese text in a different way.

ChineseAnalyzer (in this package): Index unigrams (individual Chinese characters) as a token.
CJKAnalyzer (in the analyzers/cjk package): Index bigrams (overlapping groups of two adjacent Chinese characters) as tokens.
SmartChineseAnalyzer (in the analyzers/smartcn package): Index words (attempt to segment Chinese text into words) as tokens.

ChineseAnalyzer: ?????????
CJKAnalyzer: ???????????
SmartChineseAnalyzer: ????????