WikipediaTokenizer | Extension of StandardTokenizer that is aware of Wikipedia syntax. | code | html |
WikipediaTokenizerImpl | This class is a scanner generated by JFlex 1.4.1 on 4/15/08 4:31 AM from the specification file /mnt2/mike/src/lucene.clean/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizerImpl.jflex | code | html |