Examples of ThaiTokenizer

org.apache.lucene.analysis.th.ThaiTokenizer
Tokenizer that use {@link BreakIterator} to tokenize Thai text.
WARNING: this tokenizer may not be supported by all JREs. It is known to work with Sun/Oracle and Harmony JREs. If your application needs to be fully portable, consider using ICUTokenizer instead, which uses an ICU Thai BreakIterator that will always be available.

Examples of org.apache.lucene.analysis.th.ThaiTokenizer

        super(index, indexSettings, name, settings);
    }


    @Override
    public Tokenizer create() {
        return new ThaiTokenizer();
    }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.