Package edu.udo.cs.wvtool.generic.tokenizer

Examples of edu.udo.cs.wvtool.generic.tokenizer.SimpleTokenizer

104
105
106
107
108
109
110
111
112
113
114
        setConfigurationRule(STEP_LOADER, new WVTConfigurationFact(new UniversalLoader()));
        // setConfigurationRule(
        // STEP_INPUT_FILTER,
        // new WVTConfigurationFact(new TextInputFilter()));
        setConfigurationRule(STEP_CHAR_MAPPER, new WVTConfigurationFact(new DummyCharConverter()));
        setConfigurationRule(STEP_TOKENIZER, new WVTConfigurationFact(new SimpleTokenizer()));
        setConfigurationRule(STEP_WORDFILTER, new WVTConfigurationFact(new StopWordsWrapper()));
        setConfigurationRule(STEP_STEMMER, new WVTConfigurationFact(new LovinsStemmerWrapper()));
        setConfigurationRule(STEP_VECTOR_CREATION, new WVTConfigurationFact(new TFIDF()));
        setConfigurationRule(STEP_OUTPUT, new WVTConfigurationFact(null));
View Full Code Here
TOP

Related Classes of edu.udo.cs.wvtool.generic.tokenizer.SimpleTokenizer

  • edu.udo.cs.wvtool.config.WVTConfiguration
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.