Examples of StempelFilter

org.apache.lucene.analysis.stempel.StempelFilter
Transforms the token stream as per the stemming algorithm.
Note: the input to the stemming filter must already be in lower case, so you will need to use LowerCaseFilter or LowerCaseTokenizer farther down the Tokenizer chain in order for this to work properly!

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    TokenStream result = new StandardFilter(matchVersion, source);
    result = new LowerCaseFilter(matchVersion, result);
    result = new StopFilter(matchVersion, result, stopwords);
    if(!stemExclusionSet.isEmpty())
      result = new SetKeywordMarkerFilter(result, stemExclusionSet);
    result = new StempelFilter(result, new StempelStemmer(stemTable));
    return new TokenStreamComponents(source, result);
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

public class StempelPolishStemFilterFactory extends BaseTokenFilterFactory implements ResourceLoaderAware {
  private Trie stemmer = null;
  private static final String STEMTABLE = "org/apache/lucene/analysis/pl/stemmer_20000.tbl";
  
  public TokenStream create(TokenStream input) {
    return new StempelFilter(input, new StempelStemmer(stemmer));
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    TokenStream result = new StandardFilter(matchVersion, source);
    result = new LowerCaseFilter(matchVersion, result);
    result = new StopFilter(matchVersion, result, stopwords);
    if(!stemExclusionSet.isEmpty())
      result = new KeywordMarkerFilter(result, stemExclusionSet);
    result = new StempelFilter(result, new StempelStemmer(stemTable));
    return new TokenStreamComponents(source, result);
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

  /** Sole constructor. See {@link AbstractAnalysisFactory} for initialization lifecycle. */
  public StempelPolishStemFilterFactory() {}


  @Override
  public TokenStream create(TokenStream input) {
    return new StempelFilter(input, new StempelStemmer(PolishAnalyzer.getDefaultTable()));
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    }
  }


  @Override
  public TokenStream create(TokenStream input) {
    return new StempelFilter(input, new StempelStemmer(PolishAnalyzer.getDefaultTable()));
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    TokenStream result = new StandardFilter(matchVersion, source);
    result = new LowerCaseFilter(matchVersion, result);
    result = new StopFilter(matchVersion, result, stopwords);
    if(!stemExclusionSet.isEmpty())
      result = new SetKeywordMarkerFilter(result, stemExclusionSet);
    result = new StempelFilter(result, new StempelStemmer(stemTable));
    return new TokenStreamComponents(source, result);
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    TokenStream result = new StandardFilter(matchVersion, source);
    result = new LowerCaseFilter(matchVersion, result);
    result = new StopFilter(matchVersion, result, stopwords);
    if(!stemExclusionSet.isEmpty())
      result = new KeywordMarkerFilter(result, stemExclusionSet);
    result = new StempelFilter(result, new StempelStemmer(stemTable));
    return new TokenStreamComponents(source, result);
  }

View Full Code Here

Examples of org.apache.lucene.analysis.stempel.StempelFilter

    TokenStream result = new StandardFilter(matchVersion, source);
    result = new LowerCaseFilter(matchVersion, result);
    result = new StopFilter(matchVersion, result, stopwords);
    if(!stemExclusionSet.isEmpty())
      result = new KeywordMarkerFilter(result, stemExclusionSet);
    result = new StempelFilter(result, new StempelStemmer(stemTable));
    return new TokenStreamComponents(source, result);
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.