Examples of PrefixAndSuffixAwareTokenFilter

org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter
Links two {@link PrefixAwareTokenFilter}.
NOTE: This filter might not behave correctly if used with custom Attributes, i.e. Attributes other than the ones located in org.apache.lucene.analysis.tokenattributes.

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new CachingTokenFilter(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new CachingTokenFilter(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new TokenListStream(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new CachingTokenFilter(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new CachingTokenFilter(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PrefixAndSuffixAwareTokenFilter

    tokens.add(tokenFactory("earth", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));
    tokens.add(tokenFactory("tellus", 0, 1f, 5, 10, ShingleMatrixFilter.TokenPositioner.newRow));


    tls = new TokenListStream(tokens);


    ts = new PrefixAndSuffixAwareTokenFilter(new SingleTokenTokenStream(tokenFactory("^", 1, 100f, 0, 0)), tls, new SingleTokenTokenStream(tokenFactory("$", 1, 50f, 0, 0)));
    tls = new CachingTokenFilter(ts);


    // bi-grams, position incrememnt, weight, start offset, end offset


    ts = new ShingleMatrixFilter(tls, 2, 2, new Character('_'), false);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.