Examples of DelimitedPayloadTokenFilter

org.apache.lucene.analysis.payloads.DelimitedPayloadTokenFilter
Characters before the delimiter are the "token", those after are the payload.
For example, if the delimiter is '|', then for the string "foo|bar", foo is the token and "bar" is a payload.
Note, you can also include a {@link org.apache.lucene.analysis.payloads.PayloadEncoder} to convert the payload in an appropriate way (from characters to bytes).
Note make sure your Tokenizer doesn't split on the delimiter, or this won't work @see PayloadEncoder

Examples of org.apache.lucene.analysis.payloads.DelimitedPayloadTokenFilter

  }
  
  public final TokenStream tokenStream(String fieldName, Reader reader) {
    // If this is the topics field, then need to use the notation of "p1$0.45"
    if (fieldName.matches("topicspayload.*")){
      return new DelimitedPayloadTokenFilter(
              new WhitespaceTokenizer(Version.LUCENE_35, reader),
              '$', new FloatEncoder());
    }
    // else, this is a "code" field
    return STANDARD.tokenStream(fieldName, reader);

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.