Examples of IntArrayPredicateIterator

org.carrot2.util.IntArrayPredicateIterator
Iterates over ranges between elements for which a given predicate returns true. The returned range may be of zero length ( {@link #getLength()}).
An example probably best explains what this class does. Consider the following array:
```
 [SEP, SEP, 1, SEP]  
```
where SEP is something for which the predicate returns true. If so, then the returned subranges would be equal to (start index, length):
```
 [0,0]  (empty range before the first separator) [1,0]  (empty range after the first separator) [2,1]  ([1]) [4,0]  (empty range after last separator) 
```

Examples of org.carrot2.util.IntArrayPredicateIterator

        /*
         * Recursively iterate through documents, fields and sentences. This can be
         * implemented a bit faster (without iterators), but I guess the overhead here is
         * minimal anyway.
         */
        final IntArrayPredicateIterator docIterator = new IntArrayPredicateIterator(
            context.allTokens.type, 0, context.allTokens.type.length - 1,
            ON_DOCUMENT_SEPARATOR);


        while (docIterator.hasNext())
        {
            final int docStart = docIterator.next();
            final int docLength = docIterator.getLength();


            document(context, docStart, docLength);
        }
    }

View Full Code Here

Examples of org.carrot2.util.IntArrayPredicateIterator

    /**
     * Invoked for each document. Splits further into fields.
     */
    protected void document(PreprocessingContext context, int start, int length)
    {
        final IntArrayPredicateIterator fieldIterator = new IntArrayPredicateIterator(
            context.allTokens.type, start, length,
            ON_FIELD_SEPARATOR);


        while (fieldIterator.hasNext())
        {
            final int fieldStart = fieldIterator.next();
            final int fieldLength = fieldIterator.getLength();


            field(context, fieldStart, fieldLength);
        }
    }

View Full Code Here

Examples of org.carrot2.util.IntArrayPredicateIterator

    /**
     * Invoked for each document's field. Splits further into sentences.
     */
    protected void field(PreprocessingContext context, int start, int length)
    {
        final IntArrayPredicateIterator sentenceIterator = new IntArrayPredicateIterator(
            context.allTokens.type, start, length,
            ON_SENTENCE_SEPARATOR);


        while (sentenceIterator.hasNext())
        {
            final int sentenceStart = sentenceIterator.next();
            final int sentenceLength = sentenceIterator.getLength();


            sentence(context, sentenceStart, sentenceLength);
        }
    }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.