Examples of com.google.enterprise.connector.traversal.Traverser.runBatch()

com.google.enterprise.connector.traversal.Traverser.runBatch()

Runs a batch of documents. The Traversal method may be hard (impossible?) to interrupt while it is executing runBatch(). It is expected that a thread loop running a traversal method would call runBatch(), then check for InterruptedException, then decide whether it wants to stop of itself, for scheduling reasons, or for a clean shutdown. It could then re-adjust the batch hint if desired, then repeat. @param batchSize A {@link BatchSize} instructs the traversal method toprocess approximately {@code batchSize.getHint()}, but no more than {@code batchSize.getMaximum()} number of documents in thisbatch. @return A {@link BatchResult} containing the actual number of documentsfrom this batch given to the feed and a possible policy to delay before requesting another batch.

        int docsProcessed = 0;
        int totalDocsProcessed = 0;
        int batchNumber = 0;
        BatchSize batchSize = new BatchSize(batchHint);
        do {
            BatchResult result = traverser.runBatch(batchSize);
            docsProcessed = result.getCountProcessed();
            if (docsProcessed > 0) {
                totalDocsProcessed += docsProcessed;
            }
            System.out.println("Batch# " + batchNumber + " docs " +

        5, new SystemClock()));
    final Traverser traverser = new QueryTraverser(new MockPusher(System.out),
        traversalManager, instantiator.getTraversalStateStore(connectorName),
        connectorName, Context.getInstance().getTraversalContext(),
        new SystemClock());
    BatchResult result = traverser.runBatch(new BatchSize(10));
    int totalDocsProcessed = result.getCountProcessed();
    assertTrue(totalDocsProcessed > 0);
  }
}

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.