List of appendBatch() Examples

Examples of appendBatch()

journal.io.api.Journal.WriteBatch.appendBatch()
org.apache.flume.api.RpcClient.appendBatch()

Send a list of {@linkplain Event events} to the associated Flume source.

This method blocks until the RPC returns or until the request times out.

It is strongly recommended that the number of events in the List be no more than {@link #getBatchSize()}. If it is more, multiple RPC calls will be required, and the likelihood of duplicate Events being stored will increase.

Note: If this method throws an {@link EventDeliveryException}, there is no way to recover and the application must invoke {@link #close()} on this object to clean up systemresources.
@param events List of events to send @return @throws EventDeliveryException when an error prevents event delivery.
org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()
org.fusesource.hawtjournal.api.Journal.WriteBatch.appendBatch()

Examples of journal.io.api.Journal.WriteBatch.appendBatch()

                            }
                            WriteCommand controlRecord = currentBatch.prepareBatch();
                            writeRecord.getLocation().setDataFileId(file.getDataFileId());
                            writeRecord.getLocation().setPointer(currentBatch.incrementAndGetPointer());
                            writeRecord.getLocation().setLatch(currentBatch.getLatch());
                            currentBatch.appendBatch(writeRecord);
                            if (!writeRecord.isSync()) {
                                journal.getInflightWrites().put(controlRecord.getLocation(), controlRecord);
                                journal.getInflightWrites().put(writeRecord.getLocation(), writeRecord);
                                nextWriteBatch = currentBatch;
                            } else {

View Full Code Here

Examples of journal.io.api.Journal.WriteBatch.appendBatch()

                            }
                            WriteCommand controlRecord = currentBatch.prepareBatch();
                            writeRecord.getLocation().setDataFileId(file.getDataFileId());
                            writeRecord.getLocation().setPointer(currentBatch.incrementAndGetPointer());
                            writeRecord.getLocation().setLatch(currentBatch.getLatch());
                            currentBatch.appendBatch(writeRecord);
                            if (!writeRecord.isSync()) {
                                journal.getInflightWrites().put(controlRecord.getLocation(), controlRecord);
                                journal.getInflightWrites().put(writeRecord.getLocation(), writeRecord);
                                nextWriteBatch = currentBatch;
                            } else {

View Full Code Here

Examples of journal.io.api.Journal.WriteBatch.appendBatch()

                            }
                            WriteCommand controlRecord = currentBatch.prepareBatch();
                            writeRecord.getLocation().setDataFileId(file.getDataFileId());
                            writeRecord.getLocation().setPointer(currentBatch.incrementAndGetPointer());
                            writeRecord.getLocation().setLatch(currentBatch.getLatch());
                            currentBatch.appendBatch(writeRecord);
                            if (!writeRecord.isSync()) {
                                journal.getInflightWrites().put(controlRecord.getLocation(), controlRecord);
                                journal.getInflightWrites().put(writeRecord.getLocation(), writeRecord);
                                nextWriteBatch = currentBatch;
                            } else {

View Full Code Here

Examples of journal.io.api.Journal.WriteBatch.appendBatch()

                            }
                            WriteCommand controlRecord = currentBatch.prepareBatch();
                            writeRecord.getLocation().setDataFileId(file.getDataFileId());
                            writeRecord.getLocation().setPointer(currentBatch.incrementAndGetPointer());
                            writeRecord.getLocation().setLatch(currentBatch.getLatch());
                            currentBatch.appendBatch(writeRecord);
                            if (!writeRecord.isSync()) {
                                journal.getInflightWrites().put(controlRecord.getLocation(), controlRecord);
                                journal.getInflightWrites().put(writeRecord.getLocation(), writeRecord);
                                nextWriteBatch = currentBatch;
                            } else {

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

          if (now >= lastCheck + 5000) {
            logger.debug("Packed {} bytes, {} events", sentBytes, sent);
            lastCheck = now;
          }
        }
        rpcClient.appendBatch(eventBuffer);
      }
      logger.debug("Finished");
    } finally {
      if (reader != null) {
        logger.debug("Closing reader");

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

      while ((line = reader.readLine()) != null) {
        // logger.debug("read:{}", line);


        int size = eventBuffer.size();
        if (size == batchSize) {
          rpcClient.appendBatch(eventBuffer);
          eventBuffer.clear();
        }


        Event event = EventBuilder.withBody(line, Charset.forName("UTF8"));
        setHeaders(event);

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

          lastCheck = now;
        }
      }


      if (!eventBuffer.isEmpty()) {
        rpcClient.appendBatch(eventBuffer);
      }


      logger.debug("Finished");
    } finally {
      if (reader != null) {

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

      while ((line = reader.readLine()) != null) {
        // logger.debug("read:{}", line);


        int size = eventBuffer.size();
        if (size == batchSize) {
          rpcClient.appendBatch(eventBuffer);
          eventBuffer.clear();
        }


        Event event = EventBuilder.withBody(line, Charset.forName("UTF8"));
        eventBuffer.add(event);

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

          lastCheck = now;
        }
      }


      if (!eventBuffer.isEmpty()) {
        rpcClient.appendBatch(eventBuffer);
      }


      logger.debug("Finished");
    } finally {
      if (reader != null) {

View Full Code Here

Examples of org.apache.flume.api.RpcClient.appendBatch()

          if (now >= lastCheck + 5000) {
            logger.debug("Packed {} bytes, {} events", sentBytes, sent);
            lastCheck = now;
          }
        }
        rpcClient.appendBatch(events);
        if (reader instanceof ReliableEventReader) {
          ((ReliableEventReader) reader).commit();
        }
      }
      logger.debug("Finished");

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.