Examples of org.apache.flume.api.RpcClient.appendBatch()

org.apache.flume.api.RpcClient.appendBatch()

Send a list of {@linkplain Event events} to the associated Flume source.

This method blocks until the RPC returns or until the request times out.

It is strongly recommended that the number of events in the List be no more than {@link #getBatchSize()}. If it is more, multiple RPC calls will be required, and the likelihood of duplicate Events being stored will increase.

Note: If this method throws an {@link EventDeliveryException}, there is no way to recover and the application must invoke {@link #close()} on this object to clean up systemresources.
@param events List of events to send @return @throws EventDeliveryException when an error prevents event delivery.

          if (now >= lastCheck + 5000) {
            logger.debug("Packed {} bytes, {} events", sentBytes, sent);
            lastCheck = now;
          }
        }
        rpcClient.appendBatch(eventBuffer);
      }
      logger.debug("Finished");
    } finally {
      if (reader != null) {
        logger.debug("Closing reader");

View Full Code Here

      while ((line = reader.readLine()) != null) {
        // logger.debug("read:{}", line);


        int size = eventBuffer.size();
        if (size == batchSize) {
          rpcClient.appendBatch(eventBuffer);
          eventBuffer.clear();
        }


        Event event = EventBuilder.withBody(line, Charset.forName("UTF8"));
        setHeaders(event);

View Full Code Here

          lastCheck = now;
        }
      }


      if (!eventBuffer.isEmpty()) {
        rpcClient.appendBatch(eventBuffer);
      }


      logger.debug("Finished");
    } finally {
      if (reader != null) {

View Full Code Here

      while ((line = reader.readLine()) != null) {
        // logger.debug("read:{}", line);


        int size = eventBuffer.size();
        if (size == batchSize) {
          rpcClient.appendBatch(eventBuffer);
          eventBuffer.clear();
        }


        Event event = EventBuilder.withBody(line, Charset.forName("UTF8"));
        eventBuffer.add(event);

View Full Code Here

          lastCheck = now;
        }
      }


      if (!eventBuffer.isEmpty()) {
        rpcClient.appendBatch(eventBuffer);
      }


      logger.debug("Finished");
    } finally {
      if (reader != null) {

View Full Code Here

          if (now >= lastCheck + 5000) {
            logger.debug("Packed {} bytes, {} events", sentBytes, sent);
            lastCheck = now;
          }
        }
        rpcClient.appendBatch(events);
        if (reader instanceof ReliableEventReader) {
          ((ReliableEventReader) reader).commit();
        }
      }
      logger.debug("Finished");

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.