List of appendBatch() Examples

Examples of appendBatch()

journal.io.api.Journal.WriteBatch.appendBatch()
org.apache.flume.api.RpcClient.appendBatch()

Send a list of {@linkplain Event events} to the associated Flume source.

This method blocks until the RPC returns or until the request times out.

It is strongly recommended that the number of events in the List be no more than {@link #getBatchSize()}. If it is more, multiple RPC calls will be required, and the likelihood of duplicate Events being stored will increase.

Note: If this method throws an {@link EventDeliveryException}, there is no way to recover and the application must invoke {@link #close()} on this object to clean up systemresources.
@param events List of events to send @return @throws EventDeliveryException when an error prevents event delivery.
org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()
org.fusesource.hawtjournal.api.Journal.WriteBatch.appendBatch()

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()


      while ((line = reader.readLine()) != null) {
        // logger.debug("read:{}", line);


        if (eventBuffer.size() >= 1000) {
          Status status = client.appendBatch(eventBuffer);


          if (!status.equals(Status.OK)) {
            logger.error("Unable to send batch size:{} status:{}",
                eventBuffer.size(), status);
          }

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

          lastCheck = now;
        }
      }


      if (eventBuffer.size() > 0) {
        Status status = client.appendBatch(eventBuffer);


        if (!status.equals(Status.OK)) {
          logger.error("Unable to send batch size:{} status:{}",
              eventBuffer.size(), status);
        }

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

            i = 0;
            do {
                try {
                    transceiver = null;
                    AvroSourceProtocol c = connect(agent.getHost(), agent.getPort());
                    Status status = (batch == null) ? c.append(avroEvent) : c.appendBatch(batch);
                    if (!status.equals(Status.OK)) {
                        if (i == retries - 1) {
                            String warnMsg = "RPC communication failed to " + getName() + " at " +
                                agent.getHost() + ":" + agent.getPort();
                            LOGGER.warn(warnMsg);

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

            i = 0;
            do {
                try {
                    transceiver = null;
                    AvroSourceProtocol c = connect(agent.getHost(), agent.getPort());
                    Status status = (batch == null) ? c.append(avroEvent) : c.appendBatch(batch);
                    if (!status.equals(Status.OK)) {
                        if (i == retries - 1) {
                            String warnMsg = "RPC communication failed to " + getName() + " at " +
                                agent.getHost() + ":" + agent.getPort();
                            LOGGER.warn(warnMsg);

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

                i = 0;
                do {
                    try {
                        transceiver = null;
                        final AvroSourceProtocol c = connect(agent.getHost(), agent.getPort());
                        final Status status = (batch == null) ? c.append(avroEvent) : c.appendBatch(batch);
                        if (!status.equals(Status.OK)) {
                            if (i == retries - 1) {
                                final String warnMsg = "RPC communication failed to " + getName() + " at " +
                                    agent.getHost() + ":" + agent.getPort();
                                LOGGER.warn(warnMsg);

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

            i = 0;
            do {
                try {
                    transceiver = null;
                    AvroSourceProtocol c = connect(agent.getHost(), agent.getPort());
                    Status status = (batch == null) ? c.append(avroEvent) : c.appendBatch(batch);
                    if (!status.equals(Status.OK)) {
                        if (i == retries - 1) {
                            String warnMsg = "RPC communication failed to " + getName() + " at " +
                                agent.getHost() + ":" + agent.getPort();
                            LOGGER.warn(warnMsg);

View Full Code Here

Examples of org.apache.flume.source.avro.AvroSourceProtocol.appendBatch()

            i = 0;
            do {
                try {
                    transceiver = null;
                    AvroSourceProtocol c = connect(agent.getHost(), agent.getPort());
                    Status status = (batch == null) ? c.append(avroEvent) : c.appendBatch(batch);
                    if (!status.equals(Status.OK)) {
                        if (i == retries - 1) {
                            String warnMsg = "RPC communication failed to " + getName() + " at " +
                                agent.getHost() + ":" + agent.getPort();
                            LOGGER.warn(warnMsg);

View Full Code Here

Examples of org.fusesource.hawtjournal.api.Journal.WriteBatch.appendBatch()

                            if (!canBatch) {
                                file = journal.rotateWriteFile();
                                currentBatch = new WriteBatch(file, file.getLength());
                            }
                            WriteCommand controlRecord = currentBatch.prepareBatch();
                            currentBatch.appendBatch(writeRecord);
                            if (!writeRecord.isSync()) {
                                journal.getInflightWrites().put(controlRecord.getLocation(), controlRecord);
                                journal.getInflightWrites().put(writeRecord.getLocation(), writeRecord);
                                nextWriteBatch = currentBatch;
                            } else {

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.