Examples of org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.refresh()

Package org.apache.hadoop.hdfs.server.namenode

Class org.apache.hadoop.hdfs.server.namenode.EditLogInputStream

Examples of org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.refresh()

org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.refresh()
Used to reopen and reset the position.

          op = in.readOp();
          if (op == null) { // If we've reached the end prematurely...
            Thread.sleep(200);
            LOG.info("Refreshing to " + lastPos);


            in.refresh(lastPos, maxTxId); // Then refresh to last known good position
          } else {
            long txId = op.getTransactionId();
            if (txId > maxTxId) {
              // Standby ingest contains similar logic: transactions
              // with ids lower than what is already read are ignored.

View Full Code Here

        qjm.finalizeLogSegment(0, numEdits - 1);


        // Once producer is shutdown, scan again from last known good position
        // until the end of the ledger. This mirrors the Ingest logic (last
        // read when being quiesced).
        in.refresh(lastPos, maxTxId);
        do {
          op = in.readOp();
          if (op != null) {
            long txId = op.getTransactionId();
            if (txId > maxTxId) {

View Full Code Here

      lastTxnId--;
    }


    for (int expected = firstTxnId; expected <= lastTxnId; expected++) {
      if (inProgress) { // otherwise we cannot call refresh
        stream.refresh(position, expected - 1);
      }
      FSEditLogOp op = stream.readOp();
      position = stream.getPosition();


      while (op == null) {

View Full Code Here

    
    // stop the node
    jn.stopAndJoin(0);
    
    // refresh the input stream
    is.refresh(position, 0);
    
    LOG.info("Checking failed stream");
    // this guy should be disabled
    // its position should be fixed
    URLLogInputStream urlis = tailing[0];

View Full Code Here

      position = is.getPosition();
    }
    LOG.info("Current state of the input stream: " + is.getName());
    
    // refresh again
    is.refresh(position, 0);
    assertEquals(position, urlis.getPosition());
    assertTrue(urlis.isDisabled());
    assertEquals(HdfsConstants.INVALID_TXID, urlis.getLastTxId());
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.