List of hflush() Examples

Examples of hflush()

org.apache.hadoop.fs.FSDataOutputStream.hflush()
org.apache.hadoop.hdfs.DFSOutputStream.hflush()
Flushes out to all replicas of the block. The data is in the buffers of the DNs but not necessarily in the DN's OS buffers. It is a synchronous operation. When it returns, it guarantees that flushed data become visible to new readers. It is not guaranteed that data has been flushed to persistent store on the datanode. Block allocations are persisted on namenode.
org.apache.hadoop.hdfs.client.HdfsDataOutputStream.hflush()
org.apache.hadoop.io.SequenceFile.Writer.hflush()

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()


    // Add new block should fail since /test1/file has been deleted.
    try {
      fos.write(data, 0, data.length);
      // make sure addBlock() request gets to NN immediately
      fos.hflush();


      fail("Write should fail after delete");
    } catch (Exception e) {
      /* Ignore */
    } finally {

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      for (int i = 0; i < 10; i++) {
        FSDataOutputStream stm = fs.create(
            new Path("/append-" + i), true, BLOCK_SIZE, (short) 1, BLOCK_SIZE);
        stms.add(stm);
        stm.write(1);
        stm.hflush();
      }


      cluster.restartNameNode();
      FSNamesystem ns = cluster.getNameNode(0).getNamesystem();
      BlockManagerTestUtil.updateState(ns.getBlockManager());

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

              CommonConfigurationKeys.IO_FILE_BUFFER_SIZE_KEY, 4096),
          (short) 3, blockSize);
      stm.write(new byte[(blockSize * 3) / 2]);
      // We do not close the stream so that
      // the writing seems to be still ongoing
      stm.hflush();


      LocatedBlocks blocks = client.getNamenode().getBlockLocations(
          fileName.toString(), 0, blockSize);
      DatanodeInfo[] nodes = blocks.get(0).getLocations();
      assertEquals(nodes.length, 3);

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      // create a new file.
      FSDataOutputStream stm = AppendTestUtil.createFile(fs, p, DATANODE_NUM);


      stm.write(fileContents, 0, 1);
      Thread.sleep(timeout);
      stm.hflush();
      System.out.println("Wrote 1 byte and hflush " + p);


      // write another byte
      Thread.sleep(timeout);
      stm.write(fileContents, 1, 1);

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      System.out.println("Wrote 1 byte and hflush " + p);


      // write another byte
      Thread.sleep(timeout);
      stm.write(fileContents, 1, 1);
      stm.hflush();


      stm.write(fileContents, 2, 1);
      Thread.sleep(timeout);
      stm.hflush();

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      stm.write(fileContents, 1, 1);
      stm.hflush();


      stm.write(fileContents, 2, 1);
      Thread.sleep(timeout);
      stm.hflush();


      stm.write(fileContents, 3, 1);
      Thread.sleep(timeout);
      stm.write(fileContents, 4, 1);
      stm.hflush();

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      stm.hflush();


      stm.write(fileContents, 3, 1);
      Thread.sleep(timeout);
      stm.write(fileContents, 4, 1);
      stm.hflush();


      stm.write(fileContents, 5, 1);
      Thread.sleep(timeout);
      stm.close();

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      FSDataOutputStream stm = AppendTestUtil.createFile(fs, p, DATANODE_NUM);


      stm.write(fileContents, 0, 2);
      Thread.currentThread().interrupt();
      try {
        stm.hflush();
        // If we made it past the hflush(), then that means that the ack made it back
        // from the pipeline before we got to the wait() call. In that case we should
        // still have interrupted status.
        assertTrue(Thread.currentThread().interrupted());
      } catch (InterruptedIOException ie) {

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

        System.out.println("Got expected exception during flush");
      }
      assertFalse(Thread.currentThread().interrupted());


      // Try again to flush should succeed since we no longer have interrupt status
      stm.hflush();


      // Write some more data and flush
      stm.write(fileContents, 2, 2);
      stm.hflush();

View Full Code Here

Examples of org.apache.hadoop.fs.FSDataOutputStream.hflush()

      // Try again to flush should succeed since we no longer have interrupt status
      stm.hflush();


      // Write some more data and flush
      stm.write(fileContents, 2, 2);
      stm.hflush();


      // Write some data and close while interrupted


      stm.write(fileContents, 4, 2);
      Thread.currentThread().interrupt();

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.