Examples of org.apache.hadoop.hdfs.DistributedFileSystem.concat()

Class org.apache.hadoop.hdfs.DistributedFileSystem

Examples of org.apache.hadoop.hdfs.DistributedFileSystem.concat()

org.apache.hadoop.hdfs.DistributedFileSystem.concat()
THIS IS DFS only operations, it is not part of FileSystem move blocks from srcs to trg and delete srcs afterwards all blocks should be the same size @param trg existing file to append to @param psrcs list of files (same block size, same replication) @throws IOException

       * /
       *  /testone
       *    /fileone
       *    /filetwo
       */
      fs.concat(new Path(file2), new Path[] {new Path(file1)}, false);
      inodeCount--; // file1 and file2 are concatenated to file2
      assertEquals(inodeCount, fsDir.getInodeMapSize());
      assertEquals(expectedLastInodeId, fsDir.getLastInodeId());
      
      /**

View Full Code Here

      if (partialPaths.size() > 1) {
        Path[] restPaths = partialPaths.subList(1,
            partialPaths.size()).toArray(new Path[partialPaths.size() - 1]);
        try {
          // Concat requires source and target files are in the same directory
          dfs.concat(finalTmpParity, restPaths, true);
          LOG.info("Concated " + partialPaths.size() + " files into " + finalTmpParity);
          
        } catch (IOException ioe) {
          // Maybe other tasks already finish concating. 
          LOG.info("Fail to concat " + partialPaths.size() +

View Full Code Here

    
    Path [] srcs = new Path[args.length-2];
    for(int i=2; i<args.length; i++) {
      srcs[i-2] = new Path(args[i]);
    }
    dfs.concat(new Path(args[1]), srcs, !args[0].equals("unrestricted"));
  }


}

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.