Examples of org.apache.hadoop.mapreduce.OutputCommitter.commitJob()

Class org.apache.hadoop.mapreduce.OutputCommitter

Examples of org.apache.hadoop.mapreduce.OutputCommitter.commitJob()

org.apache.hadoop.mapreduce.OutputCommitter.commitJob()
For committing job's output after successful job completion. Note that this is invoked for jobs with final runstate as SUCCESSFUL. This is called from the application master process for the entire job. This is guaranteed to only be called once. If it throws an exception the entire job will fail. @param jobContext Context of the job whose output is being written. @throws IOException

        job.getConfiguration(), ShimLoader.getHadoopShims().getHCatShim().createTaskAttemptID());
    OutputCommitter committer = hcof.getOutputCommitter(tac);
    committer.setupJob(job);
    committer.setupTask(tac);
    committer.commitTask(tac);
    committer.commitJob(job);


    Partition part = client.getPartition(dbName, tblName, Arrays.asList("p1"));
    assertNotNull(part);


    StorerInfo storer = InternalUtil.extractStorerInfo(part.getSd(), part.getParameters());

View Full Code Here

0 1 2 3

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.