Examples of HadoopDummyProgressable


Examples of org.apache.flink.hadoopcompatibility.mapred.wrapper.HadoopDummyProgressable

      throw new RuntimeException(e);
    }
   
    this.fileOutputCommitter.setupJob(jobContext);
   
    this.recordWriter = this.mapredOutputFormat.getRecordWriter(null, this.jobConf, Integer.toString(taskNumber + 1), new HadoopDummyProgressable());
  }
View Full Code Here

Examples of org.apache.flink.hadoopcompatibility.mapred.wrapper.HadoopDummyProgressable

      //compatible for hadoop 2.2.0, the temporary output directory is different from hadoop 1.2.1
      this.jobConf.set("mapreduce.task.output.dir", this.fileOutputCommitterWrapper.getTempTaskOutputPath(this.jobConf,TaskAttemptID.forName(this.jobConf.get("mapred.task.id"))).toString());
    } else {
      throw new IOException("task id too large");
    }
    this.recordWriter = this.hadoopOutputFormat.getRecordWriter(null, this.jobConf, Integer.toString(taskNumber + 1), new HadoopDummyProgressable());
  }
View Full Code Here
TOP
Copyright © 2018 www.massapi.com. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.