Examples of org.apache.hadoop.mapred.TaskID

org.apache.hadoop.mapred.TaskID
TaskID represents the immutable and unique identifier for a Map or Reduce Task. Each TaskID encompasses multiple attempts made to execute the Map or Reduce Task, each of which are uniquely indentified by their TaskAttemptID. TaskID consists of 3 parts. First part is the {@link JobID}, that this TaskInProgress belongs to. Second part of the TaskID is either 'm' or 'r' representing whether the task is a map task or a reduce task. And the third part is the task number.
An example TaskID is : task_200707121733_0003_m_000005 , which represents the fifth map task in the third job running at the jobtracker started at 200707121733.
Applications should never construct or parse TaskID strings , but rather use appropriate constructors or {@link #forName(String)} method. @see JobID @see TaskAttemptID


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

        Assert.isTrue(tv.getSeconds() > delay.getSeconds(), "Hadoop timeout is shorter than the heartbeat");


        this.progressable = progressable;
        this.rate = new TimeValue(tv.getMillis() - delay.getMillis(), TimeUnit.MILLISECONDS);
        this.log = log;
        TaskID taskID = TaskID.forName(HadoopCfgUtils.getTaskId(cfg));


        String taskId;
        if (taskID == null) {
            log.warn("Cannot determine task id...");
            taskId = "<unknown>";

View Full Code Here


            repository = new RestRepository(settings);
        }


        private int detectCurrentInstance(Configuration conf) {
            TaskID taskID = TaskID.forName(HadoopCfgUtils.getTaskId(conf));


            if (taskID == null) {
                log.warn(String.format("Cannot determine task id - redirecting writes in a random fashion"));
                return NO_TASK_ID;
            }


            return taskID.getId();
        }

View Full Code Here

0 1 2 3 4

TOP

Related Classes of org.apache.hadoop.mapred.TaskID

hivemall.utils.hadoop.HadoopUtils

org.apache.hadoop.hive.shims.Hadoop18Shims

org.apache.hadoop.hive.shims.Hadoop19Shims

org.apache.hadoop.hive.shims.Hadoop20Shims

org.apache.hadoop.hive.shims.Hadoop20SShims

org.apache.hadoop.hive.shims.Hadoop23Shims

org.apache.hadoop.hive.shims.HadoopShimsSecure

org.apache.hadoop.mapreduce.TaskReport

org.apache.hadoop.mapreduce.test.system.FinishTaskControlAction

org.apache.hadoop.streaming.TestStreamingStatus

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.