Examples of org.apache.hadoop.mapred.TaskID

org.apache.hadoop.mapred.TaskID
TaskID represents the immutable and unique identifier for a Map or Reduce Task. Each TaskID encompasses multiple attempts made to execute the Map or Reduce Task, each of which are uniquely indentified by their TaskAttemptID. TaskID consists of 3 parts. First part is the {@link JobID}, that this TaskInProgress belongs to. Second part of the TaskID is either 'm' or 'r' representing whether the task is a map task or a reduce task. And the third part is the task number.
An example TaskID is : task_200707121733_0003_m_000005 , which represents the fifth map task in the third job running at the jobtracker started at 200707121733.
Applications should never construct or parse TaskID strings , but rather use appropriate constructors or {@link #forName(String)} method. @see JobID @see TaskAttemptID

            this.beat = new HeartBeat(progressable, cfg, settings.getHeartBeatLead(), log);
            this.beat.start();
        }


        private int detectCurrentInstance(Configuration conf) {
            TaskID taskID = HadoopCfgUtils.getTaskID(conf);


            if (taskID == null) {
                log.warn(String.format("Cannot determine task id - redirecting writes in a random fashion"));
                return NO_TASK_ID;
            }


            return taskID.getId();
        }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

        this.progressable = progressable;
        this.rate = new TimeValue(tv.getMillis() - delay.getMillis(), TimeUnit.MILLISECONDS);
        this.log = log;


        String taskId;
        TaskID taskID = HadoopCfgUtils.getTaskID(cfg);


        if (taskID == null) {
            log.warn("Cannot determine task id...");
            taskId = "<unknown>";
            if (log.isTraceEnabled()) {

View Full Code Here

      return;
    for(String filename : fileNames)
    {
      String periodParts[] = filename.split("\\.");
      try{
        TaskID tid = TaskID.forName(periodParts[0]);
        if (tid.getJobID().equals(job))
        {
    //      if (! Files.delete(path + "/" + filename))
            //logger.warn("Could not delete temporary map side-effect file "+ path + "/" + filename);
        }
      } catch (Exception e) {}

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here




  String [] ret = new String[2];
  @Override
  public String [] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

  }
  
  String [] ret = new String[2];
  @Override
  public String [] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

  }


  String [] ret = new String[2];
  @Override
  public String [] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

0 1 2 3 4

TOP

Related Classes of org.apache.hadoop.mapred.TaskID

hivemall.utils.hadoop.HadoopUtils

org.apache.hadoop.hive.shims.Hadoop18Shims

org.apache.hadoop.hive.shims.Hadoop19Shims

org.apache.hadoop.hive.shims.Hadoop20Shims

org.apache.hadoop.hive.shims.Hadoop20SShims

org.apache.hadoop.hive.shims.Hadoop23Shims

org.apache.hadoop.hive.shims.HadoopShimsSecure

org.apache.hadoop.mapreduce.TaskReport

org.apache.hadoop.mapreduce.test.system.FinishTaskControlAction

org.apache.hadoop.streaming.TestStreamingStatus

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.