Examples of org.apache.hadoop.mapred.TaskID

org.apache.hadoop.mapred.TaskID
TaskID represents the immutable and unique identifier for a Map or Reduce Task. Each TaskID encompasses multiple attempts made to execute the Map or Reduce Task, each of which are uniquely indentified by their TaskAttemptID. TaskID consists of 3 parts. First part is the {@link JobID}, that this TaskInProgress belongs to. Second part of the TaskID is either 'm' or 'r' representing whether the task is a map task or a reduce task. And the third part is the task number.
An example TaskID is : task_200707121733_0003_m_000005 , which represents the fifth map task in the third job running at the jobtracker started at 200707121733.
Applications should never construct or parse TaskID strings , but rather use appropriate constructors or {@link #forName(String)} method. @see JobID @see TaskAttemptID

    public static String getJobIdFromTaskId(@Nonnull String taskidStr) {
        if(!taskidStr.startsWith("task_")) {// workaround for Tez
            taskidStr = taskidStr.replace("task", "task_");
            taskidStr = taskidStr.substring(0, taskidStr.lastIndexOf('_'));
        }
        TaskID taskId = TaskID.forName(taskidStr);
        JobID jobId = taskId.getJobID();
        return jobId.toString();
    }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

  /**
   * Create a default control action. <br/>
   * 
   */
  public FinishTaskControlAction() {
    super(new TaskID());
  }

View Full Code Here

      // handle a bug in MRUnit - should be fixed in MRUnit 1.0.0
      when(context.getTaskAttemptID()).thenAnswer(new Answer<TaskAttemptID>() {
        @Override
        public TaskAttemptID answer(final InvocationOnMock invocation) {
          // FIXME MRUNIT seems to pass taskid to the reduce task as mapred.TaskID rather than mapreduce.TaskID
          return new TaskAttemptID(new TaskID("000000000000", 0, true, 0), 0);
        }
      });


      super.setup(context);
    }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

  
  private Collection<TaskAttemptID> runningAttempts = 
    new ArrayList<TaskAttemptID>();
  private TaskAttemptID successfulAttempt = new TaskAttemptID();
  public TaskReport() {
    taskid = new TaskID();
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here


  String[] ret = new String[2];


  @Override
  public String[] getTaskJobIDs(TaskCompletionEvent t) {
    TaskID tid = t.getTaskAttemptId().getTaskID();
    ret[0] = tid.toString();
    ret[1] = tid.getJobID().toString();
    return ret;
  }

View Full Code Here

0 1 2 3 4

TOP

Related Classes of org.apache.hadoop.mapred.TaskID

hivemall.utils.hadoop.HadoopUtils

org.apache.hadoop.hive.shims.Hadoop18Shims

org.apache.hadoop.hive.shims.Hadoop19Shims

org.apache.hadoop.hive.shims.Hadoop20Shims

org.apache.hadoop.hive.shims.Hadoop20SShims

org.apache.hadoop.hive.shims.Hadoop23Shims

org.apache.hadoop.hive.shims.HadoopShimsSecure

org.apache.hadoop.mapreduce.TaskReport

org.apache.hadoop.mapreduce.test.system.FinishTaskControlAction

org.apache.hadoop.streaming.TestStreamingStatus

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.