Examples of JobID

com.asakusafw.yaess.jobqueue.client.JobId
Represents a registered job ID. @since 0.2.6
com.socrata.datasync.deltaimporter2.JobId
com.spotify.helios.common.descriptors.JobId
Uniquely Identifies Jobs Has a string representation in JSON of:
```
 "name:version:hashvalue" 
```
The hash value is so that if you are talking to multiple clusters, and the job definitions are slightly different, even though they have the same name and version, they will still be uniquely identifiable. This is most important when executing commands against multiple clusters. Many endpoints taking JobId can take an abbreviated JobId. That is, one without a the final colon and hash value.
edu.uci.ics.hyracks.api.job.JobId
eu.stratosphere.nephele.jobgraph.JobID
org.apache.flink.runtime.jobgraph.JobID
org.apache.hadoop.mapred.JobID
JobID represents the immutable and unique identifier for the job. JobID consists of two parts. First part represents the jobtracker identifier, so that jobID to jobtracker map is defined. For cluster setup this string is the jobtracker start time, for local setting, it is "local". Second part of the JobID is the job number.
An example JobID is : job_200707121733_0003 , which represents the third job running at the jobtracker started at 200707121733.
Applications should never construct or parse JobID strings, but rather use appropriate constructors or {@link #forName(String)} method. @see TaskID @see TaskAttemptID
org.apache.hadoop.mapreduce.JobID
JobID represents the immutable and unique identifier for the job. JobID consists of two parts. First part represents the jobtracker identifier, so that jobID to jobtracker map is defined. For cluster setup this string is the jobtracker start time, for local setting, it is "local" and a random number. Second part of the JobID is the job number.
An example JobID is : job_200707121733_0003 , which represents the third job running at the jobtracker started at 200707121733.
Applications should never construct or parse JobID strings, but rather use appropriate constructors or {@link #forName(String)} method. @see TaskID @see TaskAttemptID
org.apache.hadoop.mapreduce.v2.api.records.JobId

JobId represents the globally unique identifier for a MapReduce job.

The globally unique nature of the identifier is achieved by using the cluster timestamp from the associated ApplicationId. i.e. start-time of the ResourceManager along with a monotonically increasing counter for the jobId.
org.glite.jobid.Jobid
org.rhq.core.domain.operation.JobId
Simple object that encapsulates the individual pieces of data that make up an operation job ID.
This class has some JPA annotations to allow it to be an entity ID specified via @IdClass.
@author John Mazzitelli

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

  }


  private static StubbedJob createStubbedJob(Configuration conf,
      Dispatcher dispatcher, int numSplits, AppContext appContext) {
    JobID jobID = JobID.forName("job_1234567890000_0001");
    JobId jobId = TypeConverter.toYarn(jobID);
    if (appContext == null) {
      appContext = mock(AppContext.class);
      when(appContext.hasSuccessfullyUnregistered()).thenReturn(true);
    }
    StubbedJob job = new StubbedJob(jobId,

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

        Token containerToken = newContainerToken(nodeId, "password".getBytes(),
              containerTokenIdentifier);
        Container container = Container.newInstance(cId, nodeId,
            NM_HOST + ":" + NM_HTTP_PORT, resource, null, containerToken);
        JobID id = TypeConverter.fromYarn(applicationId);
        JobId jobId = TypeConverter.toYarn(id);
        getContext().getEventHandler().handle(new JobHistoryEvent(jobId, 
            new NormalizedResourceEvent(
                org.apache.hadoop.mapreduce.TaskType.REDUCE,
            100)));
        getContext().getEventHandler().handle(new JobHistoryEvent(jobId,

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

      public Dispatcher createDispatcher() {
        return dispatcher;
      }
    };
    Job job = app.submit(new Configuration());
    JobId jobId = app.getJobId();
    app.waitForState(job, JobState.RUNNING);
    Assert.assertEquals("Num tasks not correct", 2, job.getTasks().size());
    Iterator<Task> it = job.getTasks().values().iterator();
    Task mapTask = it.next();
    Task reduceTask = it.next();

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

      public Dispatcher createDispatcher() {
        return dispatcher;
      }
    };
    Job job = app.submit(new Configuration());
    JobId jobId = app.getJobId();
    app.waitForState(job, JobState.RUNNING);
    Assert.assertEquals("Num tasks not correct", 2, job.getTasks().size());
    Iterator<Task> it = job.getTasks().values().iterator();
    Task mapTask = it.next();
    Task reduceTask = it.next();

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

     String user = UserGroupInformation.getCurrentUser().getShortUserName();
     Path stagingDir = MRApps.getStagingAreaDir(conf, user);
     when(fs.exists(stagingDir)).thenReturn(true);
     ApplicationId appId = ApplicationId.newInstance(0, 1);
     ApplicationAttemptId attemptId = ApplicationAttemptId.newInstance(appId, 1);
     JobId jobid = recordFactory.newRecordInstance(JobId.class);
     jobid.setAppId(appId);
     TestMRApp appMaster = new TestMRApp(attemptId, null,
         JobStateInternal.RUNNING, maxAttempts);
     appMaster.crushUnregistration = true;
     appMaster.init(conf);
     appMaster.start();

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

     Path stagingDir = MRApps.getStagingAreaDir(conf, user);
     when(fs.exists(stagingDir)).thenReturn(true);
     ApplicationId appId = ApplicationId.newInstance(System.currentTimeMillis(),
        0);
     ApplicationAttemptId attemptId = ApplicationAttemptId.newInstance(appId, 1);
     JobId jobid = recordFactory.newRecordInstance(JobId.class);
     jobid.setAppId(appId);
     ContainerAllocator mockAlloc = mock(ContainerAllocator.class);
     Assert.assertTrue(MRJobConfig.DEFAULT_MR_AM_MAX_ATTEMPTS > 1);
     MRAppMaster appMaster = new TestMRApp(attemptId, mockAlloc,
         JobStateInternal.RUNNING, MRJobConfig.DEFAULT_MR_AM_MAX_ATTEMPTS);
     appMaster.init(conf);

View Full Code Here

Examples of org.apache.hadoop.mapreduce.v2.api.records.JobId

     Path stagingDir = MRApps.getStagingAreaDir(conf, user);
     when(fs.exists(stagingDir)).thenReturn(true);
     ApplicationId appId = ApplicationId.newInstance(System.currentTimeMillis(),
         0);
     ApplicationAttemptId attemptId = ApplicationAttemptId.newInstance(appId, 0);
     JobId jobid = recordFactory.newRecordInstance(JobId.class);
     jobid.setAppId(appId);
     ContainerAllocator mockAlloc = mock(ContainerAllocator.class);
     MRAppMaster appMaster = new TestMRApp(attemptId, mockAlloc, 4);
     appMaster.init(conf);
     //simulate the process being killed
     MRAppMaster.MRAppMasterShutdownHook hook =

View Full Code Here

Examples of org.glite.jobid.Jobid

                } catch (URISyntaxException e) {
                    logger.warn("malformed LBAddress (" + userLBAddress + "), using default");
                }
            }


            Jobid lbjob = new Jobid(lb.getHost(), lb.getPort());
            logger.info(job.getId() + " assigned gridJobId " + lbjob.toString());


            /*
             * TODO: remove this code, and assign the grid jobid to this job
             * really
             */
            lbjob = new Jobid(lb.getHost(), lb.getPort(), job.getId());
            logger.info("... but using instead " + lbjob.toString());


            //LBCredentials cred = new LBCredentials(job.getDelegationProxyCertPath(), "/etc/grid-security/certificates");
            //ContextDirect ctxd = new ContextDirect(lb.getHost(), lb.getPort());
            //ctxd.setCredentials(cred);
            //ctxd.setJobid(lbjob);

View Full Code Here

Examples of org.rhq.core.domain.operation.JobId

        if (operation.isReadyToSubmit()) {


            // submit
            ResourceOperationSchedule sched = opsManager.scheduleResourceOperation(caller,operation.getResourceId(),operation.getName(),0,0,0,-1,
                    parameters,"Test");
            JobId jobId = new JobId(sched.getJobName(),sched.getJobGroup());
            UriBuilder uriBuilder = uriInfo.getBaseUriBuilder();
            uriBuilder.path("/operation/history/{id}");
            URI uri = uriBuilder.build(jobId);
            Link histLink = new Link("history",uri.toString());
            operation.addLink(histLink);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.