Examples of JobContext

com.taobao.zeus.jobs.JobContext
Job上下文当存在多个Job顺序处理时，通过上下文莱传递Job状态与信息 @author zhoufang
de.innovationgate.wgpublisher.scheduler.JobContext
This object is passed to WGA jobs to provide access to WGA resources.
io.crate.operation.reference.sys.job.JobContext
javax.batch.runtime.context.JobContext
org.apache.airavata.core.gfac.context.JobContext
org.apache.hadoop.mapred.JobContext
@deprecated Use {@link org.apache.hadoop.mapreduce.JobContext} instead.
org.apache.hadoop.mapreduce.JobContext
A read-only view of the job that is provided to the tasks while they are running.
org.apache.helix.task.JobContext
Provides a typed interface to the context information stored by {@link TaskRebalancer} in theHelix property store.
org.apache.karaf.scheduler.JobContext
The context for a {@link Job}.
org.apache.sling.commons.scheduler.JobContext
The context for a {@link Job}.
org.drools.core.time.JobContext
org.drools.time.JobContext
org.jbpm.env.context.JobContext
org.jbpm.pvm.internal.env.JobContext
org.springframework.batch.core.scope.context.JobContext
A context object that can be used to interrogate the current {@link JobExecution} and some of its associatedproperties using expressions based on bean paths. Has public getters for the job execution and convenience methods for accessing commonly used properties like the {@link ExecutionContext} associated with the jobexecution. @author Dave Syer @author Jimmy Praet (create JobContext based on {@link StepContext}) @since 3.0

Examples of org.apache.hadoop.mapreduce.JobContext

    
    CommitterEventHandler handler = new CommitterEventHandler(mockContext, 
        mockCommitter, new TestingRMHeartbeatHandler());
    YarnConfiguration conf = new YarnConfiguration();
    conf.set(MRJobConfig.MR_AM_STAGING_DIR, stagingDir);
    JobContext mockJobContext = mock(JobContext.class);
    ApplicationAttemptId attemptid = 
      ConverterUtils.toApplicationAttemptId("appattempt_1234567890000_0001_0");
    JobId jobId =  TypeConverter.toYarn(
        TypeConverter.fromYarn(attemptid.getApplicationId()));

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    
    CommitterEventHandler handler = new CommitterEventHandler(mockContext, 
        mockCommitter, new TestingRMHeartbeatHandler());
    YarnConfiguration conf = new YarnConfiguration();
    conf.set(MRJobConfig.MR_AM_STAGING_DIR, stagingDir);
    JobContext mockJobContext = mock(JobContext.class);
    ApplicationAttemptId attemptid = 
      ConverterUtils.toApplicationAttemptId("appattempt_1234567890000_0001_0");
    JobId jobId =  TypeConverter.toYarn(
        TypeConverter.fromYarn(attemptid.getApplicationId()));

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

  job.setInputFormatClass(FileInputFormat.class);


  Configuration conf = job.getConfiguration();
  FileInputFormat.setInputPaths(job, new Path(baseDir.getAbsolutePath()));


  JobContext jobContext = new JobContext(conf, job.getJobID());


  partitionHelper.setPartitionFilterExpression("year < '2010'",
    PigStorage.class, "1");
  partitionHelper.setPartitionKeys(baseDir.getAbsolutePath(), conf,
    PigStorage.class, "1");

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

  job.setInputFormatClass(FileInputFormat.class);


  Configuration conf = job.getConfiguration();
  FileInputFormat.setInputPaths(job, new Path(baseDir.getAbsolutePath()));


  JobContext jobContext = new JobContext(conf, job.getJobID());


  partitionHelper.setPartitionFilterExpression(
    "year<='2010' and month=='01' and day>='01'", PigStorage.class, "2");
  partitionHelper.setPartitionKeys(baseDir.getAbsolutePath(), conf,
    PigStorage.class, "2");

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

  job.setInputFormatClass(FileInputFormat.class);


  Configuration conf = job.getConfiguration();
  FileInputFormat.setInputPaths(job, new Path(baseDir.getAbsolutePath()));


  JobContext jobContext = new JobContext(conf, job.getJobID());


  partitionHelper.setPartitionKeys(baseDir.getAbsolutePath(), conf,
    PigStorage.class, "3");


  List<FileStatus> files = partitionHelper.listStatus(jobContext,

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext


    
    public void store(DataBag data, FuncSpec storeFuncSpec, PigContext pigContext) throws IOException {
        Configuration conf = ConfigurationUtil.toConfiguration(pigContext.getProperties());
        // create a simulated JobContext
        JobContext jc = new JobContext(conf, new JobID());
        StoreFuncInterface sfunc = (StoreFuncInterface)PigContext.instantiateFuncFromSpec(
                storeFuncSpec);
        OutputFormat<?,?> of = sfunc.getOutputFormat();
        
        POStore store = new POStore(new OperatorKey());

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

        // The above setLocation call could write to the conf within
        // the job - get a hold of the modified conf
        conf = job.getConfiguration();
        inputFormat = wrappedLoadFunc.getInputFormat();
        try {
            inpSplits = inputFormat.getSplits(new JobContext(conf,
                    new JobID()));
        } catch (InterruptedException e) {
            throw new IOException(e);
        }        
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

                            .instantiateFuncFromSpec(ld.getLFile()
                                    .getFuncSpec());
                            Job job = new Job(conf);
                            loader.setLocation(location, job);
                            InputFormat inf = loader.getInputFormat();
                            List<InputSplit> splits = inf.getSplits(new JobContext(
                                    job.getConfiguration(), job.getJobID()));
                            List<List<InputSplit>> results = MapRedUtil
                            .getCombinePigSplits(splits, fs
                                    .getDefaultBlockSize(), conf);
                            numFiles += results.size();

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

     * @param job
     * @param st
     * @throws IOException 
     */
    private void storeSchema(Job job, POStore st) throws IOException {
        JobContext jc = new JobContext(job.getJobConf(), 
                new org.apache.hadoop.mapreduce.JobID());
        JobContext updatedJc = PigOutputCommitter.setUpContext(jc, st);
        PigOutputCommitter.storeCleanup(st, updatedJc.getConfiguration());
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    private void checkOutputSpecsHelper(List<POStore> stores, JobContext 
            jobcontext) throws IOException, InterruptedException {
        for (POStore store : stores) {
            // make a copy of the original JobContext so that
            // each OutputFormat get a different copy 
            JobContext jobContextCopy = new JobContext(
                    jobcontext.getConfiguration(), jobcontext.getJobID());
            
            // set output location
            PigOutputFormat.setLocation(jobContextCopy, store);

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.