Examples of JobContext

com.taobao.zeus.jobs.JobContext
Job上下文当存在多个Job顺序处理时，通过上下文莱传递Job状态与信息 @author zhoufang
de.innovationgate.wgpublisher.scheduler.JobContext
This object is passed to WGA jobs to provide access to WGA resources.
io.crate.operation.reference.sys.job.JobContext
javax.batch.runtime.context.JobContext
org.apache.airavata.core.gfac.context.JobContext
org.apache.hadoop.mapred.JobContext
@deprecated Use {@link org.apache.hadoop.mapreduce.JobContext} instead.
org.apache.hadoop.mapreduce.JobContext
A read-only view of the job that is provided to the tasks while they are running.
org.apache.helix.task.JobContext
Provides a typed interface to the context information stored by {@link TaskRebalancer} in theHelix property store.
org.apache.karaf.scheduler.JobContext
The context for a {@link Job}.
org.apache.sling.commons.scheduler.JobContext
The context for a {@link Job}.
org.drools.core.time.JobContext
org.drools.time.JobContext
org.jbpm.env.context.JobContext
org.jbpm.pvm.internal.env.JobContext
org.springframework.batch.core.scope.context.JobContext
A context object that can be used to interrogate the current {@link JobExecution} and some of its associatedproperties using expressions based on bean paths. Has public getters for the job execution and convenience methods for accessing commonly used properties like the {@link ExecutionContext} associated with the jobexecution. @author Dave Syer @author Jimmy Praet (create JobContext based on {@link StepContext}) @since 3.0

Examples of org.apache.hadoop.mapreduce.JobContext

                // the inputSpecificJob - use this updated conf
                
                // get the InputFormat from it and ask for splits
                InputFormat inpFormat = loadFunc.getInputFormat();
                List<InputSplit> oneInputSplits = inpFormat.getSplits(
                        new JobContext(inputSpecificJob.getConfiguration(), 
                                jobcontext.getJobID()));
                List<InputSplit> oneInputPigSplits = getPigSplits(
                        oneInputSplits, i, inpTargets.get(i), fs.getDefaultBlockSize(), combinable, confClone);
                splits.addAll(oneInputPigSplits);
            } catch (ExecException ee) {

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    
    static JobContext setUpContext(JobContext context, 
            POStore store) throws IOException {
        // make a copy of the context so that the actions after this call
        // do not end up updating the same context
        JobContext contextCopy = new JobContext(
                context.getConfiguration(), context.getJobID());
        
        // call setLocation() on the storeFunc so that if there are any
        // side effects like setting map.output.dir on the Configuration
        // in the Context are needed by the OutputCommitter, those actions

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    
    @Override
    public void cleanupJob(JobContext context) throws IOException {
        // call clean up on all map and reduce committers
        for (Pair<OutputCommitter, POStore> mapCommitter : mapOutputCommitters) {            
            JobContext updatedContext = setUpContext(context, 
                    mapCommitter.second);
            storeCleanup(mapCommitter.second, updatedContext.getConfiguration());
            mapCommitter.first.cleanupJob(updatedContext);
        }
        for (Pair<OutputCommitter, POStore> reduceCommitter : 
            reduceOutputCommitters) {            
            JobContext updatedContext = setUpContext(context, 
                    reduceCommitter.second);
            storeCleanup(reduceCommitter.second, updatedContext.getConfiguration());
            reduceCommitter.first.cleanupJob(updatedContext);
        }
       
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    
    @Override
    public void setupJob(JobContext context) throws IOException {
        // call set up on all map and reduce committers
        for (Pair<OutputCommitter, POStore> mapCommitter : mapOutputCommitters) {
            JobContext updatedContext = setUpContext(context, 
                    mapCommitter.second);
            mapCommitter.first.setupJob(updatedContext);
        }
        for (Pair<OutputCommitter, POStore> reduceCommitter : 
            reduceOutputCommitters) {
            JobContext updatedContext = setUpContext(context, 
                    reduceCommitter.second);
            reduceCommitter.first.setupJob(updatedContext);
        }
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

import org.apache.hadoop.mapreduce.task.JobContextImpl;
import org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl;


public class HadoopShims {
    static public JobContext cloneJobContext(JobContext original) throws IOException, InterruptedException {
        JobContext newContext = ContextFactory.cloneContext(original, original.getConfiguration());
        return newContext;
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

        return newContext;
    }
    
    static public JobContext createJobContext(Configuration conf, 
            JobID jobId) {
        JobContext newContext = new JobContextImpl(conf, jobId);
        return newContext;
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

 * This class wrapping all static method. PigMapReduce, PigMapBase, MiniCluster wrapping hadoop
 * version dependant implementaton of PigGenericMapReduce, PigGenericMapBase and MiniGenericCluster.
 **/
public class HadoopShims {
    static public JobContext cloneJobContext(JobContext original) throws IOException, InterruptedException {
        JobContext newContext = new JobContext(original.getConfiguration(), original.getJobID());
        return newContext;
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

        return newContext;
    }
    
    static public JobContext createJobContext(Configuration conf, 
            JobID jobId) {
        JobContext newJobContext = new JobContext(
                conf, jobId);
        return newJobContext;
    }

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext


public class TestRCFileOutputStorageDriver extends TestCase {


  public void testConversion() throws IOException {
    Configuration conf = new Configuration();
    JobContext jc = new JobContext(conf, new JobID());


    HowlSchema schema = buildHiveSchema();
    HowlInputStorageDriver isd = new RCFileInputDriver();


    isd.setOriginalSchema(jc, schema);

View Full Code Here

Examples of org.apache.hadoop.mapreduce.JobContext

    writer.close();
    BytesRefArrayWritable[] bytesArr = new BytesRefArrayWritable[]{bytes,bytes2};


    HowlSchema schema = buildHiveSchema();
    RCFileInputDriver sd = new RCFileInputDriver();
    JobContext jc = new JobContext(conf, new JobID());
    sd.setInputPath(jc, file.toString());
    InputFormat<?,?> iF = sd.getInputFormat(null);
    InputSplit split = iF.getSplits(jc).get(0);
    sd.setOriginalSchema(jc, schema);
    sd.setOutputSchema(jc, schema);

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.