Examples of JobRunner

org.springframework.data.hadoop.mapreduce.JobRunner

Simple runner for submitting Hadoop jobs sequentially. By default, the runner waits for the jobs to finish and returns a boolean indicating whether all the jobs succeeded or not (when there's no waiting, the status cannot be determined and null is returned).

For more control over the job execution and outcome consider querying the {@link Job}s or using Spring Batch (see the reference documentation for more info).

To make the runner execute at startup, use {@link #setRunAtStartup(boolean)}. @author Costin Leau

        OutputStream os = fs.create(new Path(inDir, "text.txt"));
        Writer wr = new OutputStreamWriter(os);
        wr.write("b a\n");
        wr.close();
    
    JobRunner runner = (JobRunner) ctx.getBean("runner");
    runner.call();


        Path[] outputFiles = FileUtil.stat2Paths(
                fs.listStatus(outDir, new Utils.OutputFileUtils.OutputFilesFilter()));


        assertEquals(1, outputFiles.length);

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of JobRunner

Examples of org.springframework.data.hadoop.mapreduce.JobRunner