Examples of com.twitter.elephantbird.mapreduce.input.combine.DelegateCombineFileInputFormat

Package com.twitter.elephantbird.mapreduce.input.combine

Examples of com.twitter.elephantbird.mapreduce.input.combine.DelegateCombineFileInputFormat

com.twitter.elephantbird.mapreduce.input.combine.DelegateCombineFileInputFormat
This class allows for combining the InputSplit of an underlying {@link InputFormat}in a way which functions properly with Elephant Bird's other input formats. It works seamlessly with {@link com.twitter.elephantbird.mapred.input.DeprecatedInputFormatWrapper}which means that any of Elephant Bird's Input Formats can be used in Cascading as a CombineFileInputFormat. @author Jonathan Coveney

      LzoIndex.createIndex(localFs, lzoFile);
    }


    InputFormat inputFormat;
    if (combineSplits) {
      inputFormat = new DelegateCombineFileInputFormat();
    }  else {
      inputFormat = new LzoTextInputFormat();
    }


    TextInputFormat.setInputPaths(job, outputDir_);

View Full Code Here

TOP

Related Classes of com.twitter.elephantbird.mapreduce.input.combine.DelegateCombineFileInputFormat

com.twitter.elephantbird.mapreduce.input.TestLzoTextInputFormat

org.apache.hadoop.conf.Configuration

java.io.IOException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.