Package co.cask.cdap.internal.app.runtime.spark

Examples of co.cask.cdap.internal.app.runtime.spark.SparkContextConfig


  private static final Logger LOG = LoggerFactory.getLogger(SparkDatasetInputFormat.class);
  public static final String HCONF_ATTR_INPUT_DATASET = "input.dataset.name";

  @Override
  public List<InputSplit> getSplits(final JobContext context) throws IOException, InterruptedException {
    SparkContextConfig sparkContextConfig = new SparkContextConfig(context.getConfiguration());
    List<Split> splits = sparkContextConfig.getInputSelection();
    List<InputSplit> list = new ArrayList<InputSplit>();
    for (Split split : splits) {
      list.add(new DataSetInputSplit(split));
    }
    return list;
View Full Code Here

TOP

Related Classes of co.cask.cdap.internal.app.runtime.spark.SparkContextConfig

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.