List of readCsvFile() Examples

Examples of readCsvFile()

adlzanchetta.chronoDataIO.csv.ChronoDataCsvImporter.readCsvFile()
eu.stratosphere.api.java.ExecutionEnvironment.readCsvFile()
Creates a CSV reader to read a comma separated value (CSV) file. The reader has options to define parameters and field types and will eventually produce the DataSet that corresponds to the read and parsed CSV input. @param filePath The path of the CSV file. @return A CsvReader that can be used to configure the CSV input.
org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()
Creates a CSV reader to read a comma separated value (CSV) file. The reader has options to define parameters and field types and will eventually produce the DataSet that corresponds to the read and parsed CSV input. @param filePath The path of the CSV file. @return A CsvReader that can be used to configure the CSV input.

Examples of org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()

  public void testGroupedReduceWithFieldPositionKeyNonCombinable() {
    try {
      ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      env.setDegreeOfParallelism(8);
      
      DataSet<Tuple2<String, Double>> data = env.readCsvFile("file:///will/never/be/read").types(String.class, Double.class)
        .name("source").setParallelism(6);
      
      data
        .groupBy(1)
        .reduceGroup(new RichGroupReduceFunction<Tuple2<String, Double>, Tuple2<String, Double>>() {

View Full Code Here

Examples of org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()

  public void testGroupedReduceWithFieldPositionKeyCombinable() {
    try {
      ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      env.setDegreeOfParallelism(8);
      
      DataSet<Tuple2<String, Double>> data = env.readCsvFile("file:///will/never/be/read").types(String.class, Double.class)
        .name("source").setParallelism(6);
      
      GroupReduceOperator<Tuple2<String, Double>, Tuple2<String, Double>> reduced = data
          .groupBy(1)
          .reduceGroup(new RichGroupReduceFunction<Tuple2<String, Double>, Tuple2<String, Double>>() {

View Full Code Here

Examples of org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()

  public void testGroupedReduceWithSelectorFunctionKeyNoncombinable() {
    try {
      ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      env.setDegreeOfParallelism(8);
      
      DataSet<Tuple2<String, Double>> data = env.readCsvFile("file:///will/never/be/read").types(String.class, Double.class)
        .name("source").setParallelism(6);
      
      data
        .groupBy(new KeySelector<Tuple2<String,Double>, String>() { 
          public String getKey(Tuple2<String, Double> value) { return value.f0; }

View Full Code Here

Examples of org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()

  public void testGroupedReduceWithSelectorFunctionKeyCombinable() {
    try {
      ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      env.setDegreeOfParallelism(8);
      
      DataSet<Tuple2<String, Double>> data = env.readCsvFile("file:///will/never/be/read").types(String.class, Double.class)
        .name("source").setParallelism(6);
      
      GroupReduceOperator<Tuple2<String, Double>, Tuple2<String, Double>> reduced = data
        .groupBy(new KeySelector<Tuple2<String,Double>, String>() { 
          public String getKey(Tuple2<String, Double> value) { return value.f0; }

View Full Code Here

Examples of org.apache.flink.api.java.ExecutionEnvironment.readCsvFile()

        return;
      }
      
      ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
      
      DataSet<Tuple2<Long, Long>> input = env.readCsvFile(args[0])
          .fieldDelimiter('\t').types(Long.class, Long.class);
      
      DataSet<Tuple2<Long, Long>> result = input.map(
          new MapFunction<Tuple2<Long,Long>, Tuple2<Long,Long>>() {
            public Tuple2<Long, Long> map(Tuple2<Long, Long> value){

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.