Examples of eu.stratosphere.api.java.ExecutionEnvironment.execute()

Class eu.stratosphere.api.java.ExecutionEnvironment

Examples of eu.stratosphere.api.java.ExecutionEnvironment.execute()

eu.stratosphere.api.java.ExecutionEnvironment.execute()
Triggers the program execution. The environment will execute all parts of the program that have resulted in a "sink" operation. Sink operations are for example printing results ( {@link DataSet#print()}, writing results (e.g. {@link DataSet#writeAsText(String)}, {@link DataSet#write(eu.stratosphere.api.common.io.FileOutputFormat,String)}, or other generic data sinks created with {@link DataSet#output(eu.stratosphere.api.common.io.OutputFormat)}.
The program execution will be logged and displayed with a generated default name. @return The result of the job execution, containing elapsed time and accumulators. @throws Exception Thrown, if the program executions fails.

            .aggregate(Aggregations.SUM, 0)
            .and(Aggregations.MAX, 1)
            .project(0, 1).types(Integer.class, Long.class);
        
        aggregateDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "231,6\n";
      }
      case 2: {

View Full Code Here

        DataSet<Tuple2<Long, Integer>> aggregateDs = ds.groupBy(1)
            .aggregate(Aggregations.SUM, 0)
            .project(1, 0).types(Long.class, Integer.class);
        
        aggregateDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "1,1\n" +
        "2,5\n" +
        "3,15\n" +

View Full Code Here

            .aggregate(Aggregations.MIN, 0)
            .aggregate(Aggregations.MIN, 0)
            .project(0).types(Integer.class);
        
        aggregateDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "1\n";
      }
      default:

View Full Code Here

          verticesWithNewComponents.join(iteration.getSolutionSet()).where(0).equalTo(0)
          .flatMap(new MinimumIdFilter());
      
      iteration.closeWith(updatedComponentId, updatedComponentId).writeAsText(resultPath);
      
      env.execute();
      
      return resultPath;
    }
  }

View Full Code Here

                return false;
              }
            });
        
        filterDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "\n";
      }
      case 2: {

View Full Code Here

              public boolean filter(Tuple3<Integer, Long, String> value) throws Exception {
                return true;
              }
            });
        filterDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "1,1,Hi\n" +
            "2,2,Hello\n" +
            "3,2,Hello world\n" +

View Full Code Here

              public boolean filter(Tuple3<Integer, Long, String> value) throws Exception {
                return value.f2.contains("world");
              }
            });
        filterDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "3,2,Hello world\n" +
            "4,3,Hello world, how are you?\n";

View Full Code Here

              public boolean filter(Tuple3<Integer, Long, String> value) throws Exception {
                return (value.f0 % 2) == 0;
              }
            });
        filterDs.writeAsCsv(resultPath);
        env.execute();
        
        // return expected result
        return "2,2,Hello\n" +
            "4,3,Hello world, how are you?\n" +
            "6,3,Luke Skywalker\n" +

View Full Code Here

              public boolean filter(String value) throws Exception {
                return value.startsWith("H");
              }
            });
        filterDs.writeAsText(resultPath);
        env.execute();
        
        // return expected result
        return "Hi\n" +
             "Hello\n" + 
             "Hello world\n" +

View Full Code Here

              public boolean filter(CustomType value) throws Exception {
                return value.myString.contains("a");
              }
            });
        filterDs.writeAsText(resultPath);
        env.execute();
        
        // return expected result
        return "3,3,Hello world, how are you?\n" +
            "3,4,I am fine.\n" +
            "3,5,Luke Skywalker\n";

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.