Examples of Merge

cascading.pipe.Merge
The Merge Pipe allows for multiple branches, with the same fields to be spliced back into a single stream.
The behavior is similar to the {@link GroupBy} merging features, but Merge does not perform any grouping orsorting on keys. Thus, when using a MapReduce platform, no Reducer is required.
Merge is non-blocking and performs no processing. Any number of branches and merges may be performed in a {@link cascading.flow.Flow} without triggering any additional MapReduce jobs on the Hadoop platform.
Unlike {@link HashJoin}, no preference need be made for left-hand or right-hand sided-ness of streams in relation to their sizes. @see GroupBy
com.projity.algorithm.Merge
Merge is a functor which groups time intervals together and calls a vistor object on the resulting merged intervals You can specify a comparator as well to determine whether two intervals are mergeable
javax.help.Merge
Common superclass for all merge types @author Richard Gregor @version 1.6 10/30/06
org.apache.accumulo.core.util.Merge
org.apache.jackrabbit.jcr2spi.operation.Merge
Merge...
org.h2.command.dml.Merge
This class represents the statement MERGE
org.jbpm.graph.node.Merge
TODO is the merge node useful ? i don't think the merge node is useful because every node has an implicit merge in front of it (= multiple transitions can arrive in the same node). maybe we should just leave this in for the sake of workflow patterns ?
org.lealone.command.dml.Merge
This class represents the statement MERGE
ptolemy.domains.de.lib.Merge
A timed merge actor for the DE domain. It merges a set of input signals into a single output signal based on the order of the tags associated with the events of signals. A tag is a tuple of a timestamp (as double) and a microstep or index (as non-negative integer). Tags have a lexicographic order.
This actor has an input port (a multiport) and an output port (a single port). The types of the ports are undeclared and will be resolved by the type resolution mechanism, with the constraint that the output type must be greater than or equal to the input type.
There is a boolean parameter discardEvents associated with this actor, which decides how to handle simultaneously available inputs. Each time this actor fires, it reads the first available tokens from an input channel and sends them to the output port. If the discardEvents parameter is configured to true, then this actor discards all the remaining inputs in the rest of channels. Otherwise, this actor requests refirings at the current time until no more events are left in the channels. By default, the discardEvents parameter is false. @author Edward A. Lee, Haiyang Zheng @version $Id: Merge.java,v 1.36 2005/10/28 20:18:11 cxh Exp $ @since Ptolemy II 0.4 @Pt.ProposedRating Green (hyzheng) @Pt.AcceptedRating Green (hyzheng)

Examples of cascading.pipe.Merge

    if( isMerge && isGroup )
      join = new GroupBy( Pipe.pipes( pipeLower, pipeUpper ), numLHS );
    else if( !isMerge && isGroup )
      join = new CoGroup( pipeLower, numLHS, pipeUpper, numRHS, declaredFields, new InnerJoin() );
    else if( isMerge && !isGroup )
      join = new Merge( pipeLower, pipeUpper );
    else
      join = new HashJoin( pipeLower, numLHS, pipeUpper, numRHS, declaredFields, new InnerJoin() );


    Flow flow = null;
    try

View Full Code Here

Examples of cascading.pipe.Merge

    {
    Pipe pipe = new Pipe( "foo" );


    pipe = new Each( pipe, new Fields( "a" ), new Identity() );


    pipe = new Merge( pipe, new Pipe( "bar" ) );


    assertEqualsTrace( "cascading.TraceTest.testPipeMerge(TraceTest.java", pipe.getTrace() );
    }

View Full Code Here

Examples of cascading.pipe.Merge

    Tap sink = getPlatform().getTextFile( new Fields( "line" ), getOutputPath( "insensitivegrouping" + NONDETERMINISTIC ), SinkMode.REPLACE );


    Pipe pipeLower = new Pipe( "lower" );
    Pipe pipeUpper = new Pipe( "upper" );


    Pipe merge = new Merge( pipeLower, pipeUpper );


    Fields charFields = new Fields( "char" );
    charFields.setComparator( "char", new LowerComparator() );


    Pipe splice = new GroupBy( "groupby", merge, charFields );

View Full Code Here

Examples of cascading.pipe.Merge

//    Pipe joined = new CoGroup( messages, new Fields( "id" ), people, new Fields( "id2" ) );
    Pipe joined = new HashJoin( lhs, new Fields( "id" ), rhs, new Fields( "id2" ) );


    Pipe pruned = new Each( joined, new Fields( "id2" ), new Identity(), Fields.RESULTS );
//    pruned = new Checkpoint( pruned );
    Pipe merged = new Merge( pruned, rhs );
    Pipe grouped = new GroupBy( merged, new Fields( "id2" ) );
//    Pipe grouped = new GroupBy( Pipe.pipes(  pruned, people  ), new Fields( "id2" ) );
    Aggregator count = new Count( new Fields( "count" ) );
    Pipe counted = new Every( grouped, count );

View Full Code Here

Examples of cascading.pipe.Merge

    Tap sink = getPlatform().getTextFile( new Fields( "line" ), getOutputPath( "simplemerge" ), SinkMode.REPLACE );


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );


    flow.complete();

View Full Code Here

Examples of cascading.pipe.Merge


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );
    Pipe pipeOffset = new Each( new Pipe( "offset" ), new Fields( "line" ), splitter );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper, pipeOffset );


    splice = new Each( splice, new Fields( "num", "char" ), new Identity() );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

Examples of cascading.pipe.Merge


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );
    Pipe pipeOffset = new Each( new Pipe( "offset" ), new Fields( "line" ), splitter );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper );


    splice = new Merge( splice, pipeOffset );


    splice = new Each( splice, new Fields( "num", "char" ), new Identity() );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

Examples of cascading.pipe.Merge


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );
    Pipe pipeOffset = new Each( new Pipe( "offset" ), new Fields( "line" ), splitter );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper );


    splice = new Merge( splice, pipeOffset );


    splice = new GroupBy( splice, new Fields( "num" ) );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

Examples of cascading.pipe.Merge


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), new RegexSplitter( new Fields( "num1", "char1" ), " " ) );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), new RegexSplitter( new Fields( "num1", "char1" ), " " ) );
    Pipe pipeOffset = new Each( new Pipe( "offset" ), new Fields( "line" ), new RegexSplitter( new Fields( "num2", "char2" ), " " ) );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper );


    splice = new CoGroup( splice, new Fields( "num1" ), pipeOffset, new Fields( "num2" ) );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

Examples of cascading.pipe.Merge


    Pipe pipeLower = new Each( new Pipe( "lower", pipe ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper", pipe ), new Fields( "line" ), splitter );
    Pipe pipeOffset = new Each( new Pipe( "offset", pipe ), new Fields( "line" ), splitter );


    Pipe splice = new Merge( "merge", pipeLower, pipeUpper );


    //put group before merge to test path counts
    splice = new GroupBy( splice, new Fields( "num" ) );


    splice = new Merge( splice, pipeOffset );


    // this group has its incoming paths counted, gated by the previous group
    splice = new GroupBy( splice, new Fields( "num" ) );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.