Examples of cascading.pipe.joiner.BufferJoin

cascading.pipe.joiner.BufferJoin
Class BufferJoiner notifies the Cascading planner that the next {@link cascading.operation.Buffer} instancewill implement a custom join strategy.
Internally this class simply returns {@link Fields#NONE} from {@link #getFieldDeclaration()} as a flag tothe planner.

    Function splitter = new RegexSplitter( new Fields( "num", "char" ), " " );


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );


    Pipe splice = new CoGroup( pipeLower, new Fields( "num" ), pipeUpper, new Fields( "num" ), new BufferJoin() );


    splice = new Every( splice, new InnerJoinTestBuffer( Fields.size( 4 ) ), Fields.RESULTS );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, splice );

View Full Code Here

    Function splitter = new RegexSplitter( new Fields( "num", "char" ), " " );


    Pipe pipeLower = new Each( new Pipe( "lower" ), new Fields( "line" ), splitter );
    Pipe pipeUpper = new Each( new Pipe( "upper" ), new Fields( "line" ), splitter );


    Pipe splice = new CoGroup( pipeLower, new Fields( "num" ), pipeUpper, new Fields( "num" ), new BufferJoin() );


    splice = new Every( splice, Fields.size( 1 ), new Count(), Fields.RESULTS );


    try
      {

View Full Code Here


  protected void init(Pipe[] pipes, Fields[] groupFields, Fields groupRename, MultiBuffer operation) {


    Fields outputFields = groupRename.append(operation.getResultFields());


    Pipe grouped = new CoGroup(pipes, groupFields, null, null, new BufferJoin());


    grouped = new Every(grouped,
        new MultiBufferOperation(groupRename, operation),
        outputFields
    );

View Full Code Here

TOP

Related Classes of cascading.pipe.joiner.BufferJoin

cascading.BufferPipesPlatformTest

com.liveramp.cascading_ext.assembly.MultiGroupBy

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.