Examples of cascading.operation.regex.RegexParser

cascading.operation.regex.RegexParser
Class RegexParser is used to extract a matched regex from an incoming argument value.
Sometimes its useful to parse out a value from a key/value pair in a string, if the key exists. If the key does not exist, returning an empty string instead of failing is typically expected.
The following regex can extract a value from {@code key1=value1&key2=value2} if key1 exists, otherwise anempty string is returned:
```
(?<=key1=)[^&]*|$
```

    {
    Tap source = getPlatform().getTextFile( "foosource" );


    Pipe pipe = new Pipe( "map" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Pipe( "middle", pipe );
    pipe = new Each( pipe, new Fields( "ip" ), new TestFunction( new Fields( "test" ), null ), Fields.ALL );


    pipe = new GroupBy( "reduce", pipe, new Fields( "ip" ) );

View Full Code Here

    {
    Tap source = getPlatform().getTextFile( "foosource" );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Each( pipe, new Fields( "ip" ), new TestFunction( new Fields( "test" ), null ), Fields.ALL );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );
    pipe = new Pipe( "first", pipe );

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here

    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    { // job 1
    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( pipe );
    }


    { // job 2

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( "checkpoint", pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( "checkpoint", pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );


    pipe = new Checkpoint( "checkpoint", pipe );

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( "checkpoint", pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here


    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( "checkpoint", pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here

    {
    Tap source = getPlatform().getTextFile( new Fields( "offset", "line" ), inputFileApache );


    Pipe pipe = new Pipe( "test" );


    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Checkpoint( pipe );


    pipe = new GroupBy( pipe, new Fields( "ip" ) );

View Full Code Here

0 1 2 3 4 5 6

TOP

Related Classes of cascading.operation.regex.RegexParser

bixo.examples.webmining.DemoWebMiningWorkflow

cascading.BasicPipesPlatformTest

cascading.BasicTrapPlatformTest

cascading.FieldedPipesPlatformTest

cascading.flow.AssemblyPlannerPlatformTest

cascading.flow.FlowStrategiesPlatformTest

cascading.flow.hadoop.BuildJobsHadoopPlatformTest

cascading.flow.SubAssemblyPlatformTest$TestAssembly

cascading.operation.assertion.BuildAssertionsPlatformTest

cascading.operation.debug.BuildDebugPlatformTest

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.