Package cascalog

Examples of cascalog.StdoutTap

59
60
61
62
63
64
65
66
67
68
69
  public static void main( String[] args ) {
    Tap inputTap = new Hfs( new TextDelimited(
                                new Fields("docid", "body"), "\t" ),
                            args[0] );
    Tap outputTap = new StdoutTap();

    // create the flow
    Flow simhashFlow = Simhash.simhash(inputTap, outputTap,
                                       2, // combine n-th lowest minhashes (e.g. 2)
                                       SimpleSimhash.Tokenizer.class);
View Full Code Here
42
43
44
45
46
47
48
49
50
51
52
  public static void main( String[] args ) {
    Tap inputTap = new Hfs( new TextDelimited(
                                new Fields("docid", "body"), "  " ),
                            args[0] );
    Tap outputTap = new StdoutTap();

    // create the flow
    Flow simhashFlow = Simhash.simhash(inputTap, outputTap, 1, HtmlText.tokenizer(3));
    simhashFlow.complete(); // or add to your Cascade, etc
  }
View Full Code Here
TOP

Related Classes of cascalog.StdoutTap

  • simhash.examples.HtmlSimhash
  • simhash.examples.SimpleSimhash
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.