Examples of DateExtractor

org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor
DateExtractor has four different constructors which each allow for different functionality. The incomingDateFormat ("dd/MMM/yyyy:HH:mm:ss Z" by default) is used to match the date string that gets passed in from the log. The outgoingDateFormat ("yyyy-MM-dd" by default) is used to format the returned string. Different constructors exist for each combination; please use the appropriate respective constructor. Note that any data that exists in the SimpleDateFormat schema can be supported. For example, if you were starting with the default incoming format and wanted to extract just the year, you would use the single string constructor DateExtractor("yyyy"). From pig latin you will need to use aliases to use a non-default format, like define MyDateExtractor org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor("yyyy-MM"); A = FOREACH row GENERATE DateExtractor(dayTime); If a string cannot be parsed, null will be returned and an error message printed to stderr. By default, the DateExtractor uses the GMT timezone. You can use the three-parameter constructor to override the timezone.
org.timedex.extraction.DateExtractor
An app that is able to recognize and extract dates from a sentence. @author Brandon Bell
thredds.inventory.DateExtractor
Knows how to extract a date from a MFile. @author caron @since Jun 26, 2009

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

        assertEquals("2008-09-20", dayExtractor.exec(input));
    }


    @Test
    public void testFailureThenSuccess() throws Exception {
        DateExtractor dayExtractor = new DateExtractor();
        input.set(0,"dud");
        assertEquals(null, dayExtractor.exec(input));
        input.set(0,"20/Sep/2008:23:53:04 -0600");
        assertEquals("2008-09-20", dayExtractor.exec(input));
    }

View Full Code Here

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

        assertEquals("2008-09-20", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputFormatter() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("MM-dd-yyyy");
        input.set(0,"20/Sep/2008:23:53:04 -0600");
        assertEquals("09-20-2008", dayExtractor.exec(input));
    }

View Full Code Here

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

        assertEquals("09-20-2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedInputOutputFormatter() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("dd/MMM/yyyy:HH:mm:ss", "MM~dd~yyyy");
        input.set(0,"20/Sep/2008:23:53:04");
        assertEquals("09~20~2008", dayExtractor.exec(input));
    }

View Full Code Here

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

        assertEquals("09~20~2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputInputFormatterYear() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("dd/MMM/yyyy:HH:mm:ss", "yyyy");
        input.set(0,"20/Sep/2008:23:53:04");
        assertEquals("2008", dayExtractor.exec(input));
    }

View Full Code Here

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

        assertEquals("2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputFormatterYear() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("yyyy");
        input.set(0, "20/Sep/2008:23:53:04 -0600");
        assertEquals("2008", dayExtractor.exec(input));
    }

View Full Code Here

Examples of org.timedex.extraction.DateExtractor

    }
  }
  
  public void writeEventsToDatabase(Heading root, int rank) {
    Stack<String> headingStack = new Stack<String>();
    DateExtractor extractor = new DateExtractor();
    //printHeading(root, "");
    writeEventsToDatabaseHelper(root, headingStack, extractor, rank);
  }

View Full Code Here

Examples of thredds.inventory.DateExtractor

    datasetManager.addDirectoryScan(dirName, suffix, regexpPatternString, subdirs, olderThan, enhanceMode);


    if (dateFormatMark != null) {
      isDate = true;
      if (type == Type.joinExisting) type = Type.joinExistingOne; // tricky
      DateExtractor dateExtractor = (dateFormatMark == null) ? null : new DateExtractorFromName(dateFormatMark, true);
      datasetManager.setDateExtractor(dateExtractor);
    }


 }

View Full Code Here

Examples of thredds.inventory.DateExtractor


    //DatasetScanner d = new DatasetScanner(null, dirName, suffix, regexpPatternString, subdirs, olderThan);
    //datasetManager.addDirectoryScan(d);
    datasetManager.addDirectoryScan(dirName, suffix, regexpPatternString, subdirs, olderThan, null);
    if (runMatcher != null) {
      DateExtractor dateExtractor = new DateExtractorFromName(runMatcher, false);
      datasetManager.setDateExtractor(dateExtractor);
    }
  }

View Full Code Here

Examples of thredds.inventory.DateExtractor

      f.format("  offsetMatcher=%s%n", offsetMatcher); */
  }


  @Override
  protected void buildNetcdfDataset(CancelTask cancelTask) throws IOException {
    DateExtractor dateExtractor = null;
    if (runMatcher != null)
      dateExtractor = new DateExtractorFromName(runMatcher, false); // uses path
    if (dateExtractor == null && dateFormatMark != null)
      dateExtractor = new DateExtractorFromName(dateFormatMark, true);
    fmrc = new Fmrc(datasetManager, new FeatureCollectionConfig());

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.