Examples of StdProductCrawler

org.apache.oodt.cas.crawl.StdProductCrawler

A generic Product Crawler for Products. The Crawler is given a root Product Path and it searches through all directories and sub-directories for .met files, which it uses to determine products to ingest into the file manger. The important .met file fields that this crawler requires are:

FileLocation: directory absolute path to location of product file
Filename: name of the product file to ingest
ProductType: the ProductType that will be sent to the file manager for the product file described by the .met file.

@author mattmann (Chris Mattmann) @author bfoster (Brian Foster)

          crawler = new AutoDetectProductCrawler();
          ((AutoDetectProductCrawler)crawler).
            setMimeExtractorRepo(pgeMetadata.getMetadata(MIME_EXTRACTOR_REPO));        
      }
      else{
        crawler = new StdProductCrawler();
      }


      crawler.setClientTransferer(pgeMetadata
            .getMetadata(INGEST_CLIENT_TRANSFER_SERVICE_FACTORY));
      crawler.setFilemgrUrl(pgeMetadata.getMetadata(INGEST_FILE_MANAGER_URL));

    protected boolean wasPgeSuccessful(int returnCode) {
        return returnCode == 0;
    }


    protected void ingestProducts() throws Exception {
        StdProductCrawler crawler = new StdProductCrawler();
        this.setCrawlerConfigurations(crawler);
        this.runIngestCrawler(crawler, this.getOutputDirs());
    }

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of StdProductCrawler

Examples of org.apache.oodt.cas.crawl.StdProductCrawler

Examples of org.apache.oodt.cas.crawl.StdProductCrawler