Package cn.edu.hfut.dmic.webcollector.generator.filter

Examples of cn.edu.hfut.dmic.webcollector.generator.filter.URLRegexFilter

66
67
68
69
70
71
72
73
   
    @Override
    public Generator createGenerator() {

        Generator generator = new FSGenerator(crawlPath);
        generator = new UniqueFilter(new IntervalFilter(new URLRegexFilter(generator, getRegexs())));
        return generator;
    }
View Full Code Here
52
53
54
55
56
57
58
   
   
    @Override
    public Generator createGenerator() {
        Generator generator=new RedisGenerator(tableName, ip, port);
        return new URLRegexFilter(new IntervalFilter(generator),getRegexs());
    }
View Full Code Here
TOP

Related Classes of cn.edu.hfut.dmic.webcollector.generator.filter.URLRegexFilter

  • cn.edu.hfut.dmic.webcollector.crawler.BreadthCrawler
  • cn.edu.hfut.dmic.webcollector.model.CrawlDatum
  • cn.edu.hfut.dmic.webcollector.plugin.redis.RedisCrawler
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.