Examples of com.ontometrics.scraper.extraction.DefaultFieldExtractor

Package com.ontometrics.scraper.extraction

Examples of com.ontometrics.scraper.extraction.DefaultFieldExtractor

com.ontometrics.scraper.extraction.DefaultFieldExtractor
Provides a means of pulling fields out of a page.
This extractor will work on tables and on DLs. The tables have to have 2 columns (TDs). This will take the first as the label and the second as the value. Same is done with the DLs: the DT is read as the label and the DD as the value.
One way to use this tool is to just start with this default extractor and then start removing the elements that are not helping. @author Rob

    HtmlExtractor htmlExtractor = html().url(PagedListingTable.getUrl());


    List<Record> records = new ListingDetailScraper().setConvertURLs(true)
        .iterator(pageIterator)
        .listing(new LinkExtractor().source(htmlExtractor))
        .details(new DefaultFieldExtractor().source(htmlExtractor))
        .getRecords();


    assertThat(records.size(), greaterThan(0));


    log.debug("fields = {}", records);

View Full Code Here

TOP

Related Classes of com.ontometrics.scraper.extraction.DefaultFieldExtractor

com.ontometrics.scraper.ListingDetailScraperTest

net.htmlparser.jericho.Element

net.htmlparser.jericho.Segment

net.htmlparser.jericho.Source

net.htmlparser.jericho.Tag

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.