Examples of PageDB

com.flaptor.hounder.crawler.pagedb.PageDB
The PageDB implements a database of pages. It can be read in url order or in md5 order (md5 hash of the url), which is close to random order. It also takes care of various statistics, like number of pages @author Flaptor Development Team

Examples of com.flaptor.hounder.crawler.pagedb.PageDB

            FileUtil.deleteDir(catchDir);
            if (!catchdb.rename(catchDir)) {
                throw new IOException("Unable to rename the catchdb.tmp because I couldn't remove a previous catchdb");
            }
        }
        PageDB tmp = catchdb;
        newCatcher();
        return tmp;
    }

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.