Examples of containsDataKey()

Examples of org.archive.modules.CrawlURI.containsDataKey()

84
85
86
87
88
89
90
91
92
93
94
            saveHeader(curi, latestFetch, A_ETAG_HEADER);
            saveHeader(curi, latestFetch, A_LAST_MODIFIED_HEADER);

            // save reference length (real or virtual)
            long referenceLength;
            if (curi.containsDataKey(A_REFERENCE_LENGTH)) {
                // reuse previous length if available (see FetchHTTP#setSizes).
                referenceLength = (Long) curi.getData().get(A_REFERENCE_LENGTH);
            } else {
                // normally, use content-length
                referenceLength = curi.getContentLength();
View Full Code Here

Examples of org.archive.modules.CrawlURI.containsDataKey()

94
95
96
97
98
99
100
101
102
103
104
        String via = curi.flattenVia();
       
        String digest = curi.getContentDigestSchemeString();

        String sourceTag = curi.containsDataKey(A_SOURCE_TAG)
                ? curi.getSourceTag()
                : null;
            
        StringBuilder buffer = bufLocal.get();
        buffer.setLength(0);
View Full Code Here

Examples of org.archive.modules.CrawlURI.containsDataKey()

121
122
123
124
125
126
127
128
129
130
131
            .append(ArchiveUtils.padTo(
                Integer.toString(curi.getThreadNumber()), 3, '0'))
            .append(" ");
       
        // arcTimeAndDuration
        if(curi.containsDataKey(A_FETCH_COMPLETED_TIME)) {
            long completedTime = curi.getFetchCompletedTime();
            long beganTime = curi.getFetchBeginTime();
            buffer.append(ArchiveUtils.get17DigitDate(beganTime))
                    .append("+")
                    .append(Long.toString(completedTime - beganTime));
View Full Code Here
TOP
Copyright © 2018 www.massapi.com. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.