Examples of org.apache.cassandra.utils.PureJavaCrc32

org.apache.cassandra.utils.PureJavaCrc32
A pure-java implementation of the CRC32 checksum that uses the same polynomial as the built-in native CRC32. This is to avoid the JNI overhead for certain uses of Checksumming where many small pieces of data are checksummed in succession. The current version is ~10x to 1.8x as fast as Sun's native java.util.zip.CRC32 in Java 1.6 @see java.util.zip.CRC32 This class is copied from hadoop-commons project. (The initial patch added PureJavaCrc32 was HADOOP-6148)

            // list (otherwise we'll just start replay from the first flush position that we do have, which is not correct).
            ReplayPosition rp = ReplayPosition.getReplayPosition(cfs.getSSTables());
            cfPositions.put(cfs.metadata.cfId, rp);
        }
        this.globalPosition = Ordering.from(ReplayPosition.comparator).min(cfPositions.values());
        this.checksum = new PureJavaCrc32();
    }

View Full Code Here


            // Map the segment, extending or truncating it to the standard segment size
            logFileAccessor.setLength(DatabaseDescriptor.getCommitLogSegmentSize());


            buffer = logFileAccessor.getChannel().map(FileChannel.MapMode.READ_WRITE, 0, DatabaseDescriptor.getCommitLogSegmentSize());
            checksum = new PureJavaCrc32();
            bufferStream = new DataOutputStream(new ChecksummedOutputStream(new ByteBufferOutputStream(buffer), checksum));
            buffer.putInt(CommitLog.END_OF_SEGMENT_MARKER);
            buffer.position(0);
            needsSync = true;
            sync();

View Full Code Here

0 1 2 3

TOP

Related Classes of org.apache.cassandra.utils.PureJavaCrc32

org.apache.cassandra.db.commitlog.CommitLog

org.apache.cassandra.db.commitlog.CommitLogDescriptor

org.apache.cassandra.db.commitlog.CommitLogReplayer

org.apache.cassandra.db.commitlog.CommitLogSegment

org.apache.cassandra.io.util.DataIntegrityMetadata$ChecksumValidator

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.