Examples of org.lilyproject.repository.api.RecordId.toBytes()

Class org.lilyproject.repository.api.RecordId

Examples of org.lilyproject.repository.api.RecordId.toBytes()

org.lilyproject.repository.api.RecordId.toBytes()
Returns the byte representation of this record id.
The bytes representation of record id's is designed such that they would provide a meaningful row sort order in HBase, and be usable for scan operations. The encoding is such that when an ID in un-encoded form is a prefix of another ID, it remains a prefix when encoded as bytes. This allows for prefix-scanning a range of records. (Of course, this only applies to user-specified IDs, not to UUID's).
The format for a master record id is as follows:
```
{identifier byte}{basic byte representation}
```
Where the identifier byte is (byte)0 for a USER record id, and (byte)1 for a UUID record id.
The {identifier byte} is put at the start because otherwise UUIDs and USER-id's would be intermingled, preventing meaningful scan operations on USER id's.

In case there are variant properties:
- For USER record id's, a zero byte (NULL character) is appended to mark the end of the master record id. By consequence, use of the (non-printable) zero byte is forbidden in the master record id. The reason for choosing the zero byte is because it sorts before any other byte: this makes that the record id's of variants and their master will be sorted together, without any other master record in between. Any other master record id would have a byte larger than zero at that position.
- For UUID record id's, there is no separator byte between the master and the properties, since the UUID has a fixed length of 16 bytes. This also makes that the variant properties do not influence the sort order among the master record id's
The variant properties themselves are written as:
```
({key string utf8 length}{key string in utf8}{value string utf8 length}{value string in utf8})*
```
There is no separator between the key-value pairs, as this is not needed. The key-value pairs are always sorted by key.

            RecordId recordId = record.getId();
            if (recordId == null) {
                recordId = idGenerator.newRecordId();
            }


            byte[] rowId = recordId.toBytes();


            try {
                FieldTypes fieldTypes = typeManager.getFieldTypesSnapshot();


                long version = 1L;

View Full Code Here

                originalNextFields = filterMutableFields(originalNextRecord.getFields(), fieldTypes);
            } catch (VersionNotFoundException e) {
                // There is no next version of the record
            }


            Put put = new Put(recordId.toBytes());
            Set<BlobReference> referencedBlobs = new HashSet<BlobReference>();
            Set<BlobReference> unReferencedBlobs = new HashSet<BlobReference>();


            RecordEvent recordEvent = new RecordEvent();
            recordEvent.setType(Type.UPDATE);

View Full Code Here

                                                       SchemaId vtag) throws IOException {


        final RecordId master = parentRecordId.getRecordId().getMaster();


        final Query query = new Query();
        query.addEqualsCondition("dependency_masterrecordid", master.toBytes());
        if (vtag != null) {
            query.addEqualsCondition("dependant_vtag", vtag.getBytes());
        }


        query.setIndexFilter(new DerefMapIndexFilter(parentRecordId.getRecordId().getVariantProperties(), fields));

View Full Code Here

        if (filter.getRecordId() == null) {
            throw new IllegalArgumentException("Record ID should be specified in RecordIdPrefixFilter");
        }


        RecordId recordId = filter.getRecordId();
        byte[] rowKeyPrefix = recordId.toBytes();


        return new PrefixFilter(rowKeyPrefix);
    }
}

View Full Code Here


        // Type manager
        zk = new StateWatchingZooKeeper(zkConnectionString, zkSessionTimeout);
        typeMgr = new HBaseTypeManager(idGenerator, conf, zk, new HBaseTableFactoryImpl(conf));


        Get get = new Get(recordId.toBytes());
        get.setMaxVersions();
        Result row = table.get(get);


        NavigableMap<byte[], NavigableMap<byte[], NavigableMap<Long,byte[]>>> root = row.getMap();

View Full Code Here


    @Test
    public void testIdGeneratorDefault() {
        IdGenerator idGenerator = new IdGeneratorImpl();
        RecordId recordId = idGenerator.newRecordId();
        assertEquals(recordId, idGenerator.fromBytes(recordId.toBytes()));
        assertEquals(recordId, idGenerator.fromString(recordId.toString()));
    }


    @Test
    public void testUUID() {

View Full Code Here

        // Test string representation
        assertEquals(newRecordId, idGenerator.fromString(userRecordIDString));
        assertEquals(userRecordIDString, idGenerator.fromString(userRecordIDString).toString());


        // Test bytes representation cycle
        byte[] userRecordIdBytes = newRecordId.toBytes();
        assertArrayEquals(userRecordIdBytes, idGenerator.fromBytes(userRecordIdBytes).toBytes());


        assertEquals(userRecordIDString, idGenerator.fromBytes(userRecordIdBytes).toString());


        // Test the bytes representation is really what we expect it to be

View Full Code Here

        assertEquals(variantRecordIdString, variantRecordId.toString());
        assertEquals(variantRecordId, idGenerator.fromString(variantRecordIdString));


        // Test round-trip string & bytes conversion
        assertEquals(variantRecordId, idGenerator.fromString(variantRecordId.toString()));
        assertEquals(variantRecordId, idGenerator.fromBytes(variantRecordId.toBytes()));


        // Test bytes representation is really what we expect it to be
        byte[] masterIdBytes = new byte[] {
                /* uuid type marker */1,
                /* uuid bytes */-46, 124, -37, 110, -82, 109, 17, -49, -106, -72, 68, 69, 83, 84, 0, 0 };

View Full Code Here

                /* length of value (vint) */, 3
                /* the value (ABC) */, 65, 66, 67 };


        RecordId variantId = idGenerator.newRecordId(idGenerator.fromBytes(masterIdBytes),
                Collections.singletonMap("X", "ABC"));
        assertArrayEquals(variantIdBytes, variantId.toBytes());
    }


    @Test
    public void testUUUIDWithMultipleProperties() {
        IdGenerator idGenerator = new IdGeneratorImpl();

View Full Code Here

        assertEquals(variantRecordIdString, variantRecordId.toString());
        assertEquals(variantRecordId, idGenerator.fromString(variantRecordIdString));


        // Test round-trip string & bytes conversion
        assertEquals(variantRecordId, idGenerator.fromString(variantRecordIdString));
        assertEquals(variantRecordId, idGenerator.fromBytes(variantRecordId.toBytes()));
    }


    @Test
    public void testUserIdWithVariantProperties() {
        IdGenerator idGenerator = new IdGeneratorImpl();

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.