List of encodePartition() Examples

Examples of encodePartition()

com.linkedin.camus.etl.Partitioner.encodePartition()
Encode partition values into a string, to be embedded into the working filename. Encoded values cannot use '/' or ':'. Use partition values in the etlKey. Values should be extracted from the Record and given to the CamusWrapper. The return of the method will be passed as the "encodedPartition" parameter of generatePartitionedPath() below. @param context The JobContext. @param etlKey The EtlKey containing values extracted from the Record by the MessageDecoder. @return A string that encodes the partitioning values.
com.linkedin.camus.etl.kafka.partitioner.DefaultPartitioner.encodePartition()

Examples of com.linkedin.camus.etl.Partitioner.encodePartition()

        job.getConfiguration().setBoolean(ETL_RUN_TRACKING_POST, value);
    }


    public static String getWorkingFileName(JobContext context, EtlKey key) throws IOException {
        Partitioner partitioner = getPartitioner(context, key.getTopic());
        return partitioner.getWorkingFileName(context, key.getTopic(), key.getLeaderId(), key.getPartition(), partitioner.encodePartition(context, key));
    }
    
    public static void setDefaultPartitioner(JobContext job, Class<?> cls) {
      job.getConfiguration().setClass(ETL_DEFAULT_PARTITIONER_CLASS, cls, Partitioner.class);
    }

View Full Code Here

Examples of com.linkedin.camus.etl.kafka.partitioner.DefaultPartitioner.encodePartition()

        Job testJob = new Job(new Configuration());


        DefaultPartitioner testPartitioner = new DefaultPartitioner();
        testPartitioner.setConf(testConfiguration);


        String actualResult = testPartitioner.encodePartition(testJob, testEtlKey);
        String expectedResult = "1400547600000";


        assertTrue(actualResult.equals(expectedResult));


    }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.