Package org.apache.hadoop.chukwa.extraction.demux.processor.reducer

Examples of org.apache.hadoop.chukwa.extraction.demux.processor.reducer.ReduceProcessor


        reporter.incrCounter("DemuxReduceInput", key.getReduceType()
            + " total distinct keys", 1);

        String defaultProcessor = Demux.jobConf.get(
            "chukwa.demux.reducer.default.processor", null);
        ReduceProcessor processor = ReduceProcessorFactory.getProcessor(
            key.getReduceType(), defaultProcessor);

        processor.process(key, values, chukwaOutputCollector, reporter);

        if (log.isDebugEnabled()) {
          duration = System.currentTimeMillis() - duration;
          log.debug("Demux:Reduce, dataType:" + key.getReduceType()
              + " duration:" + duration);
View Full Code Here


        if (processClass_tmps.length != 2)
          processClass = defaultProcessor_classname;
        else
          processClass = processClass_tmps[1];

        ReduceProcessor processor = ReduceProcessorFactory.getProcessor(processClass);
        System.out.println(processor.getClass().getName());
        processor.process(key, values, chukwaOutputCollector, reporter);

        if (log.isDebugEnabled()) {
          duration = System.currentTimeMillis() - duration;
          log.debug("Demux:Reduce, dataType:" + key.getReduceType()
                  + " duration:" + duration);
View Full Code Here

TOP

Related Classes of org.apache.hadoop.chukwa.extraction.demux.processor.reducer.ReduceProcessor

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.