Package org.apache.hadoop.mapred.GenWriterThread

Examples of org.apache.hadoop.mapred.GenWriterThread.TokenBucket


      super(conf, input, output, rtc);
      this.rtc = rtc;
      this.replication = (short)conf.getInt(REPLICATION_KEY, DEFAULT_REPLICATION_NUM);
      this.max_size = conf.getLong(FILE_SIZE_KEY, DEFAULT_FILE_SIZE) * 1024 * 1024;
      this.pread = conf.getFloat(READ_PERCENT_KEY, DEFAULT_READ_PERCENT);
      this.tb = new TokenBucket(rtc.data_rate);
      this.id = id;
      this.thread_name = rtc.task_name + "_" + id;
      this.running_type = init_type;
      if (running_type.equals(RUNNING_TYPE.PREPARE)) {
        this.file_prefix = rtc.cur_datanode + thread_name +  "_part";
View Full Code Here

TOP

Related Classes of org.apache.hadoop.mapred.GenWriterThread.TokenBucket

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.