Examples of HFileOutputFormat

org.apache.hadoop.hbase.mapreduce.HFileOutputFormat
Writes HFiles. Passed KeyValues must arrive in order. Writes current time as the sequence id for the file. Sets the major compacted attribute on created hfiles. Calling write(null,null) will forcibly roll all HFiles being written.
Using this class as part of a MapReduce job is best done using {@link #configureIncrementalLoad(Job,HTable)}. @see KeyValueSortReducer

Examples of org.apache.hadoop.hbase.mapreduce.HFileOutputFormat

    // output location up-front. This method will also be called as
    // part of the Hadoop call sequence when the job is launched. So
    // implementations should ensure that this method can be called
    // multiple times without inconsistent side effects. 
    public OutputFormat getOutputFormat() throws IOException {
        HFileOutputFormat outputFormat = new HFileOutputFormat();
        return outputFormat;
    }

View Full Code Here

Examples of org.apache.hadoop.hbase.mapreduce.HFileOutputFormat

     * it imports the pact-hbase project even if it is not included in the standard profile (hadoop_v1)
     */
    final TaskAttemptID attemptId = new TaskAttemptID(this.jtID, this.jobId, TaskType.MAP, taskNumber - 1, 0);


    this.context = new org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl(this.hadoopConfig, attemptId);
    final HFileOutputFormat outFormat = new HFileOutputFormat();
    try {
      this.writer = outFormat.getRecordWriter(this.context);
    } catch (InterruptedException iex) {
      throw new IOException("Opening the writer was interrupted.", iex);
    }
  }

View Full Code Here

Examples of org.apache.hadoop.hbase.mapreduce.HFileOutputFormat

     * it imports the pact-hbase project even if it is not included in the standard profile (hadoop_v1)
     */
    final TaskAttemptID attemptId = new TaskAttemptID(this.jtID, this.jobId, TaskType.MAP, taskNumber - 1, 0);


    this.context = new org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl(this.hadoopConfig, attemptId);
    final HFileOutputFormat outFormat = new HFileOutputFormat();
    try {
      this.writer = outFormat.getRecordWriter(this.context);
    } catch (InterruptedException iex) {
      throw new IOException("Opening the writer was interrupted.", iex);
    }
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.