Examples of org.apache.hadoop.mapreduce.RecordReader.initialize()

Class org.apache.hadoop.mapreduce.RecordReader

Examples of org.apache.hadoop.mapreduce.RecordReader.initialize()

org.apache.hadoop.mapreduce.RecordReader.initialize()
Called once at initialization. @param split the split that defines the range of records to read @param context the information about the task @throws IOException @throws InterruptedException


    // Switch the active context for the RecordReader...
    Configuration conf2 = new Configuration();
    conf2.set(DUMMY_KEY, "STATE2");
    TaskAttemptContext context2 = new TaskAttemptContextImpl(conf2, taskId);
    rr.initialize(split, context2);


    // And verify that the new context is updated into the child record reader.
    assertEquals("Invalid secondary dummy key value", "STATE2",
      rr.getCurrentKey().toString());
  }

View Full Code Here

    CombineFileSplit split = new CombineFileSplit(files, lengths);
    RecordReader rr = inputFormat.createRecordReader(split, context);
    assertTrue("Unexpected RR type!", rr instanceof CombineFileRecordReader);


    // first initialize() call comes from MapTask. We'll do it here.
    rr.initialize(split, context);


    // First value is first filename.
    assertTrue(rr.nextKeyValue());
    assertEquals("file1", rr.getCurrentValue().toString());

View Full Code Here

      RecordReader reader = readers.get(i);
      if (i % PRINT_EVERY == 0) {
        System.err.println("initialize RecordReader " + i + " of " +
            splits.size());
      }
      reader.initialize(split, taskContext);
    }


    for (int i = 0; i < readers.size(); ++i) {
      RecordReader reader = readers.get(i);
      if (i % PRINT_EVERY == 0) {

View Full Code Here

0 1 2 3

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.