Examples of org.apache.flink.runtime.io.disk.iomanager.BlockChannelReader.readBlock()

Package org.apache.flink.runtime.io.disk.iomanager

Class org.apache.flink.runtime.io.disk.iomanager.BlockChannelReader

Examples of org.apache.flink.runtime.io.disk.iomanager.BlockChannelReader.readBlock()

org.apache.flink.runtime.io.disk.iomanager.BlockChannelReader.readBlock()
Issues a read request, which will asynchronously fill the given segment with the next block in the underlying file channel. Once the read request is fulfilled, the segment will be added to this reader's return queue. @param segment The segment to read the block into. @throws IOException Thrown, when the reader encounters an I/O error. Due to the asynchronous nature of thereader, the exception thrown here may have been caused by an earlier read request.

      
      writer.close();
      
      final BlockChannelReader reader = this.ioManager.createBlockChannelReader(channelID);
      for (int i = 0; i < NUM_IOS; i++) {
        reader.readBlock(memSeg);
        memSeg = reader.getNextReturnedSegment();
        
        for (int pos = 0; pos < memSeg.size(); pos += 4) {
          if (memSeg.getInt(pos) != i) {
            Assert.fail("Read memory segment contains invalid data.");

View Full Code Here

        memSegs.add(writer.getNextReturnedSegment());
      }
      
      final BlockChannelReader reader = this.ioManager.createBlockChannelReader(channelID);
      while(!memSegs.isEmpty()) {
        reader.readBlock(memSegs.remove(0));
      }
      
      for (int i = 0; i < NUM_IOS; i++) {
        final MemorySegment memSeg = reader.getNextReturnedSegment();

View Full Code Here

        for (int pos = 0; pos < memSeg.size(); pos += 4) {
          if (memSeg.getInt(pos) != i) {
            Assert.fail("Read memory segment contains invalid data.");
          }
        }
        reader.readBlock(memSeg);
      }
      
      reader.closeAndDelete();
      
      // get back the memory

View Full Code Here

          readSegments.add(emptyBuffers.take());
        }


        // read the first segment
        MemorySegment firstSeg = readSegments.remove(readSegments.size() - 1);
        reader.readBlock(firstSeg);
        firstSeg = reader.getReturnQueue().take();


        // create the read end reading one less buffer, because the first buffer is already read back
        readEnd = new ReadEnd(firstSeg, emptyBuffers, fullBuffers, reader, readSegments, segmentSize,
          numBuffersSpilled - 1);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.