Examples of org.apache.flink.runtime.io.disk.iomanager.HeaderlessChannelReaderInputView

Package org.apache.flink.runtime.io.disk.iomanager

Examples of org.apache.flink.runtime.io.disk.iomanager.HeaderlessChannelReaderInputView

org.apache.flink.runtime.io.disk.iomanager.HeaderlessChannelReaderInputView
A {@link org.apache.flink.core.memory.DataInputView} that is backed by a{@link BlockChannelReader}, making it effectively a data input stream. This view is similar to the {@link ChannelReaderInputView}, but does not expect a header for each block, giving a direct stream abstraction over sequence of written blocks. It therefore requires specification of the number of blocks and the number of bytes in the last block.

      if (this.externalInView != null) {
        this.externalInView.close();
      }
      
      final BlockChannelReader reader = this.ioManager.createBlockChannelReader(this.writer.getChannelID());
      this.externalInView = new HeaderlessChannelReaderInputView(reader, this.fullSegments, this.blockCount, this.numBytesInLastSegment, false);
      return this.externalInView;
    }
  }

View Full Code Here

      final List<MemorySegment> segments = new ArrayList<MemorySegment>(2);
      segments.add(getNextBuffer());
      segments.add(getNextBuffer());
      
      final BlockChannelReader inReader = this.ioManager.createBlockChannelReader(p.getBuildSideChannel().getChannelID());
      final ChannelReaderInputView inView = new HeaderlessChannelReaderInputView(inReader, segments,
            p.getBuildSideBlockCount(), p.getLastSegmentLimit(), false);
      final ChannelReaderInputViewIterator<BT> inIter = new ChannelReaderInputViewIterator<BT>(inView, 
          this.availableMemory, this.buildSideSerializer);
      final TypeComparator<BT> btComparator = this.buildSideComparator;
      BT rec = this.buildSideSerializer.createInstance();

View Full Code Here

TOP

Related Classes of org.apache.flink.runtime.io.disk.iomanager.HeaderlessChannelReaderInputView

org.apache.flink.runtime.io.disk.SpillingBuffer

org.apache.flink.runtime.operators.hash.MutableHashTable

java.io.EOFException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.