Examples of joshua.util.io.LineReader

joshua.util.io.LineReader
This class provides an Iterator interface to a BufferedReader. This covers the most common use-cases for reading from files without ugly code to check whether we got a line or not. @author wren ng thornton @version $LastChangedDate: 2009-03-26 15:06:57 -0400 (Thu, 26 Mar 2009) $


    // instantiate them.
    int wordCounter = 0;
    int sentenceCounter = 0;


    LineReader lineReader = new LineReader(inputFilename);


    for (String phraseString : lineReader) {
      int[] words = vocab.getIDs(phraseString);
//      String[] wordStrings = phraseString.split("\\s+");
//      int[] words = new int[wordStrings.length];

View Full Code Here

    int[][] alignedTargetIndices = new int[sourceCorpus.size()][];


    // set the values of the arrays based on the alignments file...
    int sentenceCounter = 0;


    LineReader lineReader = new LineReader(alignmentsFilename);


    for (String line : lineReader) {


      // Start index of current source sentence
      int sourceOffset = sourceCorpus.getSentencePosition(sentenceCounter);

View Full Code Here

0 1 2 3

TOP

Related Classes of joshua.util.io.LineReader

joshua.corpus.suffix_array.SuffixArrayFactory

joshua.corpus.vocab.DefaultSymbol

joshua.corpus.vocab.Vocabulary

joshua.decoder.DecoderFactory

joshua.decoder.DecoderThread

joshua.decoder.ff.lm.ArpaFile

joshua.decoder.ff.lm.buildin_lm.LMGrammarJAVA

joshua.decoder.ff.lm.distributed_lm.LMGrammarRemote

joshua.decoder.ff.lm.distributed_lm.LMServer

joshua.decoder.ff.tm.GrammarReader

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.