Examples of TokenSequence

cc.mallet.types.TokenSequence
A representation of a piece of text, usually a single word, to which we can attach properties.
com.antlersoft.query.environment.TokenSequence
Represents a sequence of tokens that are interpreted together, and optionally the object that represents the result of interpreting them.
A token sequence can be converted to a string form, which can be converted back into an equivalent token sequence by feeding it back to the parserenvironment.
@author Michael A. MacDonald
org.netbeans.api.lexer.TokenSequence
uk.ac.cam.ch.wwmm.oscar3.recogniser.document.TokenSequence
A tokenised representation of a piece of text, as made by the Tokeniser class. @author ptc24

Examples of uk.ac.cam.ch.wwmm.oscar3.recogniser.document.TokenSequence

        for(LatticeCell prev : cell.prev) {
          System.out.println("\t<-\t" + prev);
        }
      }*/
      
      TokenSequence tokSeq = lattice.tokSeq;
      List<Token> tokens = tokSeq.getTokens();
      List<List<Token>> sentences = SentenceSplitter.makeSentences(tokens);
      Set<String> existingRelations = new HashSet<String>();
      for(List<Token> sentence : sentences) {
        /*NewGeniaRunner.runGenia(sentence);
        List<NamedEntity> bioNEs = NewGeniaRunner.getGeniaNEs(sentence);

View Full Code Here

Examples of uk.ac.cam.ch.wwmm.oscar3.recogniser.document.TokenSequence

    
    DFARelationFinder relf = DFARelationFinder.getInstance();
    List<Lattice> lattices = Lattice.buildLattices(procDoc, safDoc.getRootElement());
    
    for(Lattice lattice : lattices) {
      TokenSequence tokSeq = lattice.tokSeq;
      List<Token> tokens = tokSeq.getTokens();
      List<List<Token>> sentences = SentenceSplitter.makeSentences(tokens);
      Set<String> existingRelations = new HashSet<String>();
      for(List<Token> sentence : sentences) {
        List<Relation> relations = relf.getRelations(sentence, "", lattice, null);
        if(relations.size() > 0) {

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.