Examples of BufferedTokenStream

com.google.jstestdriver.token.BufferedTokenStream
Acts as a buffer for an Iterator. @author corysmith@google.com (Cory Smith)
org.antlr.v4.runtime.BufferedTokenStream
This implementation of {@link TokenStream} loads tokens from a{@link TokenSource} on-demand, and places the tokens in a buffer to provideaccess to any previous token by index.
This token stream ignores the value of {@link Token#getChannel}. If your parser requires the token stream filter tokens to only those on a particular channel, such as {@link Token#DEFAULT_CHANNEL} or{@link Token#HIDDEN_CHANNEL}, use a filtering token stream such a {@link CommonTokenStream}.

Examples of com.google.jstestdriver.token.BufferedTokenStream

                       id,
                       ConcreteToken.from("="),
                       html,
                       ConcreteToken.from("*/"));
    
    BufferedTokenStream stream = new BufferedTokenStream(tokens.iterator());
    
    assertEquals(new Nodes().add(new HtmlDocGlobalNode(id, Lists.newArrayList(html))), 
                 new HtmlDocParser().parse(stream));
  }

View Full Code Here

Examples of com.google.jstestdriver.token.BufferedTokenStream

                       ConcreteToken.from("="),
                       html,
                       ConcreteToken.from("*/"),
                       blockEndToken);
    
    BufferedTokenStream stream = new BufferedTokenStream(tokens.iterator());
    
    assertEquals(new Nodes().add(new TextNode(functionToken))
                            .add(new TextNode(blockStartToken))
                            .add(new HtmlDocNestedNode(id, Lists.newArrayList(html)))
                            .add(new TextNode(blockEndToken)),

View Full Code Here

Examples of com.google.jstestdriver.token.BufferedTokenStream

        barToken,
        equalsToken,
        htmlToken,
        endDocToken,
        endBlockToken);
    BufferedTokenStream stream = new BufferedTokenStream(tokens.iterator());


    assertEquals(new Nodes().add(new TextNode(setUpToken))
                            .add(new TextNode(equalsToken))
                            .add(new TextNode(functionToken))
                            .add(new TextNode(blockStartToken))

View Full Code Here

Examples of com.google.jstestdriver.token.BufferedTokenStream

                                                    ConcreteToken.from("{"),
                                                    ConcreteToken.from("="),
                                                    ConcreteToken.from("}")};
  
  public BufferedTokenStream createStream(InputStream in) {
    return new BufferedTokenStream(new TokenEmitter(new BufferedInputStream(in), TOKENS));
  }

View Full Code Here

Examples of org.antlr.v4.runtime.BufferedTokenStream

import static org.junit.Assert.assertEquals;


public class TestBufferedTokenStream extends BaseTest {


  protected TokenStream createTokenStream(TokenSource src) {
    return new BufferedTokenStream(src);
  }

View Full Code Here

Examples of org.antlr.v4.runtime.BufferedTokenStream

      }


      ANTLRInputStream source = new ANTLRInputStream(new ByteArrayInputStream(fileLines.toString().getBytes()));


      ScssLexer lexer = new ScssLexer(source);
      TokenStream stream = new BufferedTokenStream(lexer);
      ScssParser par = new ScssParser(stream);
      par.getInterpreter().setPredictionMode(PredictionMode.LL_EXACT_AMBIG_DETECTION);


      par.addErrorListener(new FailOnErrorListener());
      return par.stylesheet();

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.