traxys/tree-sitter
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
tree-sitter/test/fixtures/test_grammars/inverted_external_token
History
Max Brunsfeld e64f7a64a1 Start work on running test corpus tests
2019-01-11 13:31:06 -08:00
..
corpus.txt Avoid creating external tokens that start after they end 2017-12-07 11:50:27 -08:00
grammar.json Start work on running test corpus tests 2019-01-11 13:31:06 -08:00
readme.md Avoid creating external tokens that start after they end 2017-12-07 11:50:27 -08:00
scanner.c Avoid creating external tokens that start after they end 2017-12-07 11:50:27 -08:00

readme.md

This language has an external scanner that calls lexer->advance(lexer, true) (in order to skip whitespace) after having called lexer->mark_end(lexer). This tests an edge case in the parser's handling of token start and end positions.