traxys/tree-sitter
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
tree-sitter/test/fixtures/test_grammars/unused_rules
History
Max Brunsfeld f04d7c5860 Handle unused tokens
2017-03-09 21:16:37 -08:00
..
corpus.txt Handle unused tokens 2017-03-09 21:16:37 -08:00
grammar.json Handle unused tokens 2017-03-09 21:16:37 -08:00
readme.md Handle unused tokens 2017-03-09 21:16:37 -08:00

readme.md

The generated parsers use the grammar's token count to distinguish between terminal and non-terminal symbols. When the grammar has unused tokens, these tokens don't appear in the parser, so they need to be omitted from the token count.