tree-sitter/test/fixtures/test_grammars/unused_rules
2025-09-16 02:24:11 -04:00
..
corpus.txt Handle unused tokens 2017-03-09 21:16:37 -08:00
grammar.js feat: migrate to ESM 2025-09-16 02:24:11 -04:00
readme.md Handle unused tokens 2017-03-09 21:16:37 -08:00

The generated parsers use the grammar's token count to distinguish between terminal and non-terminal symbols. When the grammar has unused tokens, these tokens don't appear in the parser, so they need to be omitted from the token count.