Max Brunsfeld 4b04afac5e Control lexer's error-mode via explicit boolean argument ... Previously, the lexer would operate in error-mode (ignoring any garbage input until it found a valid token) if it was invoked in the 'error' state. Now that the error state is deduped with other lexical states, the lexer might be invoked in that state even when error-mode is not intended. This adds a third argument to `ts_lex` that explicitly sets the error-mode. This bug was unlikely to occur in any real grammars, but it caused the node-tree-sitter-compiler test suite to fail for some grammars with only one rule.		2015-12-30 09:43:12 -08:00
..
compiler	Rename ubiquitous_tokens -> extra_tokens in compiler API	2015-12-17 15:50:50 -08:00
fixtures	Control lexer's error-mode via explicit boolean argument	2015-12-30 09:43:12 -08:00
runtime	Support UTF16 directly	2015-12-28 13:53:22 -08:00