tree-sitter/src/compiler
Max Brunsfeld 38c144b4a3 Refine logic for deciding when tokens need to be re-lexed
* While generating the lex table, note which tokens can match the
  same string. A token needs to be relexed when it has possible
  homonyms in the current state.
* Also note which tokens can match substrings of each other tokens.
  A token needs to be relexed when there are viable tokens that
  could match longer strings in the current state and the next
  token has been edited.
* Remove the logic for marking tokens as fragile on creation.
* Store the reusability/non-reusability of symbols off of individual
  actions and onto the entire entry for the state & symbol.
2016-06-21 07:28:04 -07:00
..
build_tables Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
generate_code Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
prepare_grammar Make repeat rules left-recursive instead of right recursive 2016-04-18 12:40:14 -07:00
rules Distinguish separators from main tokens via a property on transitions 2016-05-19 16:27:25 -07:00
util Generate correct C literals for non-ascii characters 2014-09-28 18:40:15 -07:00
compile.cc Fix assorted memory leaks in test code 2016-02-05 12:23:54 -08:00
compile.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
compile_error.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
grammar.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
lex_table.cc Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
lex_table.h Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
lexical_grammar.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
parse_grammar.cc Remove old error recovery code 2016-03-02 20:58:39 -08:00
parse_grammar.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
parse_table.cc Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
parse_table.h Refine logic for deciding when tokens need to be re-lexed 2016-06-21 07:28:04 -07:00
precedence_range.cc Include precedence calculation in LexItemSet::transitions 2015-10-30 16:07:29 -07:00
precedence_range.h Include precedence calculation in LexItemSet::transitions 2015-10-30 16:07:29 -07:00
rule.cc Add helper for dynamic-casting to rule subclasses 2015-10-12 19:21:56 -07:00
rule.h Fix linter errors 2015-10-12 19:22:05 -07:00
rules.h Remove old error recovery code 2016-03-02 20:58:39 -08:00
syntax_grammar.cc Record in parse table which actions can hide splits 2015-12-17 13:11:56 -08:00
syntax_grammar.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00
variable.cc Merge branch 'flatten-rules-into-productions' 2015-10-02 23:46:39 -07:00
variable.h Make the compile function plain C and take a JSON grammar 2016-01-11 12:33:48 -08:00