14 commits

Author	SHA1	Message	Date
Max Brunsfeld	1ff7cedf40	Unify ubiquitous tokens and lexical separators in API	2014-09-07 22:16:45 -07:00
Max Brunsfeld	3dea1261a6	Clean up document specs for incremental parsing	2014-09-03 18:48:10 -07:00
Max Brunsfeld	545e575508	Revert "Remove the separator characters construct" ... This reverts commit 5cd07648fd. The separators construct is useful as an optimization. It turns out that constructing a node for every chunk of whitespace in a document causes a significant performance regression. Conflicts: src/compiler/build_tables/build_lex_table.cc src/compiler/grammar.cc src/runtime/parser.c	2014-09-02 08:03:51 -07:00
Max Brunsfeld	5cd07648fd	Remove the separator characters construct ... Now, grammars can handle whitespace by making it another ubiquitous token, like comments. For now, this has the side effect of whitespace being included in the tree that precedes it. This was already an issue for other ubiquitous tokens though, so it needs to be fixed anyway.	2014-09-01 20:19:43 -07:00
Max Brunsfeld	98cc2f2264	Auto-format all source code with clang-format	2014-07-21 13:20:00 -07:00
Max Brunsfeld	b9393b5c1a	Refactor grammar helper functions	2014-05-01 20:02:06 -07:00
Max Brunsfeld	b86203d205	Extract shared helper functions from example grammars	2014-04-27 21:45:05 -07:00
Max Brunsfeld	a437d39773	Add rule precedence construct ... Still need to add some way of expressing left and right associativity	2014-04-15 08:40:46 -07:00
Max Brunsfeld	a79a7435de	Remove remaining trailing whitespace from generated c code	2014-03-29 19:21:42 -07:00
Max Brunsfeld	99817a38c1	Improve trees generated by arithmetic grammar ... This work should inform how to implement operator precedence helper functions	2014-03-29 18:37:51 -07:00
Max Brunsfeld	13c4e6e648	Tweak format for example grammars	2014-03-28 13:51:32 -07:00
Max Brunsfeld	48baf056b4	Store grammars' rules in vectors, not maps ... This way, we can keep of the order in which the rules were given, for resolving reduce/reduce conflicts.	2014-03-24 13:17:38 -07:00
Max Brunsfeld	671f1a1ddc	Start work on javascript grammar	2014-03-24 09:14:29 -07:00
Max Brunsfeld	06cd18b483	Put example grammars in tree_sitter::examples ns	2014-03-24 07:19:31 -07:00