8 commits

Author	SHA1	Message	Date
Max Brunsfeld	545e575508	Revert "Remove the separator characters construct" ... This reverts commit 5cd07648fd. The separators construct is useful as an optimization. It turns out that constructing a node for every chunk of whitespace in a document causes a significant performance regression. Conflicts: src/compiler/build_tables/build_lex_table.cc src/compiler/grammar.cc src/runtime/parser.c	2014-09-02 08:03:51 -07:00
Max Brunsfeld	5cd07648fd	Remove the separator characters construct ... Now, grammars can handle whitespace by making it another ubiquitous token, like comments. For now, this has the side effect of whitespace being included in the tree that precedes it. This was already an issue for other ubiquitous tokens though, so it needs to be fixed anyway.	2014-09-01 20:19:43 -07:00
Max Brunsfeld	779bf0d745	Don't store tree's hidden children in a separate array ... Just mark hidden trees as such, and skip them when pretty-printing a tree	2014-07-17 13:36:53 -07:00
Max Brunsfeld	09e28e7859	Collapse nodes with only one child and no additional text content	2014-03-26 00:10:59 -07:00
Max Brunsfeld	50a90e456b	Handle * quantifier in regex patterns	2014-03-22 20:08:11 -07:00
Max Brunsfeld	13009e52a5	Clean	2014-03-22 15:59:21 -07:00
Max Brunsfeld	c40411b4d1	Handle unexpected tokens properly ... Also, add null and boolean values to json grammar	2014-03-22 15:46:58 -07:00
Karen Wang and Max Brunsfeld	f248ece3aa	Use table-driven tests for specific parsers	2014-03-22 15:19:13 -07:00