Max Brunsfeld
|
a3679fbb1f
|
Distinguish separators from main tokens via a property on transitions
It was incorrect to store it as a property on the lexical states themselves
|
2016-05-19 16:27:25 -07:00 |
|
Max Brunsfeld
|
c96c4a08e6
|
Use an object pool for stack nodes, to reduce allocations
Also, fix some leaks in the case where memory allocation failed during parsing
|
2016-02-04 11:19:42 -08:00 |
|
Max Brunsfeld
|
3dde0a6f39
|
Handle allocation failures during parsing
|
2016-01-19 18:08:01 -08:00 |
|
Max Brunsfeld
|
f2e7058ad9
|
Support UTF16 directly
This makes the API easier to use from javascript
|
2015-12-28 13:53:22 -08:00 |
|
Max Brunsfeld
|
da1bc038e5
|
Remove nested options structs in Tree
|
2015-12-22 14:20:58 -08:00 |
|
Max Brunsfeld
|
2bcd2e4d00
|
Reuse fragile tokens that came from the current lex state
|
2015-12-21 16:04:11 -08:00 |
|
Max Brunsfeld
|
d713054d61
|
Record which tokens are fragile when lexing
|
2015-12-10 21:05:54 -08:00 |
|
Max Brunsfeld
|
08d50c25ae
|
clang-format
|
2015-12-04 20:56:33 -08:00 |
|
Max Brunsfeld
|
d2bf88d5fe
|
Include rows and columns in TSLength
This way, we don't have to have separate 1D and 2D versions for so many values
|
2015-12-04 20:20:29 -08:00 |
|
Max Brunsfeld
|
8e217f758c
|
Use individual args instead of TSLength in input seek function
|
2015-12-03 23:06:01 -08:00 |
|
Max Brunsfeld
|
8a146a9bef
|
Reset lexer correctly when old input was blank
|
2015-12-03 10:00:39 -08:00 |
|
Max Brunsfeld
|
f08554e958
|
Replace NodeType enum with SymbolMetadata bitfield
This will allow storing other metadata about symbols, like if they
only appear as ubiquitous tokens
|
2015-12-02 15:10:24 -08:00 |
|
joshvera
|
9da4aeaeff
|
columns start at 0 for sanity's sake
|
2015-11-30 17:22:47 -05:00 |
|
joshvera
|
cc77889d11
|
combine logs
|
2015-11-30 14:19:50 -05:00 |
|
joshvera
|
88d3432787
|
Merge remote-tracking branch 'joshvera/line-numbers' into line-numbers
|
2015-11-30 13:06:54 -05:00 |
|
joshvera
|
7633cbb836
|
indentation
|
2015-11-30 12:59:23 -05:00 |
|
joshvera
|
4af3b7d0fd
|
Add offset_point to LookaheadState
|
2015-11-30 12:50:16 -05:00 |
|
joshvera
|
f5fc247c8b
|
Merge remote-tracking branch 'origin/master' into line-numbers
|
2015-11-30 12:36:11 -05:00 |
|
joshvera
|
4cbc4b8bcf
|
Revert "try starting from 1"
This reverts commit 11efff2442.
|
2015-11-30 12:16:58 -05:00 |
|
joshvera
|
11efff2442
|
try starting from 1
|
2015-11-25 14:25:11 -05:00 |
|
joshvera
|
3d9a44d880
|
Calculate the column and offset separately in TSNode
|
2015-11-25 13:36:19 -05:00 |
|
joshvera
|
4663b9ce89
|
Add padding and size points to ts_tree_make_leaf in ts_lexer__accept
|
2015-11-25 11:44:13 -05:00 |
|
Max Brunsfeld
|
7aba2a0716
|
Rename DEBUG macro to LOG
DEBUG is already used as the symbol to enable/disable assert() calls
|
2015-11-20 11:50:50 -08:00 |
|
Max Brunsfeld
|
64874449e4
|
Allow different parse stack heads to lex differently
|
2015-11-19 20:55:18 -08:00 |
|
joshvera
|
b0f6bac3ab
|
replace start and end with padding and size
|
2015-11-18 16:34:50 -08:00 |
|
joshvera
|
a85b7fe3c4
|
start column at 0 again
|
2015-11-16 16:59:12 -08:00 |
|
joshvera
|
fc49a3949a
|
try resetting to 1
|
2015-11-13 14:13:16 -05:00 |
|
joshvera
|
8058500c5b
|
Add source info to TSTree
|
2015-11-12 15:32:53 -05:00 |
|
joshvera
|
bf666351e9
|
Set token_end_source_info
|
2015-11-12 13:28:33 -05:00 |
|
joshvera
|
e60ab58187
|
maybe increment line and column here?
|
2015-11-12 13:25:35 -05:00 |
|
joshvera
|
e720922662
|
Add source info to TSLexer
|
2015-11-12 12:24:05 -05:00 |
|
Max Brunsfeld
|
f5d861a019
|
Fix bug where ts_stack_pop results were backwards for some stack configurations
|
2015-10-28 12:10:45 -07:00 |
|
Max Brunsfeld
|
c885eea706
|
Add current position to lexer debug message
|
2015-10-26 12:47:54 -07:00 |
|
Max Brunsfeld
|
500533476b
|
Fix bugs in handling multiple simultaneous ambiguities
|
2015-10-22 11:42:38 -07:00 |
|
Max Brunsfeld
|
216ce8c80b
|
Rename receiver parameter to 'self'
|
2015-10-14 22:14:08 -07:00 |
|
Max Brunsfeld
|
b3d883e128
|
Store edits in trees, not by splitting stack
This allows for multiple edits per parse, though it is not exposed through
the API yet
|
2015-09-18 22:02:06 -07:00 |
|
Max Brunsfeld
|
0467d190fe
|
Add ts_tree_edit function
|
2015-09-18 22:02:06 -07:00 |
|
Max Brunsfeld
|
296d8cc1e8
|
clang-format
|
2015-09-13 19:41:11 -07:00 |
|
Max Brunsfeld
|
ebd60213d9
|
Drop release functions from callback structs
The caller can just as easily take care of the cleanup explicitly
|
2015-09-08 23:24:33 -07:00 |
|
Max Brunsfeld
|
9591c88f39
|
In runtime, distinguish between anonymous and hidden nodes
|
2015-09-06 00:12:37 -07:00 |
|
Max Brunsfeld
|
6933d7b425
|
🎨 naming conventions
|
2015-08-16 20:05:47 -07:00 |
|
Max Brunsfeld
|
f9b057f3a9
|
clang-format everything
|
2015-07-27 18:29:48 -07:00 |
|
Max Brunsfeld
|
d5ce3a9b5a
|
lexer: in error mode, continue until token is found
|
2015-06-15 15:26:05 -07:00 |
|
Max Brunsfeld
|
de9a48d11f
|
Tweak debugging in parser and lexer
|
2014-10-22 20:10:08 -07:00 |
|
Max Brunsfeld
|
8cf800ef5d
|
Unify debugging API for parsing and lexing
|
2014-10-17 17:52:54 -07:00 |
|
Max Brunsfeld
|
7498725d7f
|
Move lexer debugging logic out of public header
|
2014-10-17 16:20:01 -07:00 |
|
Max Brunsfeld
|
5c600942df
|
Inline some helper functions for lexer
|
2014-10-17 15:22:01 -07:00 |
|
Max Brunsfeld
|
d33b074c30
|
Don't call input::seek_fn unnecessarily
|
2014-10-14 22:56:42 -07:00 |
|
Max Brunsfeld
|
b5d022a70c
|
Fix missing field warnings for debugger structs
|
2014-10-14 22:50:24 -07:00 |
|
Max Brunsfeld
|
c594208ab8
|
Allow callbacks to be specified for debug output
|
2014-10-13 01:02:18 -07:00 |
|