traxys/tree-sitter
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Avoid unnecessary TSInput calls when resetting lexer within an existing chunk

Browse source
This commit is contained in:
Max Brunsfeld 2016-09-06 10:23:07 -07:00
parent b76574e01c
commit e2ca55c918
1 changed files with 6 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

9
src/runtime/lexer.c
View file

@ -95,9 +95,12 @@ static inline void ts_lexer__reset(TSLexer *self, TSLength position) {
self->token_start_position = position;
self->current_position = position;
self->chunk = 0;
self->chunk_start = 0;
self->chunk_size = 0;
if (self->chunk && (position.bytes < self->chunk_start || position.bytes >= self->chunk_start + self->chunk_size)) {
self->chunk = 0;
self->chunk_start = 0;
self->chunk_size = 0;
}
self->lookahead_size = 0;
self->lookahead = 0;
}