traxys/tree-sitter
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
3980 commits 16 branches 98 tags 37 MiB
Commit graph

3980 commits

This branch
This branch
All branches
Author SHA1 Message Date
Kian-Meng Ang
b8552ec6c4 Fix typos 2022-06-28 19:57:42 +08:00
Max Brunsfeld
01df16ca9f lib: 0.20.8 2022-06-27 15:07:40 -07:00
Max Brunsfeld
b37f915520
Merge pull request #1783 from tree-sitter/empty-external-tokens-after-errors 
Allow empty external tokens during error recovery, if they change the scanner's state
 2022-06-25 17:31:35 -07:00
Max Brunsfeld
8b5ff2ec8f Loosen randomized changed range assertions on newline characters 
For now, don't error if the scope changes for a newline character.
 2022-06-25 17:13:46 -07:00
Max Brunsfeld
3ac36b0cbe Handle backslashes in token names when printing DOT debug graphs 2022-06-25 17:13:11 -07:00
Max Brunsfeld
04381dcea3 Add more python error recovery tests 2022-06-24 19:07:40 -07:00
Max Brunsfeld
5aa2f4dc8c Log when ignoring an empty external token after an error 2022-06-24 19:07:27 -07:00
Max Brunsfeld
d223a81b50 Allow empty external tokens during err recovery if they change the scanner's state 2022-06-24 15:58:13 -07:00
Max Brunsfeld
c0e1991f6b 🎨 ts_parser__lex 2022-06-24 14:24:21 -07:00
Max Brunsfeld
ca902065cb Fix bug when stack versions merge after reducing a non-terminal extra 2022-06-24 14:24:21 -07:00
Max Brunsfeld
be463c7789 Update test script with flags for new randomized test options 2022-06-24 14:24:21 -07:00
Max Brunsfeld
db91399ea7 lib: 0.20.7 2022-06-22 16:03:21 -07:00
Max Brunsfeld
58b719541b Fix failure to match queries with wildcard at root with range restrictions 2022-06-22 15:54:06 -07:00
Max Brunsfeld
46a2a5933f
Merge pull request #1748 from jamessan/cli-min-ts-ver 
cli: Bump tree-sitter dependency to 0.20.3
 2022-06-04 13:35:57 -07:00
Max Brunsfeld
efe009f47d
Merge pull request #1759 from rhysd/doc-alias 
Add C API names as document aliases in Rust docs
 2022-05-31 14:45:18 -07:00
Max Brunsfeld
1c9d2c5bb0
Merge pull request #1763 from rhysd/fix-doc-warning 
cli: fix warnings from `cargo doc`
 2022-05-31 14:44:29 -07:00
rhysd
21c6cd8c22 cli: fix warnings from cargo doc 2022-05-31 10:59:30 +09:00
rhysd
08899428f3 Add C APIs as document aliases 2022-05-30 21:36:11 +09:00
James McCoy
d11841f6ba
cli: Bump tree-sitter dependency to 0.20.3 
tree-sitter/tree-sitter#1504 added the capture_quantifiers API and its
usage in tree-sitter-cli, so the version should express the dependency.
 2022-05-17 11:07:55 -04:00
Max Brunsfeld
b729029a40
Merge pull request #1747 from Cycatz/master 
Add link to Org language parser
 2022-05-16 09:51:42 -07:00
Cycatz
369c88713c
Add link to Org language parser 2022-05-16 15:58:33 +00:00
Max Brunsfeld
6192d29610
Merge pull request #1738 from rhysd/patch-2 
Add link to JSON parser in document
 2022-05-03 10:30:11 -07:00
Linda_pp
d9365a8fd6
Add link to JSON parser in document 2022-05-04 00:01:02 +09:00
Max Brunsfeld
cfbafabe6f
Merge pull request #1643 from fengT-T/master 
Fix: Set https proxy for npm cli install script
 2022-04-26 09:54:04 -07:00
Max Brunsfeld
465ceead0f
Merge pull request #1677 from siegel/master 
Fixed warning/error when compiling with `clang -Os`.
 2022-04-03 15:30:06 -07:00
Max Brunsfeld
bd3d84162f
Merge pull request #1692 from alebastr/alt-arch-fixes 
Fix build and tests on alternative architectures
 2022-04-03 15:29:12 -07:00
Aleksei Bavshin
fe33599f46
lib: fix incorrect int ptr cast on big-endian architectures 
`*usize` -> `*u32` conversion on 64-bit big-endian machine takes high
halfword of the value. As a consequence, any result returned via
`count` is unexpectedly shifted left:

    u32   = 00 00 00 01             // 1
    usize = 00 00 00 01 00 00 00 00 // 4294967296

Fixes following test failure:
```
$ cargo test -- tests::corpus_test
<...>
running 13 tests
memory allocation of 206158430208 bytes failed
error: test failed, to rerun pass '--lib'
```
 2022-03-23 00:47:01 -07:00
Aleksei Bavshin
cdf2ecd176
tags: fix incorrect uses of i8 instead of c_char 
Fixes build on aarch64, ppc64le and other platforms that have c_char
defined as u8.
 2022-03-23 00:01:51 -07:00
Aleksei Bavshin
b27b4665ac
test: fix incorrect uses of i8 instead of c_char 
Fixes build on aarch64, ppc64le and other platforms that have c_char
defined as u8.
 2022-03-23 00:00:26 -07:00
Rich Siegel
150eb2966b Fixed warning/error when compiling with clang -Os. 
DISCUSSION:

When compiling with `-Os` for "smallest, fastest", an error is reported in `parser.c`:

```
/Users/siegel/git/tree-sitter/lib/src/./parser.c:1368:10: error: unused variable 'did_merge' [-Werror,-Wunused-variable]
    bool did_merge = ts_stack_merge(self->stack, version, previous_version_count);
         ^
1 error generated.
```

This is because with `NDEBUG` set,  `assert(e)` collapses to `(void)0`,
which in turn means that `did_merge` does not actually get consumed.
This seems to get caught when compiling with `-Os`, but not otherwise.

Compiler version:
```
Apple clang version 13.0.0 (clang-1300.0.29.30)
Target: arm64-apple-darwin21.3.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
```
 2022-03-04 18:00:16 -05:00
Max Brunsfeld
ccd6bf554d 0.20.6 2022-03-02 20:50:52 -08:00
Max Brunsfeld
1b2e90f647 libs: 0.20.6 2022-03-02 20:50:29 -08:00
Max Brunsfeld
8decec3774 Properly incorporate lookahead bytes when recovering via missing token 2022-03-02 17:12:25 -08:00
Max Brunsfeld
7170ec7c96 Improve randomized testing setup 
* Allow iterations to be specified via an env var
* Randomly decide the edit count, with a maximum
  specified via an env var.
* Instead of separate env vars for starting seed + trial, just accept a seed
* Remove some noisy output
 2022-03-02 17:12:25 -08:00
Max Brunsfeld
4bf5149a18 Run cargo test directly on CI 2022-03-02 17:12:25 -08:00
Max Brunsfeld
a6a102bec9 Set CLI as default workspace member 2022-03-02 16:36:14 -08:00
Max Brunsfeld
4b93326898 Don't generate primary states array if it will be unused due to abi version setting 2022-03-02 14:57:59 -08:00
Max Brunsfeld
621eb04cb1 tags: 0.20.2 2022-03-02 14:48:58 -08:00
Max Brunsfeld
09d08e8f8b 0.20.5 2022-03-02 14:43:53 -08:00
Max Brunsfeld
fcbef45899 libs: 0.20.5 2022-03-02 14:43:16 -08:00
Max Brunsfeld
38d2cd15bd
Merge pull request #1667 from tree-sitter/dependabot/bundler/docs/nokogiri-1.13.3 
Bump nokogiri from 1.11.4 to 1.13.3 in /docs
 2022-02-26 16:56:14 -08:00
Max Brunsfeld
c42882b149
Merge pull request #1666 from the-mikedavis/md-tags-testing-docs 
add unit testing documentation for tags queries
 2022-02-26 16:13:02 -08:00
Max Brunsfeld
a494d6aa28
Merge pull request #1668 from tree-sitter/remember-lookahead-bytes-on-error-detection 
Remember lookahead bytes on error detection
 2022-02-26 14:59:40 -08:00
Max Brunsfeld
c697ebfb27 Add explicit unit test for error detection lookahead bug 2022-02-26 14:33:09 -08:00
dependabot[bot]
fa3e87479f
Bump nokogiri from 1.11.4 to 1.13.3 in /docs 
Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.11.4 to 1.13.3.
- [Release notes](https://github.com/sparklemotion/nokogiri/releases)
- [Changelog](https://github.com/sparklemotion/nokogiri/blob/main/CHANGELOG.md)
- [Commits](https://github.com/sparklemotion/nokogiri/compare/v1.11.4...v1.13.3)

---
updated-dependencies:
- dependency-name: nokogiri
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-26 03:43:21 +00:00
Michael Davis
699629ecdd
add unit testing documentation for tags queries 2022-02-25 05:46:30 -06:00
Max Brunsfeld
9866674cf8
Merge pull request #1660 from alex-pinkus/expanded-regex-support 
Expand regex support to include emojis and binary ops
 2022-02-24 17:14:23 -08:00
Max Brunsfeld
5eb0a3090f
Merge pull request #1547 from the-mikedavis/md-test-tags 
test tags queries in 'tree-sitter test'
 2022-02-24 15:22:15 -08:00
Patrick Thomson
3bd6fae4cc
Merge pull request #1649 from tree-sitter/tag-name-conventions 
Describe tagging and associated naming conventions for syntax captures.
 2022-02-24 09:26:00 -05:00
Max Brunsfeld
0fb864c1a0 Retain information about the lexer's lookahead for the token where an error was detected 2022-02-22 09:45:26 -08:00