Linter config `.vscode/settings.json`:
```json
{
"[markdown]": {
"files.trimTrailingWhitespace": false,
},
"markdownlint.config": {
"default": true,
// "ul-style": {
// "style": "asterisk"
// },
"MD001": false,
"MD024": false,
"MD025": false,
"MD033": false,
"MD041": false,
"MD053": false,
},
}
```
5 KiB
| title | permalink |
|---|---|
| Contributing | contributing |
Contributing
Code of Conduct
Contributors to Tree-sitter should abide by the Contributor Covenant.
Developing Tree-sitter
Prerequisites
To make changes to Tree-sitter, you should have:
- A C compiler, for compiling the core library and the generated parsers.
- A Rust toolchain, for compiling the Rust bindings, the highlighting library, and the CLI.
- Node.js and NPM, for generating parsers from
grammar.jsfiles. - Either Emscripten or Docker, for compiling the library to WASM.
Building
Clone the repository:
git clone https://github.com/tree-sitter/tree-sitter
cd tree-sitter
Optionally, build the WASM library. If you skip this step, then the tree-sitter playground command will require an internet connection. If you have emscripten installed, this will use your emcc compiler. Otherwise, it will use Docker:
./script/build-wasm
Build the Rust libraries and the CLI:
cargo build --release
This will create the tree-sitter CLI executable in the target/release folder.
Testing
Before you can run the tests, you need to clone some grammars that are used for testing:
script/fetch-fixtures
To test any changes you've made to the CLI, you can regenerate these parsers using your current CLI code:
script/generate-fixtures
Then you can run the tests:
script/test
Similarly, to test the WASM binding, you need to compile these parsers to WASM:
script/generate-fixtures-wasm
script/test-wasm
Debugging
The test script has a number of useful flags. You can list them all by running script/test -h. Here are some of the main flags:
If you want to run a specific unit test, pass its name (or part of its name) as an argument:
script/test test_does_something
You can run the tests under the debugger (either lldb or gdb) using the -g flag:
script/test test_does_something -g
Part of the Tree-sitter test suite involves parsing the corpus tests for several different languages and performing randomized edits to each example in the corpus. If you just want to run the tests for a particular language, you can pass the -l flag. And if you want to run a particular example from the corpus, you can pass the -e flag:
script/test -l javascript -e Arrays
Published Packages
The main tree-sitter/tree-sitter repository contains the source code for several packages that are published to package registries for different languages:
- Rust crates on crates.io:
tree-sitter- A Rust binding to the core librarytree-sitter-highlight- The syntax-highlighting librarytree-sitter-cli- The command-line tool
- JavaScript modules on npmjs.com:
web-tree-sitter- A WASM-based JavaScript binding to the core librarytree-sitter-cli- The command-line tool
There are also several other dependent repositories that contain other published packages:
tree-sitter/node-tree-sitter- Node.js bindings to the core library, published astree-sitteron npmjs.comtree-sitter/py-tree-sitter- Python bindings to the core library, published astree-sitteron PyPI.org.
Publishing New Releases
Publishing a new release of the CLI requires these steps:
-
Commit and push all outstanding changes and verify that CI passes:
git commit -m "Fix things" git push -
Create a new tag:
script/version patchThis will determine the current version, increment the patch version number, and update the
Cargo.tomlandpackage.jsonfiles for the Rust and Node CLI packages. It will then create a commit and a tag for the new version. For more information about the arguments that are allowed, see the documentation for thenpm versioncommand. -
Push the commit and the tag:
git push git push --tags -
Wait for CI to pass. Because of the git tag, the CI jobs will publish artifacts to a GitHub release. The npm module of
tree-sitter-cliworks by downloading the appropriate binary from the corresponding GitHub release during installation. So it's best not to publish the npm package until the binaries are uploaded. -
Publish the npm package:
cd cli/npm npm publish