2018-05-17 14:35:31 -07:00
Rust Tree-sitter
2019-02-05 11:33:58 -08:00
================
2018-05-17 14:35:31 -07:00
2019-02-05 11:33:58 -08:00
[](https://travis-ci.org/tree-sitter/tree-sitter)
[](https://ci.appveyor.com/project/maxbrunsfeld/tree-sitter/branch/master)
2018-05-18 12:02:52 -07:00
[](https://crates.io/crates/tree-sitter)
2018-05-17 14:35:31 -07:00
Rust bindings to the [Tree-sitter][] parsing library.
2018-05-18 11:42:13 -07:00
### Basic Usage
First, create a parser:
```rust
2018-06-19 16:19:37 -07:00
use tree_sitter::{Parser, Language};
// ...
2018-06-28 10:25:01 +02:00
let mut parser = Parser::new();
2018-05-18 11:42:13 -07:00
```
2019-08-21 20:59:37 +02:00
Tree-sitter languages consist of generated C code. To make sure they're properly compiled and linked, you can create a [build script ](https://doc.rust-lang.org/cargo/reference/build-scripts.html ) like the following (assuming `tree-sitter-javascript` is in your root directory):
```rust
extern crate cc;
use std::path::PathBuf;
fn main() {
let dir: PathBuf = ["tree-sitter-javascript", "src"].iter().collect();
cc::Build::new()
.include(& dir)
.file(dir.join("parser.c"))
.file(dir.join("scanner.c"))
.compile("tree-sitter-javascript");
}
```
To then use languages from rust, you must declare them as `extern "C"` functions and invoke them with `unsafe` . Then you can assign them to the parser.
2018-05-18 11:42:13 -07:00
```rust
2018-06-28 10:25:01 +02:00
extern "C" { fn tree_sitter_c() -> Language; }
extern "C" { fn tree_sitter_rust() -> Language; }
extern "C" { fn tree_sitter_javascript() -> Language; }
2018-05-18 11:42:13 -07:00
2018-06-19 16:19:37 -07:00
let language = unsafe { tree_sitter_rust() };
parser.set_language(language).unwrap();
2018-05-18 11:42:13 -07:00
```
Now you can parse source code:
```rust
let source_code = "fn test() {}";
2019-08-08 08:35:23 -07:00
let tree = parser.parse(source_code, None).unwrap();
2018-05-18 11:42:13 -07:00
let root_node = tree.root_node();
2018-06-19 16:19:37 -07:00
2018-05-18 11:42:13 -07:00
assert_eq!(root_node.kind(), "source_file");
assert_eq!(root_node.start_position().column, 0);
assert_eq!(root_node.end_position().column, 12);
```
### Editing
2018-06-19 16:19:37 -07:00
Once you have a syntax tree, you can update it when your source code changes. Passing in the previous edited tree makes `parse` run much more quickly:
2018-05-18 11:42:13 -07:00
```rust
let new_source_code = "fn test(a: u32) {}"
tree.edit(InputEdit {
start_byte: 8,
old_end_byte: 8,
new_end_byte: 14,
start_position: Point::new(0, 8),
old_end_position: Point::new(0, 8),
new_end_position: Point::new(0, 14),
});
2018-06-19 16:19:37 -07:00
2019-02-05 10:59:31 -08:00
let new_tree = parser.parse(new_source_code, Some(&tree));
2018-05-18 11:42:13 -07:00
```
### Text Input
2019-02-05 10:59:31 -08:00
The source code to parse can be provided either either as a string, a slice, a vector, or as a function that returns a slice. The text can be encoded as either UTF8 or UTF16:
2018-05-18 11:42:13 -07:00
```rust
2018-06-19 16:19:37 -07:00
// Store some source code in an array of lines.
let lines = & [
"pub fn foo() {",
" 1",
"}",
];
// Parse the source code using a custom callback. The callback is called
// with both a byte offset and a row/column offset.
2019-02-05 10:59:31 -08:00
let tree = parser.parse_with(& mut |_byte: u32, position: Point| -> & [u8] {
2018-06-19 16:19:37 -07:00
let row = position.row as usize;
let column = position.column as usize;
if row < lines.len ( ) {
if column < lines [ row ] . as_bytes ( ) . len ( ) {
& lines[row].as_bytes()[column..]
2018-05-18 11:42:13 -07:00
} else {
2018-06-19 16:19:37 -07:00
"\n".as_bytes()
2018-05-18 11:42:13 -07:00
}
2018-06-19 16:19:37 -07:00
} else {
& []
2018-05-18 11:42:13 -07:00
}
2018-06-19 16:19:37 -07:00
}, None).unwrap();
2018-05-18 11:42:13 -07:00
2018-06-19 16:19:37 -07:00
assert_eq!(
tree.root_node().to_sexp(),
"(source_file (function_item (visibility_modifier) (identifier) (parameters) (block (number_literal))))"
);
2018-05-18 11:42:13 -07:00
```
2018-05-17 14:35:31 -07:00
[tree-sitter]: https://github.com/tree-sitter/tree-sitter