Commit graph

83 commits

Author SHA1 Message Date
Amaan Qureshi
40606dd632
feat: add version subcommand for versioning grammars 2024-10-18 22:08:57 -04:00
Will Lillis
4705a3153a
feat: Add CST pretty-printer for parser output
Co-authored-by: Amaan Qureshi <amaanq12@gmail.com>
2024-10-12 18:37:12 -04:00
Amaan Qureshi
ea3846a2c5
feat: move tree-sitter configuration to dedicated file (#3700) 2024-09-30 11:11:23 -04:00
Amaan Qureshi
9301d38b77 feat!: remove C++ support for external scanners 2024-09-07 20:14:36 -04:00
Ron Panduwana
2bb20fe2fe
feat: allow external scanners to use the logger
Co-authored-by: Amaan Qureshi <amaanq12@gmail.com>
2024-08-17 14:46:28 -04:00
Segev Finer
149a2a9081
docs: add tsserver annotation to example (#3460) 2024-07-28 09:17:20 +03:00
Amaan Qureshi
34c4784ac5
docs: add note for bullet 2024-06-23 13:38:57 -04:00
ObserverOfTime
6bfdae00f2 docs: mention build command variables 2024-05-05 13:06:45 -04:00
ObserverOfTime
63babea301 fix: proper function prototypes 2024-04-11 16:28:21 -04:00
Amaan Qureshi
99b93d83a1 feat(cli)!: add a separate build command to compile parsers
This allows users to build parsers without having to run `test` or
`parse` to invoke the compilation process, and allows them to output the
object file to wherever they like. The `build-wasm` command was merged
into this by just specifying the `--wasm` flag.
2024-03-17 05:36:30 -04:00
Giftpflanze
647d2e5c37
docs: fix typo 2024-03-12 02:29:55 -04:00
Amaan Qureshi
3eb7366500 docs: document test attributes 2024-02-29 02:17:30 -05:00
Amaan Qureshi
60a935139b refactor!: remove top-level corpus dir for tests
It's confusing to have tests in two different top-level directories when working between different grammars, and most of them use `test/corpus` which is more fitting, so time to go.
2024-02-29 02:17:30 -05:00
ObserverOfTime
502dacf220 refactor: rename TS_REUSE_ALLOCATOR flag
TREE_SITTER_REUSE_ALLOCATOR is more consistent
2024-02-27 15:54:38 -05:00
Amaan Qureshi
f1eecf9786 feat: expose the allocator and array header files for external scanners 2024-02-26 09:43:13 -05:00
Amaan Qureshi
9e5bf6591f feat: improve language bindings
Co-authored-by: ObserverOfTime <chronobserver@disroot.org>
2024-02-25 19:06:01 -05:00
Amaan Qureshi
74812ced1b chore: deprecate C++ scanners
C++ has been a headache to deal with throughout the ecosystem and for
several downstream projects. It is difficult to get working with WASM,
and induces potential issues with compilation on Windows. It has been
proven that writing scanners in C is a much better alternative, and is
the recommended way to write scanners now. C++ support will likely be
removed in 0.21.0
2024-02-14 15:43:53 -05:00
Amaan Qureshi
792cbde728 docs: mention that token($.foo) is illegal 2024-02-12 17:17:37 -05:00
Amaan Qureshi
0109c877d5 docs: document regex limitations 2024-02-12 17:17:37 -05:00
Caleb White
6ccc1d11c8 chore: document preferred language for scanner 2024-02-09 03:21:23 -05:00
dundargoc
df1fe842eb docs: various fixes
Closes https://github.com/tree-sitter/tree-sitter/issues/1317.
Closes https://github.com/tree-sitter/tree-sitter/issues/1752.
Closes https://github.com/tree-sitter/tree-sitter/issues/2439.

Co-authored-by: Simon Hengel <sol@typeful.net>
Co-authored-by: Akash Yadav <itsaky01@gmail.com>
Co-authored-by: Sebastiaan Speck <12570668+sebastiaanspeck@users.noreply.github.com>
Co-authored-by: Laytan Laats <laytanlaats@hotmail.com>
2024-02-08 00:08:59 +01:00
Amaan Qureshi
03abb6179c
Merge pull request #2780 from bugwelle/patch-1
fix(docs): Fix link to contributing guide
2024-02-05 01:13:03 -05:00
Adrian Alic
6fd3582ae3
Add missing closing parenthesis 2024-01-25 20:45:46 -05:00
Andre Meyering
0da0da043e
fix(docs): Fix link to contributing guide
The link to the contribution guide on 
https://tree-sitter.github.io/tree-sitter/using-parsers was dead.
2023-11-24 09:59:00 +01:00
Ganesan Arjuna Maharaja
f9f51480eb correcting the spelling of valid_symbols in indent dedent example 2023-07-29 20:55:33 +05:30
Andrew Hlynskyi
3c806913d8 docs: improve external scanner details and fix conflicting tokens details
* Removed convention notes introduced in #1947 due to:
  * It doesn't so strict for bindings and they may need to obey to some
    target language conventions.
  * For language grammars there is a note that states the same in the
    `Creating Parsers` section.
* Removed `External Scanning` item introduced in 87a0517 commit
  originated from #1612 due to unclear consistency with other
  5 original statements. There is a similar explanation in the
  `Other External Scanner Details` section.
2023-04-16 23:46:21 +03:00
Andrew Hlynskyi
613382c70a docs: update badges; fix markdown lint complains
Linter config `.vscode/settings.json`:
```json
{
    "[markdown]": {
        "files.trimTrailingWhitespace": false,
    },
    "markdownlint.config": {
        "default": true,
        // "ul-style": {
        //     "style": "asterisk"
        // },
        "MD001": false,
        "MD024": false,
        "MD025": false,
        "MD033": false,
        "MD041": false,
        "MD053": false,
    },
}
```
2023-04-16 23:39:08 +03:00
Andrew Hlynskyi
b5e6d18086 docs: add a grammar syntax sample for lexical precedence 2023-04-15 05:10:02 +03:00
Andrew Hlynskyi
bfd56a1e59 docs: remove controversial Earliest Starting Position item added previously by 87a0517 2023-04-15 05:10:02 +03:00
Andrew Hlynskyi
1f051d339c chore(docs): fix misprint repetitions and remove dangling spaces 2023-04-09 20:40:18 +03:00
Andreas Deininger
0751736d17 docs: convert various links to https protocol 2023-04-04 18:05:46 +03:00
Andrew Helwer
278ff01e71 Added additional documentation details
* External scanners and infinite loops
* Terminal keywords in externals array
* Using error sentinel external token
* Good practice to erase state variables in deserialize func
* Emphasize external scanner is called first
2023-01-03 02:48:55 +02:00
Andrew Helwer
87a0517f3c Various updates to Creating Parsers docs
* Documented test separator suffixes
* Documented partial precedences field
* Added external scanning to conflicting tokens rules
* Added earliest starting position to conflicting tokens rules
* Added note about lexical precedence vs. parse precedence
* Added note about tree-sitter calling external scanner with all
  tokens marked valid during error recovery
2023-01-03 02:48:48 +02:00
Andrew Helwer
dddbc2d4f7 Added working commands for Windows users
Windows users are likely to be using either Windows Terminal (which uses PowerShell) or PowerShell directly.
2023-01-02 02:31:06 +02:00
mliszcz
7bf2484d81 Fix test output formatting for rules starting with M/U
Previously the rule names could not begin with an uppercase M or U
because the test output formatter assumed that they represent special
tokens: MISSING or UEXPECTED.

Fixes #1940.
2022-11-15 20:20:44 +01:00
Jonathan Arnett
245e3b0092 Add note about including an external scanner in Rust crate 2022-10-30 23:24:50 -04:00
Max Brunsfeld
3563fe009a Explain in the docs that npm install supports limited platforms 2022-09-02 15:31:21 -07:00
Andrew Helwer
80c34d62ab Fixed rust build, updated docs 2022-01-07 10:36:25 -05:00
Max Brunsfeld
2bee7c9b75 Update get_column docs
Fixes #1405
2021-09-22 13:53:42 -07:00
Andrew Hlynskyi
c1849098f5 chore(docs): Fix getting started example, closes #891 2021-08-27 11:07:49 +03:00
Niklas Mohrin
66cfc05d76
Fix highlighting typo on "creating parsers" site 2021-07-25 14:08:46 +02:00
Jean-Hadrien Chabran
2aa1578f6b Update generated files 2021-06-07 14:33:32 +02:00
Sjoerd Langkemper
103d37adc4 Fix typo: lanugage -> language 2021-03-23 16:42:07 +01:00
François Wouts
b7f99d45f0
Revert back to 2.5.0 to minimise changes 2021-02-24 07:56:26 +11:00
François Wouts
86d4be4ea7
Link to Ruby 3 docs instead 2021-02-24 07:55:48 +11:00
François Wouts
9437973b3e
Fix broken link to Ruby's Percent Strings
The current link fails with a 404.
2021-02-24 07:52:24 +11:00
Max Brunsfeld
d12b874a48
Merge pull request #735 from Vehmloewff/patch-1
Add documentation for `token.immediate`
2020-11-03 11:55:12 -08:00
Patrick Thomson
9f9f2a52b7 Docs. 2020-09-29 12:59:05 -04:00
Elijah Mooring
43a3f1bbe0
Update section-3-creating-parsers.md 2020-09-19 11:19:26 -05:00
Max Brunsfeld
4ec7d80968 Mention rule order as the fallback criteria in docs
Fixes #702
2020-07-29 10:04:21 -07:00