Commit graph

289 commits

Author SHA1 Message Date
Amaan Qureshi
0109c877d5 docs: document regex limitations 2024-02-12 17:17:37 -05:00
Caleb White
6ccc1d11c8 chore: document preferred language for scanner 2024-02-09 03:21:23 -05:00
dundargoc
df1fe842eb docs: various fixes
Closes https://github.com/tree-sitter/tree-sitter/issues/1317.
Closes https://github.com/tree-sitter/tree-sitter/issues/1752.
Closes https://github.com/tree-sitter/tree-sitter/issues/2439.

Co-authored-by: Simon Hengel <sol@typeful.net>
Co-authored-by: Akash Yadav <itsaky01@gmail.com>
Co-authored-by: Sebastiaan Speck <12570668+sebastiaanspeck@users.noreply.github.com>
Co-authored-by: Laytan Laats <laytanlaats@hotmail.com>
2024-02-08 00:08:59 +01:00
dependabot[bot]
7f3122bc00
build(deps-dev): bump nokogiri from 1.14.3 to 1.16.2 in /docs
Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.14.3 to 1.16.2.
- [Release notes](https://github.com/sparklemotion/nokogiri/releases)
- [Changelog](https://github.com/sparklemotion/nokogiri/blob/main/CHANGELOG.md)
- [Commits](https://github.com/sparklemotion/nokogiri/compare/v1.14.3...v1.16.2)

---
updated-dependencies:
- dependency-name: nokogiri
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-05 21:04:01 +00:00
Amaan Qureshi
03abb6179c
Merge pull request #2780 from bugwelle/patch-1
fix(docs): Fix link to contributing guide
2024-02-05 01:13:03 -05:00
dependabot[bot]
eb821761a1
build(deps-dev): bump activesupport from 7.0.4.3 to 7.1.3 in /docs
Bumps [activesupport](https://github.com/rails/rails) from 7.0.4.3 to 7.1.3.
- [Release notes](https://github.com/rails/rails/releases)
- [Changelog](https://github.com/rails/rails/blob/v7.1.3/activesupport/CHANGELOG.md)
- [Commits](https://github.com/rails/rails/compare/v7.0.4.3...v7.1.3)

---
updated-dependencies:
- dependency-name: activesupport
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-03 23:02:35 +00:00
Steven Kalt
d35efd4608
feat(cli): support building WASM via podman
Previously, `tree-sitter build-wasm` had the ability to build WASM
by using docker to pull in an image with a complete emscripten toolchain.
This commit adds the ability to use podman to do the same thing.

Using podman requires two notable changes:
1. Using the fully-qualified image name. Docker defaults to prepending
    `docker.io` to the image name, but podman does not.
2. Podman will mount the `/src/` volume as belonging to root unless
  `--userns=keep-id` is passed. I think podman's different
  volume-ownership is related to podman's daemonless execution and
  `--uidmap` functionality, but I'm not 100% sure.

To test, I ran
```sh
script/fetch-fixtures
script/generate-fixtures
script/generate-fixtures-wasm # <- the important one!
```

which worked as well as the docker version.
2024-01-29 00:50:32 -05:00
Amaan Qureshi
571fc02bd4
docs: add various binding and grammar links
Co-authored-by: Ramkumar Ramachandra <r@artagnon.com>
Co-authored-by: Yutaro Sakamoto <yutaro-sakamoto@yutaro-sakamoto.com>
Co-authored-by: Philipp Mildenberger <philipp@mildenberger.me>
Co-authored-by: Sepehr Laal <5657848+3p3r@users.noreply.github.com>
Co-authored-by: Lachance, Alexandre <alexandrelachance@me.com>
Co-authored-by: Derek Stride <derek@stride.host>
Co-authored-by: John Didion <github@didion.net>
Co-authored-by: Felix Rath <felixm.rath@gmail.com>
Co-authored-by: Javier Suarez <jsuarez@salesforce.com>
Co-authored-by: Fabian Wermelinger <fab4100@posteo.net>
Co-authored-by: Colin Kennedy <ckanimate@gmail.com>
Co-authored-by: Alfred Fuller <afuller@buf.build>
Co-authored-by: Boris Verkhovskiy <boris.verk@gmail.com>
Co-authored-by: Stanislav Romanov <kaermorchen@gmail.com>
Co-authored-by: Hamza Hamud <53880692+hhamud@users.noreply.github.com>
Co-authored-by: Tomas Sandven <tomas@sandven.email>
Co-authored-by: Vladimir Kazanov <vkazanov@inbox.ru>
Co-authored-by: citronneur <citronneur@gmail.com>
Co-authored-by: DennySun2100 <138833544+DennySun2100@users.noreply.github.com>
Co-authored-by: Z572 <37945516+Z572@users.noreply.github.com>
Co-authored-by: alaviss <leorize+oss@disroot.org>
2024-01-25 21:41:07 -05:00
Adrian Alic
6fd3582ae3
Add missing closing parenthesis 2024-01-25 20:45:46 -05:00
Andre Meyering
0da0da043e
fix(docs): Fix link to contributing guide
The link to the contribution guide on 
https://tree-sitter.github.io/tree-sitter/using-parsers was dead.
2023-11-24 09:59:00 +01:00
Firas al-Khalil
665da5e230 doc: fix multi-language program typo 2023-11-06 13:18:09 +01:00
Amaan Qureshi
c5cb27e522
docs: improve predicate docs 2023-08-31 16:01:37 -04:00
Amaan Qureshi
95ab103f48
docs: update injection properties 2023-08-22 01:36:25 -04:00
Amaan Qureshi
45313e0dfb
feat: add injection.self to inject a node with itself 2023-08-18 18:37:57 -04:00
dependabot[bot]
5cca35e2ef
chore(deps-dev): bump commonmarker from 0.23.9 to 0.23.10 in /docs
Bumps [commonmarker](https://github.com/gjtorikian/commonmarker) from 0.23.9 to 0.23.10.
- [Release notes](https://github.com/gjtorikian/commonmarker/releases)
- [Changelog](https://github.com/gjtorikian/commonmarker/blob/v0.23.10/CHANGELOG.md)
- [Commits](https://github.com/gjtorikian/commonmarker/compare/v0.23.9...v0.23.10)

---
updated-dependencies:
- dependency-name: commonmarker
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-08-08 20:25:20 +00:00
Ganesan Arjuna Maharaja
f9f51480eb correcting the spelling of valid_symbols in indent dedent example 2023-07-29 20:55:33 +05:30
Amaan Qureshi
c1d227bdb7
docs: document negative assertions 2023-07-25 00:32:40 -04:00
Andrew Hlynskyi
3c806913d8 docs: improve external scanner details and fix conflicting tokens details
* Removed convention notes introduced in #1947 due to:
  * It doesn't so strict for bindings and they may need to obey to some
    target language conventions.
  * For language grammars there is a note that states the same in the
    `Creating Parsers` section.
* Removed `External Scanning` item introduced in 87a0517 commit
  originated from #1612 due to unclear consistency with other
  5 original statements. There is a similar explanation in the
  `Other External Scanner Details` section.
2023-04-16 23:46:21 +03:00
Andrew Hlynskyi
613382c70a docs: update badges; fix markdown lint complains
Linter config `.vscode/settings.json`:
```json
{
    "[markdown]": {
        "files.trimTrailingWhitespace": false,
    },
    "markdownlint.config": {
        "default": true,
        // "ul-style": {
        //     "style": "asterisk"
        // },
        "MD001": false,
        "MD024": false,
        "MD025": false,
        "MD033": false,
        "MD041": false,
        "MD053": false,
    },
}
```
2023-04-16 23:39:08 +03:00
Andrew Hlynskyi
d7fcc7aad3
Merge pull request #2206 from tree-sitter/fix-docs-prec-rules
docs: remove controversial statement
2023-04-15 05:43:04 +03:00
dependabot[bot]
e47f05062a chore(deps): bump commonmarker from 0.23.8 to 0.23.9 in /docs
Bumps [commonmarker](https://github.com/gjtorikian/commonmarker) from 0.23.8 to 0.23.9.
- [Release notes](https://github.com/gjtorikian/commonmarker/releases)
- [Changelog](https://github.com/gjtorikian/commonmarker/blob/main/CHANGELOG.md)
- [Commits](https://github.com/gjtorikian/commonmarker/compare/v0.23.8...v0.23.9)

---
updated-dependencies:
- dependency-name: commonmarker
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-15 05:15:36 +03:00
Andrew Hlynskyi
b5e6d18086 docs: add a grammar syntax sample for lexical precedence 2023-04-15 05:10:02 +03:00
Andrew Hlynskyi
bfd56a1e59 docs: remove controversial Earliest Starting Position item added previously by 87a0517 2023-04-15 05:10:02 +03:00
Andrew Hlynskyi
1f051d339c chore(docs): fix misprint repetitions and remove dangling spaces 2023-04-09 20:40:18 +03:00
Kait Lam
e3ea048db1 docs: alphabetise language bindings on front page
This helps with readability when scanning for a particular language. It is, strangely, almost sorted with the exception of Java and Kotlin.
2023-04-09 17:48:00 +03:00
Carlo Teubner
34e0ab696c
docs: remove mention of Atom
Atom is dead, so this mention seems unnecessary now.
2023-04-08 18:10:44 +01:00
Andrew Hlynskyi
c26dde0414
Merge pull request #1947 from hickford/patch-3
docs: explain naming convention for bindings and parsers
2023-04-04 18:37:18 +03:00
M Hickford
5ce60ef9e5 docs: clarify naming convention for bindings and parsers 2023-04-04 18:29:52 +03:00
Andreas Deininger
0751736d17 docs: convert various links to https protocol 2023-04-04 18:05:46 +03:00
Andrew Hlynskyi
2ce06b623e docs: update Gemfile.lock to fix GH dependabot complains
Updated with commands like:
  > gem install bundler
  > bundle config set --local path 'vendor/bundle'
  > bundle update --bundler
  > #bundle add webrick
  > bundle update
  > #bundle exec jekyll serve
2023-03-15 12:38:06 +02:00
Andrew Hlynskyi
1b2a3e3c73 docs: add webrick to Gemfile to fix a compat issue 2023-03-15 12:31:54 +02:00
Andrew Hlynskyi
5766b8a0a7 docs: apply scheme marker for all query syntax snippets 2023-02-06 21:33:50 +02:00
Andrew Hlynskyi
2e732d17dd docs: merge of all binding and grammar link PRs
Joined commit messages:
---

Closes: #2048

    docs: add capnp, smali, thrift

Closes: #2026

    Add Perl binding

Closes: #1989

    Add Ada to the list of available parsers

Closes: #1980

    Add clojure to list of available parsers

    After some discussion in
    https://github.com/sogaiu/tree-sitter-clojure/issues/28

    I decided to submit an issue to the tree-sitter organization
    to include tree-sitter-clojure in their list of available parsers.
    This repository is used by a couple of editors and tools, and
    I am using it to build a tree-sitter based programming mode
    for Clojure in Emacs.
    Since there are a couple of tools that depend on it, it seems
    worthy of inclusion in an official list of tree-sitter grammars.

Closes: #1943

    Add meson grammar to list.

Closes: #1926

    docs(meson): add parse for meson
    add meson

Closes: #1912

    Merge branch 'master' into add-heex-parser

Closes: #1908

    Add Apex to available parsers

Closes: #1876

    Add tree-sitter-gleam to list of available parsers

Closes: #1862

    DOCS: Add entries various SQL flavor parsers

Closes: #1857

    Add Go to the available language bindings

Closes: #1856

    docs: add jq grammar

Closes: #1828

    Add tree sitter lalrpop

    This is a parser for https://github.com/lalrpop/lalrpop,
    a parser generator for use in Rust.

    It is still in development because it should support some kind
    of highlighting of the pseudo rust code used in rules.

Closes: #1733

    Add YANG parser to parser list
    I wrote this parser over summer vacation last year and I've been using it at work every day since.

Closes: #1728

    Add link to m68k grammar
    Link to m68k (Motorola 68000 assembly) grammar in docs.

Closes: #1697

    Added rego language

Closes: #1694

    docs: add Formula parser

Closes: #1672

    docs: Add link to QML (Qt UI spec/programming language) parser

Closes: #1671

    parser: add beancount parser link

Closes: #1623

    Add link to llvm grammars
    Add links to LLVM IR, MIR and TableGen parsers.

Closes: #1579

    Add my Smali parser to the WIP list

Closes: #1575

    Update index.md

Closes: #1563

    Add re2c and sort alphabetically

    Added re2c parser (lexer generator).
    Sorted the list alphabetically case-insensitively.

Closes: #1209

    add link to chess Portable Game Notation grammar

Closes: #1176

    Add tree-sitter-lean.

Closes: #1123

    Add parsers to list

---
Co-authored-by: Amaan Qureshi <amaanq12@gmail.com>
Co-authored-by: Felipe Gasper <FGasper@users.noreply.github.com>
Co-authored-by: Emmanuel Briot <briot.emmanuel@gmail.com>
Co-authored-by: Danny Freeman <dannyfreeman@users.noreply.github.com>
Co-authored-by: Garrett D'Amore <garrett@damore.org>
Co-authored-by: ShootingStarDragons <ShootingStarDragons@protonmail.com>
Co-authored-by: Clay <connorlay@users.noreply.github.com>
Co-authored-by: Anthony Heber <anthony@heber.dev>
Co-authored-by: Jonathan Arnett <jonarnett90@gmail.com>
Co-authored-by: takegue <takegue@gmail.com>
Co-authored-by: Cédric Fabianski <cedric@bearer.sh>
Co-authored-by: flurie <flurie@gmail.com>
Co-authored-by: traxys <quentin+dev@familleboyer.net>
Co-authored-by: Tomas Sandven <597206+Hubro@users.noreply.github.com>
Co-authored-by: Graham Bates <info@grahambates.com>
Co-authored-by: Lex <mr.x97@mail.ru>
Co-authored-by: Ben Siraphob <bensiraphob@gmail.com>
Co-authored-by: Yuya Nishihara <yuya@tcha.org>
Co-authored-by: WeiZhang <kweizh@gmail.com>
Co-authored-by: Flakebi <flakebi@t-online.de>
Co-authored-by: Yotam <me@yotam.net>
Co-authored-by: Fymyte <34305318+Fymyte@users.noreply.github.com>
Co-authored-by: Alexandre A. Muller <muller@outlook.com>
Co-authored-by: Roland Walker <walker@pobox.com>
Co-authored-by: Julian Berman <Julian@GrayVines.com>
Co-authored-by: Santos Gallegos <stsewd@protonmail.com>
2023-01-27 10:15:23 +02:00
Andrew Hlynskyi
cca626afe7 docs: remove duplicated link 2023-01-27 07:49:07 +02:00
Matt
ae3b60bd29
Include many new parsers in a unified list 2023-01-17 09:14:57 -05:00
Andrew Helwer
278ff01e71 Added additional documentation details
* External scanners and infinite loops
* Terminal keywords in externals array
* Using error sentinel external token
* Good practice to erase state variables in deserialize func
* Emphasize external scanner is called first
2023-01-03 02:48:55 +02:00
Andrew Helwer
87a0517f3c Various updates to Creating Parsers docs
* Documented test separator suffixes
* Documented partial precedences field
* Added external scanning to conflicting tokens rules
* Added earliest starting position to conflicting tokens rules
* Added note about lexical precedence vs. parse precedence
* Added note about tree-sitter calling external scanner with all
  tokens marked valid during error recovery
2023-01-03 02:48:48 +02:00
Andrew Helwer
dddbc2d4f7 Added working commands for Windows users
Windows users are likely to be using either Windows Terminal (which uses PowerShell) or PowerShell directly.
2023-01-02 02:31:06 +02:00
Max Brunsfeld
8883d43bee
Merge pull request #1941 from mliszcz/master
Fix test output formatting for rules starting with M/U
2022-11-15 17:13:39 -08:00
Max Brunsfeld
37e0e8a7ab
Merge pull request #1918 from alanz/add-erlang-complete
Add Erlang to list of Available Parsers
2022-11-15 16:27:39 -08:00
mliszcz
7bf2484d81 Fix test output formatting for rules starting with M/U
Previously the rule names could not begin with an uppercase M or U
because the test output formatter assumed that they represent special
tokens: MISSING or UEXPECTED.

Fixes #1940.
2022-11-15 20:20:44 +01:00
Jonathan Arnett
245e3b0092 Add note about including an external scanner in Rust crate 2022-10-30 23:24:50 -04:00
Garrett D'Amore
db846931c6
Add D grammar - it is quite complete for D 2.100. 2022-10-20 08:33:43 -07:00
Alan Zimmerman
54ace9fe27 Add Erlang to list of Available Parsers
Switching from under-development

  https://github.com/AbstractMachinesLab/tree-sitter-erlang

to

  https://github.com/WhatsApp/tree-sitter-erlang/

which is based originally on it.
2022-10-20 09:50:14 +01:00
Gilles Roustan
346572a348 Add twig parser in documentation 2022-10-04 10:08:56 +02:00
Max Brunsfeld
d1d8193d2f
Merge pull request #1858 from mattmassicotte/swift-docs-update
Update ref to swift parser
2022-09-06 14:09:02 -07:00
Matt
94b828f4fb
Update ref to swift parser 2022-09-05 16:21:12 -04:00
Max Brunsfeld
3563fe009a Explain in the docs that npm install supports limited platforms 2022-09-02 15:31:21 -07:00
Max Brunsfeld
366210ae92
Merge pull request #1766 from 6cdh/racket-link
Add link to Racket language parser
2022-08-25 10:52:34 -07:00
petrisch
40a2afad49
Update section-2-using-parsers.md
Typo
2022-06-27 10:15:23 +02:00