-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add EBNF for AST to book #1066
base: main
Are you sure you want to change the base?
Add EBNF for AST to book #1066
Changes from 5 commits
64c9561
9d69c95
1d9da95
8a0c8a9
9692b39
0bbe2b2
5abc947
0d12b3d
29c4aac
3031479
66c9f87
1edfe2f
bfbf8ba
9ababbb
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,237 @@ | ||
We currently take inputs from the following AST (visualization can be done | ||
using <https://rr.red-dove.com/ui>). Literals are strings, numbers and | ||
booleans | ||
|
||
``` ebnf | ||
char ::= [a-zA-Z] | ||
string ::= char* | ||
digit ::= [0-9] | ||
uint ::= digit+ | ||
int ::= ("-")? uint | ||
float ::= int (".")? uint | ||
bool ::= "true" | "false" | ||
|
||
literal ::= | ||
| "\"" string "\"" | ||
| "'" char "'" | ||
| int | ||
| float | ||
| bool | ||
``` | ||
|
||
We support a number of simple types characters, strings, booleans and | ||
numbers. Number types for integers (8,16,32,64,128 bit or machine sized) | ||
and floats (16,32, or 64 bit). Composite types are tuples, fixed length | ||
lists (arrays), variable length lists (vectors/slices), ptr types, and | ||
function types. Lastly we have named types defined by items, e.g. enums | ||
and structs. | ||
|
||
``` ebnf | ||
generic_value ::= | ||
| "'" ident | ||
| ty | ||
| expr | ||
|
||
impl ::= | ||
| "self" | ||
| goal | ||
| "dyn" | ||
| <!TODO!> | ||
goal ::= ident "<" (generic_value ",")* ">" | ||
|
||
ty ::= | ||
| "bool" | ||
| "char" | ||
| "u8" | "u16" | "u32" | "u64" | "u128" | "usize" | ||
| "i8" | "i16" | "i32" | "i64" | "i128" | "isize" | ||
| "f16" | "f32" | "f64" | ||
| "str" | ||
| (ty ",")* | ||
| "[" ty ";" int "]" | ||
| "[" ty "]" | ||
| "*const" ty | "*mut" ty | ||
| "*" expr | "*mut" expr | ||
| ident | ||
| (ty "->")* ty | ||
| impl "::" ident | ||
| "impl" ty | ||
| (goal)* | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I don't get this (goal)* line here. From what variant in AST does this come from? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Should be | "dyn" (goal)* |
||
``` | ||
|
||
The patterns allowed reflect these types. Wildcard patterns, literal | ||
types, typed patterns, list patterns, record or tuple patterns. | ||
|
||
``` ebnf | ||
pat ::= | ||
| "_" | ||
| pat ":" ty | ||
| (ident "{" (ident ":" pat ";")* "}" | ident "(" (pat ",")* ")" ) | ||
| (pat "|")* pat | ||
| ("[" (expr ",")* "]" | "[" expr ";" int "]") | ||
| "&" pat | ||
| literal | ||
| ident "@" pat | ||
cmester0 marked this conversation as resolved.
Show resolved
Hide resolved
|
||
``` | ||
|
||
The simple expressions are literals, local or global variables, type | ||
casts, assignments and lists. Control flow expressions, if statements, | ||
match statements, loops, return, break and continue. The rest is blocks, | ||
macro calls, lambda functions and borrowing. | ||
|
||
``` ebnf | ||
local_var ::= ident | ||
global_var ::= ident | ||
|
||
modifiers ::= "" | "unsafe" modifiers | "const" modifiers | ||
|
||
lhs ::= pat | ||
param ::= pat | ||
|
||
expr ::= | ||
| "if" expr "{" expr "}" ("else" "{" expr "}")? | ||
| expr "(" (expr ",")* ")" | ||
| literal | ||
| "[" (expr ",")* "]" | "[" expr ";" int "]" | ||
| ident "(" (expr ",")* ")" | ident "{" (ident ":"expr ";")* "}" | ident "{" (ident ":"expr ";")* ".." expr "}" | ||
| "match" expr "{" (("|" pat)* "=>" (expr "," | "{" expr "}"))* "}" | ||
| "let" pat (":" ty)? ":=" expr ";" expr | ||
| modifiers "{" expr "}" | ||
| local_var | ||
| global_var | ||
| expr "as" ty | ||
| loops_expr | ||
| lhs "=" expr | ||
| "return" expr | ||
| expr "?" | ||
| "&" ("mut")? expr | ||
| "&" expr "as" "&const _" | "&mut" expr "as" "&mut _" | ||
| "|" param "|" expr | ||
|
||
loops_expr ::= | ||
| "loop" "{" expr "}" | ||
| "while" "(" expr ")" "{" expr "}" | ||
| "for" "(" pat "in" expr ")" "{" expr "}" | ||
| "for" "(" "let" ident "in" expr ".." expr ")" "{" expr "}" | ||
| "break" expr | ||
| "continue" | ||
``` | ||
|
||
The items supported are functions, type aliasing, enums, structs, trait | ||
definitions and implementations, and imports. | ||
|
||
``` ebnf | ||
item ::= | ||
| modifiers "fn" ident "(" (pat ":" ty ",")* ")" (":" ty)? "{" expr "}" | ||
| "type" ident "=" ty | ||
| "enum" ident "=" "{" (ident ("(" (ty)* ")")? ",")* "}" | ||
| "struct" ident "=" "{" (ident ":" ty ",")* "}" | ||
| "trait" ident "{" (trait_item)* "}" | ||
| "impl" ("<" (generics ",")* ">")? ident "for" ty "{" (impl_item)* "}" | ||
| "use" path ";" | ||
``` | ||
|
||
The full AST description | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The full AST description is really just a I guess this is for visualization? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yes, wanted it to have the full description somewhere, but could just be a separate file. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Throwing this onto https://rr.red-dove.com/ui gives me errors. Can you check what's wrong? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Seems it does not like escaping |
||
|
||
``` ebnf | ||
char ::= [a-zA-Z] | ||
string ::= char* | ||
digit ::= [0-9] | ||
uint ::= digit+ | ||
int ::= ("-")? uint | ||
float ::= int (".")? uint | ||
bool ::= "true" | "false" | ||
|
||
literal ::= | ||
| "\"" string "\"" | ||
| "'" char "'" | ||
| int | ||
| float | ||
| bool | ||
|
||
ident ::= string | ||
|
||
generic_value ::= | ||
| "'" ident | ||
| ty | ||
| expr | ||
|
||
impl ::= | ||
| "self" | ||
| goal | ||
| "dyn" | ||
| <!TODO!> | ||
goal ::= ident "<" (generic_value ",")* ">" | ||
|
||
ty ::= | ||
| "bool" | ||
| "char" | ||
| "u8" | "u16" | "u32" | "u64" | "u128" | "usize" | ||
| "f16" | "f32" | "f64" | ||
| "str" | ||
| (ty ",")* | ||
| ident "(" (ident ",")* ")" | ||
| "[" ty ";" int "]" | ||
| "[" ty "]" | ||
| "*const" ty | "*mut" ty | ||
| "*" expr | "*mut" expr | ||
| ident | ||
| (ty "->")* ty | ||
| impl "::" ident | ||
| "impl" ty | ||
| "dyn" (goal)* | ||
|
||
pat ::= | ||
| "_" | ||
| pat ":" | ||
| (ident "{" (ident ":" pat ";")* "}" | ident "(" (pat ",")* ")" ) | ||
| (pat "|")* pat | ||
| ("[" (expr ",")* "]" | "[" expr ";" int "]") | ||
| "&" pat | ||
| literal | ||
| ident "@" pat | ||
|
||
local_var ::= ident | ||
global_var ::= ident | ||
|
||
modifiers ::= "" | "unsafe" modifiers | "const" modifiers | ||
|
||
lhs ::= pat | ||
param ::= pat | ||
|
||
expr ::= | ||
| "if" expr "{" expr "}" ("else" "{" expr "}")? | ||
| expr "(" (expr ",")* ")" | ||
| literal | ||
| "[" (expr ",")* "]" | "[" expr ";" int "]" | ||
| ident "(" (expr ",")* ")" | ident "{" (ident ":"expr ";")* "}" | ident "{" (ident ":"expr ";")* ".." expr "}" | ||
| "match" expr "{" (("|" pat)* "=>" (expr "," | "{" expr "}"))* "}" | ||
| "let" pat (":" ty)? ":=" expr ";" expr | ||
| modifiers "{" expr "}" | ||
| local_var | ||
| global_var | ||
| expr "as" ty | ||
| loops_expr | ||
| lhs "=" expr | ||
| "return" expr | ||
| expr "?" | ||
| "&" ("mut")? expr | ||
| "&" expr "as" "&const _" | "&mut" expr "as" "&mut _" | ||
| "|" param "|" expr | ||
|
||
loops_expr ::= | ||
| "loop" "{" expr "}" | ||
| "while" "(" expr ")" "{" expr "}" | ||
| "for" "(" pat "in" expr ")" "{" expr "}" | ||
| "for" "(" "let" ident "in" expr ".." expr ")" "{" expr "}" | ||
| "break" expr | ||
| "continue" | ||
|
||
item ::= | ||
| modifiers "fn" ident "(" (pat ":" ty ",")* ")" (":" ty)? "{" expr "}" | ||
| "type" ident "=" ty | ||
| "enum" ident "=" "{" (ident ("(" (ty)* ")")? ",")* "}" | ||
| "struct" ident "=" "{" (ident ":" ty ",")* "}" | ||
| "trait" ident "{" (trait_item)* "}" | ||
| "impl" ("<" (generics ",")* ">")? ident "for" ty "{" (impl_item)* "}" | ||
| "use" path ";" | ||
``` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I guess we can remove this TODO altogether?
The category
impl
is a bit weird since it has no Rust syntax, but I think it's fine