mirror of
https://github.com/rust-lang/rust.git
synced 2025-05-14 02:49:40 +00:00
86b0bafbf1
parser: Ensure that all nonterminals have tokens after parsing
`parse_nonterminal` should always result in something with tokens.
This requirement wasn't satisfied in two cases:
- `stmt` nonterminal with expression statements (e.g. `0`, or `{}`, or `path + 1`) because `fn parse_stmt_without_recovery` forgot to propagate `force_collect` in some cases.
- `expr` nonterminal with expressions with built-in attributes (e.g. `#[allow(warnings)] 0`) due to an incorrect optimization in `fn parse_expr_force_collect`, it assumed that all expressions starting with `#` have their tokens collected during parsing, but that's not true if all the attributes on that expression are built-in and inert.
(Discovered when trying to implement eager `cfg` expansion for all attributes https://github.com/rust-lang/rust/pull/83824#issuecomment-817317170.)
r? `@Aaron1011`
|
||
|---|---|---|
| .. | ||
| ast | ||
| attr | ||
| expand | ||
| util | ||
| ast_like.rs | ||
| ast.rs | ||
| entry.rs | ||
| lib.rs | ||
| mut_visit.rs | ||
| node_id.rs | ||
| ptr.rs | ||
| token.rs | ||
| tokenstream.rs | ||
| visit.rs | ||