Module trivial

Available on crate feature lexer only.

Trivial tokens and their implementation.

Constants

SINGLE_ASCII_CHAR_TRIVIAL_TOKENS

Single ASCII character trivial tokens that can be matched directly against the source code.

TWO_ASCII_TRIVIAL_TOKENS

Trivial tokens that are two ASCII characters and can be matched directly against the input source code.

Functions

try_consume_trivial_token

Attempt to consume a “trivial” token from the start of the Lexer’s Lexer::remaining fragment.