Module trivial

Available on crate feature lexer only.

Trivial tokens and their implementation.

Constants

• SINGLE_ASCII_CHAR_TRIVIAL_TOKENS
  Single ASCII character trivial tokens that can be matched directly against the source code.
• TWO_ASCII_TRIVIAL_TOKENS
  Trivial tokens that are two ASCII characters and can be matched directly against the input source code.

Functions

• try_consume_trivial_token
  Attempt to consume a “trivial” token from the start of the Lexer’s Lexer::remaining fragment.