Available on crate feature
lexer only.Expand description
First pass lexer that gets run on the source code and returns a series of tokens with their associated Fragments.
Note that this will strip out comments and whitespace, returning only fragments that match one of the paterns defined for tokens.
Modules§
- comments
- Implementation of comment token lexing.
- identifier
- Implementation related to parsing keywords and identifiers.
- integer_
literal - Implementation for lexing integer literals.
- quoted
- Lexing implementation for quoted literals.
- token
- Token models.
- trivial
- Trivial tokens and their implementation.
Structs§
- Lexer
- The lexical analyser for wright. This produces a series of tokens that make up the larger elements of the language.