Module lexer

Available on crate feature lexer only.

First pass lexer that gets run on the source code and returns a series of tokens with their associated Fragments.

Note that this will strip out comments and whitespace, returning only fragments that match one of the paterns defined for tokens.

Modules

• comments
  Implementation of comment token lexing.
• identifier
  Implementation related to parsing keywords and identifiers.
• integer_literal
  Implementation for lexing integer literals.
• quoted
  Lexing implementation for quoted literals.
• token
  Token models.
• trivial
  Trivial tokens and their implementation.

Structs

• Lexer
  The lexical analyser for wright. This produces a series of tokens that make up the larger elements of the language.