Module comments

Available on crate feature lexer only.

Implementation of comment token lexing.

Constants

• MULTI_LINE_COMMENT_END
  The pattern that ends any multi-line comments (including doc comments).
• MULTI_LINE_COMMENT_START
  The pattern that starts any multi-line comments (including doc comments).
• SINGLE_LINE_COMMENT_PREFIX
  The pattern that begins any single line comments (including doc comments).

Functions

• try_match_block_comment
  Attempt to match a block comment from the start of the Lexer::remaining fragment. Return a usize and optionally a TokenTy. The usize indicates how many bytes were in the comment. The TokenTy (if it’s not None) should be TokenTy::InnerBlockDocComment, TokenTy::OuterBlockDocComment, or TokenTy::UnterminatedBlockComment.
• try_match_single_line_comment
  Attempt to match a sinlgle line comment from the start of the Lexer::remaining fragment. Return a usize and optionally a TokenTy. The usize indicates how many bytes were in the comment. The TokenTy (if it’s not None) should be either TokenTy::InnerDocComment or TokenTy::OuterDocComment.