Class Lexer

Index

Constructors

Accessors

keepComments preprocessing tokenAtStartOfLine tokenHasLeadingSpace tokenKind tokenLength tokenOffset tokenText

Methods

Constructors

constructor

new Lexer(source: string): Lexer
Creates a new lexer.
Parameters
- source: string
  The source code to be tokenized.
Returns Lexer
- Defined in Lexer.ts:32

Accessors

keepComments

get keepComments(): boolean
Returns whether the lexer should keep comments.

Returns boolean
- Defined in Lexer.ts:68
set keepComments(value: boolean): void
Sets whether the lexer should keep comments.
Parameters
- value: boolean
Returns void
- Defined in Lexer.ts:75

preprocessing

get preprocessing(): boolean
Returns whether the lexer is configured to preprocess the input.

Returns boolean
- Defined in Lexer.ts:54
set preprocessing(value: boolean): void
Sets whether the lexer should preprocess the input.
Parameters
- value: boolean
Returns void
- Defined in Lexer.ts:61

tokenAtStartOfLine

get tokenAtStartOfLine(): boolean
Returns whether the current token is at the start of a line.

Returns boolean
- Defined in Lexer.ts:89

tokenHasLeadingSpace

get tokenHasLeadingSpace(): boolean
Returns whether the current token has a leading space.

Returns boolean
- Defined in Lexer.ts:96

tokenKind

get tokenKind(): TokenKind
Returns the current token kind.

Returns TokenKind
- Defined in Lexer.ts:82

tokenLength

get tokenLength(): number
Returns the length of the current token.

Returns number
- Defined in Lexer.ts:110

tokenOffset

get tokenOffset(): number
Returns the offset of the current token.

Returns number
- Defined in Lexer.ts:103

tokenText

get tokenText(): string
Returns the text of the current token.

Returns string
- Defined in Lexer.ts:117

Methods

dispose

dispose(): void
Disposes the lexer.

Returns void
- Defined in Lexer.ts:39

next

next(): TokenKind
Returns the next token.

Returns TokenKind
The next token.
- Defined in Lexer.ts:47