Plain text lexer.
The input chunks converted to string tokens directly, without any change.
Constructs plain text lexer.
Emitter function called each time a token is found.
Whether to emit a raw string rather quoted string. false by default.
false
Flushes the input emitting all pending tokens.
Scans the input chunk for tokens.
chunk
Chunk of input to scan.
Generated using TypeDoc
Plain text lexer.
The input chunks converted to string tokens directly, without any change.