Prism::Translation::Parser::Lexer

< Object 5 instance methods 1 class methods

Accepts a list of prism tokens and converts them into the expected format for the parser gem.

Class methods 1

.new

Instance methods 5

#parse_complex #parse_float #parse_integer #parse_rational #to_a

Constants

EXPR_BEG

These constants represent flags in our lex state. We really, really don’t want to be using them and we really, really don’t want to be exposing them as part of our public API. Unfortunately, we don’t have another way of matching the exact tokens that the parser gem expects without them. We should find another way to do this, but in the meantime we’ll hide them from the documentation and mark them as private constants.

EXPR_LABEL

No documentation available

LAMBDA_TOKEN_TYPES

It is used to determine whether do is of the token type kDO or kDO_LAMBDA.

NOTE: In edge cases like ‘-> (foo = -> (bar) {}) do end`, please note that kDO is still returned instead of kDO_LAMBDA, which is expected: github.com/ruby/prism/pull/3046

LPAREN_CONVERSION_TOKEN_TYPES

The PARENTHESIS_LEFT token in Prism is classified as either tLPAREN or tLPAREN2 in the Parser gem. The following token types are listed as those classified as tLPAREN.

Range

No documentation available

TYPES

The direct translating of types between the two lexers.

Attributes

lexed

Read

An array of tuples that contain prism tokens and their associated lex state when they were lexed.

offset_cache

Read

A hash that maps offsets in bytes to offsets in characters.

source_buffer

Read

The Parser::Source::Buffer that the tokens were lexed from.