Prism::Translation::Parser::Lexer

< Object 17 instance methods 1 class methods

Accepts a list of prism tokens and converts them into the expected format for the parser gem.

Class methods 1

Instance methods 17

#calculate_heredoc_whitespace #escape_build #escape_read #interpolation? #parse_complex #parse_float #parse_integer #parse_rational #percent_array? #percent_array_leading_whitespace #percent_array_unescape #range #regexp? #simplify_string? #to_a #trim_heredoc_whitespace #unescape_string

Constants

COMMENT_CONTINUATION_TYPES

Types of tokens that are allowed to continue a method call with comments in-between. For these, the parser gem doesn’t emit a newline token after the last comment.

DELIMITER_SYMETRY

When one of these delimiters is encountered, then the other one is allowed to be escaped as well.

ESCAPES

Escape sequences that have special and should appear unescaped in the resulting string.

These constants represent flags in our lex state. We really, really don’t want to be using them and we really, really don’t want to be exposing them as part of our public API. Unfortunately, we don’t have another way of matching the exact tokens that the parser gem expects without them. We should find another way to do this, but in the meantime we’ll hide them from the documentation and mark them as private constants.

EXPR_LABEL

No documentation available

HeredocData

Heredocs are complex and require us to keep track of a bit of info to refer to later

LAMBDA_TOKEN_TYPES

It is used to determine whether do is of the token type kDO or kDO_LAMBDA.

NOTE: In edge cases like -> (foo = -> (bar) {}) do end, please note that kDO is still returned instead of kDO_LAMBDA, which is expected: github.com/ruby/prism/pull/3046

LPAREN_CONVERSION_TOKEN_TYPES

The PARENTHESIS_LEFT token in Prism is classified as either tLPAREN or tLPAREN2 in the Parser gem. The following token types are listed as those classified as tLPAREN.