Skip to content

lexer: handle multiline comment after keyword#89

Open
blotus wants to merge 1 commit intoDataDog:mainfrom
blotus:ident-multilinecomment-fix
Open

lexer: handle multiline comment after keyword#89
blotus wants to merge 1 commit intoDataDog:mainfrom
blotus:ident-multilinecomment-fix

Conversation

@blotus
Copy link

@blotus blotus commented Mar 10, 2026

Hello,

While testing your (excellent) library, we found a corner case in which SQL keywords were not properly detected when followed directly by a multiline comment.

Before this change, the query select/**/*/**/from/**/events would get tokenized as:

select/
*
*
/*/**/
from/
*
*
/
events

Note the / from the comment being part of select.

With this change, it now gets parsed as:

select
/**/
*
/**/
from
/**/
events

@blotus blotus requested a review from a team as a code owner March 10, 2026 14:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant