ydb/yql/essentials/sql/v1/lexer/ut, branch mainMirror of YDB github reposhttps://code.mastervirt.ru/ydb/atom?h=main2025-10-16T10:32:23ZYQL-20490 Drop antlr3 grammar2025-10-16T10:32:23Zvvvvvvvv@yandex-team.com2025-10-16T09:36:14Zurn:sha1:c7fc294bcd5212a20e5c1b5708637580e7ba4863
commit_hash:6c5c638d87eb41018d637f1535af104fac16e51c
Intermediate changes2025-03-31T22:23:36Zrobot-pigletrobot-piglet@yandex-team.com2025-03-31T22:12:58Zurn:sha1:f93076bbe93dd6ebb8d75a930268d30839b9011a
commit_hash:e57b3e95787cc8037f200f1b6b6073e35403b27e
YQL-19616 Convert YQL lexer grammar to regexes2025-03-28T15:50:04Zvityamanvityaman.dev@yandex.ru2025-03-28T15:29:24Zurn:sha1:60b99f11bcb2386c2a1c36ffd2e96e69d0105dac
- [x] Parse YQL grammar to extract lexer grammar into `TLexerGrammar`.
- [x] Translate `TLexerGrammar` into regexes.
- [x] Implement a lexer via regexes `TRegexLexer` to test generated regexes validity.
- [x] Test on `Default` syntax mode.
- [x] Test on `ANSI` syntax mode.
---
- Related to https://github.com/ydb-platform/ydb/issues/15129
- Requirement for https://github.com/ytsaurus/ytsaurus/pull/1112
---
Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1127
commit_hash:03ffffe81cdafe7f93a4d3fd9a3212fe67f1c72d
YQL-19616 Implement ILexer via antlr_ast2025-03-19T10:18:48ZVictor Smirnov53015676+vityaman@users.noreply.github.com2025-03-19T10:03:56Zurn:sha1:28b29535ce7b21a3dde60b485c98f66f8c08f882
- [x] Added `antlr_ast/antlr4` module and moved `TLexerTokensCollector4` there from `proto_ast/antlr4`.
- [x] Moved stuff around back and forth.
Ready for a review.
---
Co-authored-by: vityaman [vityaman.dev@yandex.ru]
Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1128
commit_hash:e08785c3408ef813505bdc7511560e9536f4ab79
YQL-19594 Explicit lexers & parsers2025-02-19T14:46:38Zvvvvvvvv@yandex-team.com2025-02-19T14:28:26Zurn:sha1:52daccf61e2e827114cfb3372071cddaec7974ba
commit_hash:6be543b7c5bff6ee474ee606c920197fb2569767
Merge GH PR #94042024-11-12T05:10:50Zaneporadaaneporada@yandex-team.com2024-11-12T04:55:22Zurn:sha1:621c8c7dade57165d6d431295f7a9a9143a062fa
commit_hash:d780798556aedbe2be898d69185380f2ecb95f9c