ydb/yql/essentials/sql/v1/lexer/lexer.cpp, branch oidc-1.2.5-devMirror of YDB github reposhttps://code.mastervirt.ru/ydb/atom?h=oidc-1.2.5-dev2025-06-18T12:49:04ZYQL-20086 sql2025-06-18T12:49:04Zvvvvvvvv@yandex-team.com2025-06-18T12:12:37Zurn:sha1:379a419911ee1bbb93f56085133712fa5d8c3112
commit_hash:b06f3d2f5fa81e2073966eb172758758bd94fdf2
YQL-19616 Convert YQL lexer grammar to regexes2025-03-28T15:50:04Zvityamanvityaman.dev@yandex.ru2025-03-28T15:29:24Zurn:sha1:60b99f11bcb2386c2a1c36ffd2e96e69d0105dac
- [x] Parse YQL grammar to extract lexer grammar into `TLexerGrammar`.
- [x] Translate `TLexerGrammar` into regexes.
- [x] Implement a lexer via regexes `TRegexLexer` to test generated regexes validity.
- [x] Test on `Default` syntax mode.
- [x] Test on `ANSI` syntax mode.
---
- Related to https://github.com/ydb-platform/ydb/issues/15129
- Requirement for https://github.com/ytsaurus/ytsaurus/pull/1112
---
Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1127
commit_hash:03ffffe81cdafe7f93a4d3fd9a3212fe67f1c72d
YQL-19747 Split statements2025-03-27T20:42:19Zvityamanvityaman.dev@yandex.ru2025-03-27T20:28:33Zurn:sha1:b24ce722d5cf848fcbe6c6f9b6fce9698174d3de
When we run completion engine on multi-statement query, where preceding statements are syntactically incorrect, `antlr4-c3` does not return candidates. Running engine only on a current statement provides a best-effort attempt to provide candidates.
- Related to https://github.com/ydb-platform/ydb/issues/9056
- Depends on https://github.com/ytsaurus/ytsaurus/pull/1127 (`ELexerFlavor`)
---
Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1144
commit_hash:0ced9443a9712191f5420246531f781ca4bc5f42
YQL-19616 Implement ILexer via antlr_ast2025-03-19T10:18:48ZVictor Smirnov53015676+vityaman@users.noreply.github.com2025-03-19T10:03:56Zurn:sha1:28b29535ce7b21a3dde60b485c98f66f8c08f882
- [x] Added `antlr_ast/antlr4` module and moved `TLexerTokensCollector4` there from `proto_ast/antlr4`.
- [x] Moved stuff around back and forth.
Ready for a review.
---
Co-authored-by: vityaman [vityaman.dev@yandex.ru]
Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1128
commit_hash:e08785c3408ef813505bdc7511560e9536f4ab79
refine Antlr deps2025-02-27T20:34:50Zvvvvvvvv@yandex-team.com2025-02-27T20:18:15Zurn:sha1:042383afc665c770fae0a51b02fcd6671cc3bd35
refine Antlr deps
commit_hash:71b99424edb283bf56be6e79c9c9a19d805ce2ce
YQL-19594 Explicit lexers & parsers 22025-02-21T10:58:34Zvvvvvvvv@yandex-team.com2025-02-21T10:37:16Zurn:sha1:39c78c7d5074d33cc06b63234fa96e9a93213fdc
commit_hash:2aa733486a55a04c39ff8bb1c7eaca3a85719647
Introduced lexer & parser interfaces2025-02-18T13:08:18Zvvvvvvvv@yandex-team.com2025-02-18T11:49:48Zurn:sha1:1213d16b7fd20d4255d2ebb709a1745efbfeb91b
commit_hash:fee365c90a176dd33a967cee20994b21d530080c
YQL-19553 CLI for yql linter2025-02-10T12:36:34Zvvvvvvvv@yandex-team.com2025-02-10T11:34:20Zurn:sha1:5079f75b9e1bdf35a019a79274547b338254846f
init
commit_hash:a21a71769ad2095e40909c69255a3cf38eabc179
YQL-19553 initial implementation of YQL linters2025-02-07T13:03:02Zvvvvvvvv@yandex-team.com2025-02-07T12:41:05Zurn:sha1:eef90607948dfac38d51bcfcbd582492bc1ece60
commit_hash:70690bcdabf0bcfe095fb10e9e58717281d11d53
YQL for create, alter and drop transfer from topic to table2025-01-21T11:32:19Ztesseracttesseract@yandex-team.com2025-01-21T09:50:29Zurn:sha1:e677409ecb6106695a976307290b2f6bad3d72c0
commit_hash:09502f46a7ee665609d2c4ba8d9e0aa421720cdb