aboutsummaryrefslogtreecommitdiffstats
path: root/yql/essentials/sql/v1/lexer
Commit message (Collapse)AuthorAgeFilesLines
* YQL-19616: Fix TRegexLexer performancevityaman9 days5-45/+120
| | | | | | | | | | | | | | | | | Fix `TRegexLexer` performance. Now it is just 2 times slower than a reference ANTLR implementation on Release mode, so merged regexes are 3 times better than scan&compare. ![image](https://github.com/user-attachments/assets/4e0cb27a-491d-4dbd-b10a-5725ffa6d902) --- - Related to `YQL-19616` - Related to https://github.com/ydb-platform/ydb/issues/15129 - Related to https://github.com/vityaman/ydb/issues/42 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1278 commit_hash:1529f641172fea13f0d33fbfd06a4827c6efde01
* Intermediate changesrobot-piglet2025-05-128-192/+332
| | | | commit_hash:3a624a323006078de71f50747f7b2e8cadba7ccd
* YQL-19616 refactor test lexers from sql2yql, supported facade run toolsvvvv2025-04-144-0/+113
| | | | commit_hash:fb1727dda2b8c7d2ff42d4436c54cb7aa1ce4bc2
* Intermediate changesrobot-piglet2025-04-144-3/+50
| | | | commit_hash:b6187f8eba6e8debc23f1928b2e44a396f3511ad
* YQL-19616 Fix lexer/regex STRING_VALUE and TSKIP recognitionvityaman2025-04-112-9/+39
| | | | | | | | | | - Related to https://github.com/ydb-platform/ydb/issues/15129 - Related to https://github.com/vityaman/ydb/issues/11 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1201 commit_hash:53ef677a35649a6dc77d8c4269a8aceefcd15026
* YQL-19616 Fix regex lexervityaman2025-04-094-8/+17
| | | | | | | | | | | | | | | | | | Fixed regex lexer issues: - `TSKIP` token recognition - `HEXGIGITS` number recognition - `EOF` token content --- - Related to https://github.com/ydb-platform/ydb/issues/15129 - Related to https://github.com/vityaman/ydb/issues/11 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1190 commit_hash:497c39efcbbe4e387da523b5e2c8abaa6485d93b
* Intermediate changesrobot-piglet2025-04-074-11/+18
| | | | commit_hash:6768768ea3a3962231d3fabdffb2ce0db44e9347
* Intermediate changesrobot-piglet2025-04-022-5/+7
| | | | commit_hash:28e9e4bd6b02e8914d82b2aafe9f341b5492421f
* Intermediate changesrobot-piglet2025-04-016-83/+323
| | | | commit_hash:e57b3e95787cc8037f200f1b6b6073e35403b27e
* YQL-19616 Convert YQL lexer grammar to regexesvityaman2025-03-2812-41/+988
| | | | | | | | | | | | | | | | | - [x] Parse YQL grammar to extract lexer grammar into `TLexerGrammar`. - [x] Translate `TLexerGrammar` into regexes. - [x] Implement a lexer via regexes `TRegexLexer` to test generated regexes validity. - [x] Test on `Default` syntax mode. - [x] Test on `ANSI` syntax mode. --- - Related to https://github.com/ydb-platform/ydb/issues/15129 - Requirement for https://github.com/ytsaurus/ytsaurus/pull/1112 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1127 commit_hash:03ffffe81cdafe7f93a4d3fd9a3212fe67f1c72d
* YQL-19747 Split statementsvityaman2025-03-272-9/+16
| | | | | | | | | | | | When we run completion engine on multi-statement query, where preceding statements are syntactically incorrect, `antlr4-c3` does not return candidates. Running engine only on a current statement provides a best-effort attempt to provide candidates. - Related to https://github.com/ydb-platform/ydb/issues/9056 - Depends on https://github.com/ytsaurus/ytsaurus/pull/1127 (`ELexerFlavor`) --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1144 commit_hash:0ced9443a9712191f5420246531f781ca4bc5f42
* YQL-19616 Implement ILexer via antlr_astVictor Smirnov2025-03-1912-16/+165
| | | | | | | | | | | | | - [x] Added `antlr_ast/antlr4` module and moved `TLexerTokensCollector4` there from `proto_ast/antlr4`. - [x] Moved stuff around back and forth. Ready for a review. --- Co-authored-by: vityaman [vityaman.dev@yandex.ru] Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1128 commit_hash:e08785c3408ef813505bdc7511560e9536f4ab79
* refine Antlr depsvvvv2025-02-273-23/+0
| | | | | refine Antlr deps commit_hash:71b99424edb283bf56be6e79c9c9a19d805ce2ce
* YQL-19594 Explicit lexers & parsers 2vvvv2025-02-211-8/+0
| | | | commit_hash:2aa733486a55a04c39ff8bb1c7eaca3a85719647
* YQL-19594 Explicit lexers & parsersvvvv2025-02-192-7/+28
| | | | commit_hash:6be543b7c5bff6ee474ee606c920197fb2569767
* Introduced lexer & parser interfacesvvvv2025-02-1815-41/+325
| | | | commit_hash:fee365c90a176dd33a967cee20994b21d530080c
* YQL-19553 CLI for yql lintervvvv2025-02-102-3/+3
| | | | | init commit_hash:a21a71769ad2095e40909c69255a3cf38eabc179
* YQL-19553 initial implementation of YQL lintersvvvv2025-02-072-2/+2
| | | | commit_hash:70690bcdabf0bcfe095fb10e9e58717281d11d53
* YQL for create, alter and drop transfer from topic to tabletesseract2025-01-212-0/+205
| | | | commit_hash:09502f46a7ee665609d2c4ba8d9e0aa421720cdb
* Merge GH PR #9404aneporada2024-11-125-0/+213
| | | | commit_hash:d780798556aedbe2be898d69185380f2ecb95f9c
* Moved other yql/essentials libs YQL-19206vvvv2024-11-074-0/+106
init commit_hash:7d4c435602078407bbf20dd3c32f9c90d2bbcbc0