ydb/yql/essentials/parser, branch oidc-1.2.3

YQL-20102: Enable debug arrow validation

2025-07-10T12:51:42Z

В данном PR включена поддержка валидации Datum'ов на соответствие `MKQL type <-> arrow type <-> arrow array data structure.` Выявленные проблемы: 1\. `AllocateResizableBuffer(size_t size)` возвращает массив длины 0 вместо size. Поэтому есть ошибка в работе с датами в некоторых нодах commit_hash:122f2bd114dec50993131391a3793d9540877cb4

YQL-20153 params fixes

2025-07-04T13:48:49Z

commit_hash:6a71bff1ad52eddd1b8c7d516f0810f0decf401e

YQL-20086 parser (w/o pg)

2025-06-20T14:10:34Z

commit_hash:f4bddb30981abde1a951149fff272d86a22dd726

Intermediate changes

2025-06-16T17:16:31Z

commit_hash:18e311c0ad94b55003cb5a6c0487a16830fac5cd

YQL-19747: Support USE statement

2025-05-20T10:07:06Z

Introduce global analysis which will be extended with more ParseTree analysis later. --- - Related to `YQL-19747` - Related to https://github.com/vityaman/ydb/issues/40 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1281 commit_hash:848fb3fdd6bc9612769c47d66198fca018ff465f

YQL-19611: Appropriate handle of null arguments in param score matching

2025-05-13T14:38:39Z

commit_hash:aef029b757218731b5855868b341ffdb3fa79203

YQL-19767: Introduce MKQL allocator address sanitizing

2025-05-06T12:16:42Z

Здесь поддержал только out of bounds access и use after free. Отложенное использование памяти и тд буду делать потом commit_hash:2a3fd472b626762ff7c8b7b0bc1285af50c511cf

Intermediate changes

2025-04-24T10:12:15Z

commit_hash:dc3193604b8e3f1c1a2e012318f542b2497d7638

YQL-19747 Detect a token at the caret position

2025-04-23T12:27:38Z

When I tried to implement a folder and object names completion at `ID_QUOTED` I faced with a problem, that I actually can't detect, that cursor is at `ID_QUOTED` token because `TCompletionInput::Text` it was cut until the `TCompletionInput::CursorPosition`, therefore at input ``` SELECT * FROM `#` ``` prefix was ``` SELECT * FROM `# ``` and then lexer failed. While we actually want tokenize the whole current statement, `C3` still needs to receive a prefix as input. I tried to tokenize the whole statement and then on input `SELECT Optional<#>` got nothing because `<>` is solid token in the `SQL`. The only way to fix it I found is to cut a query to prefix until the cursor position. BTW, current implementation is not so efficient as we tokenize the input multiple times. Especially `SplitQueryToStatemnts` seems heavy. In future we anyway will parse the whole input so will need to design APIs to receive ready token streams to do statements splitting, for example, just not to do the work twice. ![image](https://github.com/user-attachments/assets/114804d3-f311-4a46-be84-8ed4650bc9dd) So I introduce you the following changes - [x] Select the whole current statement, not just prefix. - [x] Find the token at caret and output no candidates when caret is at `STRING_VALUE`, `DIGIGTS` and so on. - [x] Change `C3` wrapper interface to take `TCompletionInput` to hide an implementation detail that it runs on cut prefix. - [x] `#` annotated queries in unit tests. - [x] Detect `CaretTokenPosition` -- if is it enclosed with a token or between two. - [x] Ensure that `maxErrors` in `ILexer::Tokenize` is positive. Just a tiny bugfix. --- - Related to https://github.com/ytsaurus/ytsaurus/pull/1209 - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/14 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1225 commit_hash:a434b9888ec8a7356247d63d9f1420e256ae4fca

YQL-19747 Improve yql_complete tool and add input validation

2025-04-07T21:17:32Z

No description --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1185 commit_hash:1def5874ff6a9a5b3dcdd0ad285d2e64b16c9306