summaryrefslogtreecommitdiffstats
path: root/yql/essentials/tools
Commit message (Collapse)AuthorAgeFilesLines
* YQL-17269: support INTERSECT and EXCEPT without PositionalUnionAllkndrvt2025-06-201-0/+11
| | | | commit_hash:632e24794e8bcf6ef0502b7e8c031e964d28d36a
* YQL-19747: Load schema from JSON for CLIvitya-smirnov2025-06-192-3/+51
| | | | | | Now it is possible to pass clusters schema via a JSON file using `-s` flag. commit_hash:fd579430968881627c77d4586464952176134dc5
* Intermediate changesrobot-piglet2025-06-181-6/+6
| | | | commit_hash:c1a8fb920a99a419ee1636efe4655ea367cc4b11
* Intermediate changesrobot-piglet2025-06-171-15/+6
| | | | commit_hash:ff50a44bdfd5c21be7a5c2a0f48165050d5313cd
* Intermediate changesrobot-piglet2025-06-112-5/+1
| | | | commit_hash:c8d74820e197343a1019edeff4f8c21fc5805244
* Intermediate changesrobot-piglet2025-06-095-18/+80
| | | | commit_hash:a5cf347a0fdbf87672444c86b9acad24d4ab956a
* fix re2 langvervvvv2025-05-281-0/+2
| | | | | | | fix YQL-18878: Provide regex error from 2025.03 version commit_hash:fdaeba4009bfbedccd39942909bcd303ae4ae932
* Intermediate changesrobot-piglet2025-05-282-2/+4
| | | | commit_hash:7ef8aac06a5394b98eea88e8519641f5b04e2878
* YQL-19845 fixed outer resolvingvvvv2025-05-271-0/+2
| | | | commit_hash:0a063bba6282dd67ca5d8e6aa906200ed6a8aed6
* Intermediate changesrobot-piglet2025-05-271-1/+0
| | | | commit_hash:be87cc6701e6f6ee1e135fb1ec94fc86b919c120
* Intermediate changesrobot-piglet2025-05-161-1/+5
| | | | commit_hash:9c2d6168402f00f42c25eb95631b419c1483b978
* Intermediate changesrobot-piglet2025-05-122-1/+1
| | | | commit_hash:7a1e89d4ac973444c2b7275f326889e14b6f9e3d
* Intermediate changesrobot-piglet2025-05-123-0/+97
| | | | commit_hash:3a624a323006078de71f50747f7b2e8cadba7ccd
* YQL-19747 Complete folder, table and cluster namesvityaman2025-05-061-0/+1
| | | | | | | | | | | | | | | | --- - Related to `YQL-19747` - On top of https://github.com/ytsaurus/ytsaurus/pull/1253 - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/14 - Related to https://github.com/vityaman/ydb/issues/35 - Related to https://github.com/vityaman/ydb/issues/40 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1257 commit_hash:0b842abb27184c88b8177beeea29fb1ea86b7a04
* Intermediate changesrobot-piglet2025-05-051-1/+1
| | | | commit_hash:6a772aebd3249332cf554bea9ed67a25f3b45876
* YQL-19747 Introduce SimpleSchemaGatewayvityaman2025-04-291-0/+2
| | | | | | | | | | | | | | | | | | | Introduce the `SimpleSchemaGateway` to make it easier to implement `SchemaGateway`s. The idea is that actually existing schema providers really do not support filtration such as by name and type, so in practice they return us the whole list and we need to filter it by hand. The `SimpleSchemaGateway` to `SchemaGateway` adapter does this for us -- we only need to implement a path splitting and folder listing. The other and important feature of the `SimpleSchemaGateway` is that it is simple to implement a caching decorator for it -- just store a mapping `Path -> [FolderEntry]`, while caching a `SchemaGateway` with filters is soooo not trivial. I also added string constants for known folder entry types, because they should be documented somewhere. --- - Related to `YQL-19747` - Related to https://github.com/vityaman/ydb/issues/14 - Related to https://github.com/vityaman/ydb/issues/34 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1245 commit_hash:dda6dcac544ca95d5e8e08f1e7de9de6b5770f25
* YQL-19747 Enable custom NameSet and FrequencyDatavityaman2025-04-281-9/+9
| | | | | | | | | | | | | | | | | | | | | | Clients might want to use custom `NameSet` and `FrequencyData` in their environment, for example, to get their private UDFs and to have more relevant ranking that includes their private UDF and respect their usage pattern. To achieve this goal I decided to load pure `NameSet` and `FrequencyData` and provide functions for pruning. Also I checked defaults and decided that it is more common for a client to create a `StaticNameService` from pure `NameSet` and `FrequencyData` to keep their pruning consistent. I also extracted a separate module `ranking`. It will be needed when I will implement `UnionNameService` to union `StaticNameService` and `SchemaNameService`. `UnionNameService` will load `Limit` names from each child and then crop them to sorted prefix of length `Limit` using `IRanking`. --- - Related to `YQL-19747` - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/14 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1246 Co-authored-by: vvvv <[email protected]> Co-authored-by: vvvv <[email protected]> commit_hash:cdca301a58a34e56d537a447b4ff779cd70faea6
* YQL-19747: Refactor sql/v1/complete usage of Future and Ptrvityaman2025-04-251-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - [x] Chained futures, add `CompleteAsync` method (then will migrate the YDB CLI on it). - [x] Removed deadlined and fallback NameService as unused - [x] Annotate thread-safe methods with `const` and use `AtomicSharedPtr` for them. - [x] Move `name` to `name/service` with backward compatibility with the YDB CLI. --- `CompletionEngine` is left thread-unsafe because of the dependency chain `CompletionEngine -> LocalSyntaxAnalysis -> C3Engine` which is thread-unsafe, but readonly indexed data structures such as `Ranking` and `NameService` are annotated with const and distributed via shared pointers. I removed deadlined and fallback name services because the first is stupid the second is ahead of its time and is better to be added later to keep interfaces as minimal as possible. --- The migration on async complete plan: 1. Introduce CompleteAsync 2. Migrate clients on CompleteAsync 3. Make Complete to return Future 4. Migrate clients on Complete 5. Remove CompleteAsync --- - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/33 - Related to https://github.com/vityaman/ydb/issues/31 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1241 Co-authored-by: vvvv <[email protected]> Co-authored-by: vvvv <[email protected]> commit_hash:497cc081ab78bebf7354e0acfaa418d936cc8240
* Intermediate changesrobot-piglet2025-04-223-2/+29
| | | | commit_hash:112bf21627e2883a424e58d1a65caf7af62c24c8
* YQL-19861 abi, udf resolvers, test, pass via yt gatewaysvvvv2025-04-214-5/+9
| | | | commit_hash:6e3f5fac6a8598586987b52d749644d1ce1fccbe
* UdfResolver analyticsmrlolthe1st2025-04-181-2/+2
| | | | commit_hash:393ec43ede4bf529dd68413165afce4bb49a43db
* YQL-19845 support of lang version checking inside facadevvvv2025-04-163-0/+21
| | | | commit_hash:5cfb2a0aa2904106df4ae69b9311bcc5a695928d
* YQL-19616 refactor test lexers from sql2yql, supported facade run toolsvvvv2025-04-145-68/+39
| | | | commit_hash:fb1727dda2b8c7d2ff42d4436c54cb7aa1ce4bc2
* Intermediate changesrobot-piglet2025-04-112-10/+32
| | | | commit_hash:3130610c0735089d0be0e14d07555480bbed5a19
* Intermediate changesrobot-piglet2025-04-111-5/+16
| | | | commit_hash:2f615b4a2a2726593dd70b36499819265862155f
* YQL-19747 Improve yql_complete tool and add input validationvityaman2025-04-082-1/+22
| | | | | | | | | No description --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1185 commit_hash:1def5874ff6a9a5b3dcdd0ad285d2e64b16c9306
* YQL-19747 Introduce types and functions rankingvityaman2025-04-022-2/+40
| | | | | | | | | | | | - [x] Fix bug with incorrect no-case sorting. - [x] Get names from `sql_functions.json` and `types.json`. - [x] Add types and functions ranking according to `rules_corr_basic.json` data via a `PartialSort`. - [x] Add benchmark workspace. --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1167 commit_hash:84d93265fb69bf5651f905d6af038056657e9a16
* Intermediate changesrobot-piglet2025-04-023-14/+17
| | | | commit_hash:35e335cd8fb87b060881460b5b592519967d5ca0
* YQL-19747 sql functionsvvvv2025-03-285-0/+95
| | | | commit_hash:9f628fe1894ee7dcdcbdd161855b668ca6e7380f
* YQL-19616 Convert YQL lexer grammar to regexesvityaman2025-03-281-2/+2
| | | | | | | | | | | | | | | | | - [x] Parse YQL grammar to extract lexer grammar into `TLexerGrammar`. - [x] Translate `TLexerGrammar` into regexes. - [x] Implement a lexer via regexes `TRegexLexer` to test generated regexes validity. - [x] Test on `Default` syntax mode. - [x] Test on `ANSI` syntax mode. --- - Related to https://github.com/ydb-platform/ydb/issues/15129 - Requirement for https://github.com/ytsaurus/ytsaurus/pull/1112 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1127 commit_hash:03ffffe81cdafe7f93a4d3fd9a3212fe67f1c72d
* YQL-19747 typesvvvv2025-03-285-0/+111
| | | | commit_hash:b710713239241d2c02cad4138362ef0da67faa93
* Intermediate changesrobot-piglet2025-03-271-0/+1
| | | | commit_hash:334467ee716dce69171d491a61aa6f9b5f914080
* Intermediate changesrobot-piglet2025-03-252-28/+63
| | | | commit_hash:e2b7b2f9068bb480c3779b387c101673cc6cf7a7
* Intermediate changesrobot-piglet2025-03-192-0/+56
| | | | commit_hash:50f35111dfe21322f7d24f449ffb9d644521d601
* YQL-19724 logger for udf resolvingvvvv2025-03-193-13/+45
| | | | commit_hash:c019511f90871e0a4d783856db0fa2272e21a336
* YQL-19694 ABI logger interfacevvvv2025-03-142-2/+2
| | | | commit_hash:b673d403e9bfb2ac31eedd8d2231ac018a8f36dd
* YQL-19701 linter extension for unknown clustersvvvv2025-03-131-0/+6
| | | | commit_hash:79c042af0cf2c51389b5a22bd866cd211b6acf64
* Add logging, memlimit and retry to binariescdzyura1712025-03-111-23/+2
| | | | | Add logging, memlimit and retry to binaries commit_hash:60c51f87f148d20303a379afd1b0d1c511733567
* Intermediate changesrobot-piglet2025-03-054-0/+17
| | | | commit_hash:dacf0e6cb652774fdda7fd6543333c73a68e65b2
* Intermediate changesrobot-piglet2025-02-283-0/+66
| | | | commit_hash:635f3c44553ff6c26f4387533d6260171d23708f
* YQL-19594 Explicit lexers & parsers 2vvvv2025-02-212-2/+16
| | | | commit_hash:2aa733486a55a04c39ff8bb1c7eaca3a85719647
* YQL-19594 Explicit lexers & parsersvvvv2025-02-196-3/+45
| | | | commit_hash:6be543b7c5bff6ee474ee606c920197fb2569767
* refactor SQL translators YQL-19594vvvv2025-02-165-10/+28
| | | | commit_hash:401d21dd23ee9bb7ee52b2fc42e596cb3e4bdda7
* YQL-19553 CLI for yql lintervvvv2025-02-103-0/+136
| | | | | init commit_hash:a21a71769ad2095e40909c69255a3cf38eabc179
* Use coordinator and worker in fmrGatewaycdzyura1712025-02-101-3/+3
| | | | | use coordinator and worker in fmrGateway commit_hash:a0977459dcbe041e5330c8959152be40fe18eea6
* EXISTS with tables YQL-19496vvvv2025-01-291-0/+1
| | | | commit_hash:76639a66853d8a9d514e4b11f47e14e2d26e26c4
* Intermediate changesrobot-piglet2025-01-293-5/+5
| | | | commit_hash:22545c4aa243324b513d4c90832d07cc85d8a6cf
* Intermediate changesrobot-piglet2025-01-251-8/+9
| | | | commit_hash:86cf5b4dacfff849827654a41271dda52444e8d7
* YQL for create, alter and drop transfer from topic to tabletesseract2025-01-211-1/+1
| | | | commit_hash:09502f46a7ee665609d2c4ba8d9e0aa421720cdb
* Intermediate changesrobot-piglet2024-12-251-1/+1
| | | | commit_hash:590e82994e20a092dbe0ab18b8d2fd0fd6fc4dab