aboutsummaryrefslogtreecommitdiffstats
path: root/yql/essentials/tools
Commit message (Collapse)AuthorAgeFilesLines
* Refactor exec context, add map fmr gateway for underlying native and run map ↵cdzyura1714 days2-2/+3
| | | | | | | task in separate process Refactor exec context, add map fmr gateway for underlying native and run map task in separate process commit_hash:08aecf79d7cd82b978168f138afbeed85314e354
* YQL-19616: Improve TextMate and Vim grammarsvitya-smirnov5 days5-79/+39
| | | | | | | | | - Fixed multiline tokens - Fixed REAL number display - Disabled punctuation highlighting - Refactored by extracting properties to core highlighting commit_hash:a2d1eb6e4e49b1cb785b90accbdecebe977faa13
* YQL-19616: Fix BindParameterIdentifier typovitya-smirnov9 days4-6/+6
| | | | commit_hash:d95cb665e7dd63f67ee4ef7a2602f1c9ec34d26f
* Intermediate changesrobot-piglet11 days10-15/+242
| | | | commit_hash:9b36145268d91eb8ed2f7ac54b006a7ee268a593
* YQL-19616: Generate Vim SQL syntax highlightingvitya-smirnov12 days4-1/+190
| | | | | | | | | | Introduced a Vim syntax highlighting for YQL. This is a replacement for an existing almost manually written conguration. It uses regexes generated from the original ANTLR4 grammar. Now only Default lexer mode is supported. commit_hash:85fa094593bd9d80373754a492b46ede1a50148d
* Intermediate changesrobot-piglet12 days2-1/+12
| | | | commit_hash:0f7d01c349dc801704a27453a3da46573284d7fe
* Intermediate changesrobot-piglet13 days1-0/+6
| | | | commit_hash:778aa5364639806318069575e28e3ec6d757b69e
* Intermediate changesrobot-piglet2025-07-111-1/+3
| | | | commit_hash:28e7ffac446ec164b114e1e27cbccf1ac4e7086e
* Intermediate changesrobot-piglet2025-07-101-1/+1
| | | | commit_hash:0db8837c719ce19cf1d9ef561ba7fd77f80a8ae8
* Intermediate changesrobot-piglet2025-07-091-1/+6
| | | | commit_hash:e7846c444dce1a91050e458886f839bf3424a5c6
* Intermediate changesrobot-piglet2025-07-082-1/+54
| | | | commit_hash:4bdb12bc8b88e2f51996b218a14171a53d6bb6b1
* YQL-17301: Add retry policy to http downloadpanikku2025-07-081-0/+1
| | | | | Добавление делея между запросами commit_hash:5da96c91c5fba48bb81893ec61e8e6f69f144728
* YQL-20129: fix LoadRichMetadata imports, add function namesmrlolthe1st2025-06-302-0/+10
| | | | commit_hash:f19dba75a72831698bb37ce88c6e1bbc054cd203
* YQL-17269: support INTERSECT and EXCEPT without PositionalUnionAllkndrvt2025-06-201-0/+11
| | | | commit_hash:632e24794e8bcf6ef0502b7e8c031e964d28d36a
* YQL-19747: Load schema from JSON for CLIvitya-smirnov2025-06-192-3/+51
| | | | | | Now it is possible to pass clusters schema via a JSON file using `-s` flag. commit_hash:fd579430968881627c77d4586464952176134dc5
* Intermediate changesrobot-piglet2025-06-181-6/+6
| | | | commit_hash:c1a8fb920a99a419ee1636efe4655ea367cc4b11
* Intermediate changesrobot-piglet2025-06-171-15/+6
| | | | commit_hash:ff50a44bdfd5c21be7a5c2a0f48165050d5313cd
* Intermediate changesrobot-piglet2025-06-112-5/+1
| | | | commit_hash:c8d74820e197343a1019edeff4f8c21fc5805244
* Intermediate changesrobot-piglet2025-06-095-18/+80
| | | | commit_hash:a5cf347a0fdbf87672444c86b9acad24d4ab956a
* fix re2 langvervvvv2025-05-281-0/+2
| | | | | | | fix YQL-18878: Provide regex error from 2025.03 version commit_hash:fdaeba4009bfbedccd39942909bcd303ae4ae932
* Intermediate changesrobot-piglet2025-05-282-2/+4
| | | | commit_hash:7ef8aac06a5394b98eea88e8519641f5b04e2878
* YQL-19845 fixed outer resolvingvvvv2025-05-271-0/+2
| | | | commit_hash:0a063bba6282dd67ca5d8e6aa906200ed6a8aed6
* Intermediate changesrobot-piglet2025-05-271-1/+0
| | | | commit_hash:be87cc6701e6f6ee1e135fb1ec94fc86b919c120
* Intermediate changesrobot-piglet2025-05-161-1/+5
| | | | commit_hash:9c2d6168402f00f42c25eb95631b419c1483b978
* Intermediate changesrobot-piglet2025-05-122-1/+1
| | | | commit_hash:7a1e89d4ac973444c2b7275f326889e14b6f9e3d
* Intermediate changesrobot-piglet2025-05-123-0/+97
| | | | commit_hash:3a624a323006078de71f50747f7b2e8cadba7ccd
* YQL-19747 Complete folder, table and cluster namesvityaman2025-05-061-0/+1
| | | | | | | | | | | | | | | | --- - Related to `YQL-19747` - On top of https://github.com/ytsaurus/ytsaurus/pull/1253 - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/14 - Related to https://github.com/vityaman/ydb/issues/35 - Related to https://github.com/vityaman/ydb/issues/40 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1257 commit_hash:0b842abb27184c88b8177beeea29fb1ea86b7a04
* Intermediate changesrobot-piglet2025-05-051-1/+1
| | | | commit_hash:6a772aebd3249332cf554bea9ed67a25f3b45876
* YQL-19747 Introduce SimpleSchemaGatewayvityaman2025-04-291-0/+2
| | | | | | | | | | | | | | | | | | | Introduce the `SimpleSchemaGateway` to make it easier to implement `SchemaGateway`s. The idea is that actually existing schema providers really do not support filtration such as by name and type, so in practice they return us the whole list and we need to filter it by hand. The `SimpleSchemaGateway` to `SchemaGateway` adapter does this for us -- we only need to implement a path splitting and folder listing. The other and important feature of the `SimpleSchemaGateway` is that it is simple to implement a caching decorator for it -- just store a mapping `Path -> [FolderEntry]`, while caching a `SchemaGateway` with filters is soooo not trivial. I also added string constants for known folder entry types, because they should be documented somewhere. --- - Related to `YQL-19747` - Related to https://github.com/vityaman/ydb/issues/14 - Related to https://github.com/vityaman/ydb/issues/34 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1245 commit_hash:dda6dcac544ca95d5e8e08f1e7de9de6b5770f25
* YQL-19747 Enable custom NameSet and FrequencyDatavityaman2025-04-281-9/+9
| | | | | | | | | | | | | | | | | | | | | | Clients might want to use custom `NameSet` and `FrequencyData` in their environment, for example, to get their private UDFs and to have more relevant ranking that includes their private UDF and respect their usage pattern. To achieve this goal I decided to load pure `NameSet` and `FrequencyData` and provide functions for pruning. Also I checked defaults and decided that it is more common for a client to create a `StaticNameService` from pure `NameSet` and `FrequencyData` to keep their pruning consistent. I also extracted a separate module `ranking`. It will be needed when I will implement `UnionNameService` to union `StaticNameService` and `SchemaNameService`. `UnionNameService` will load `Limit` names from each child and then crop them to sorted prefix of length `Limit` using `IRanking`. --- - Related to `YQL-19747` - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/14 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1246 Co-authored-by: vvvv <vvvv@yandex-team.com> Co-authored-by: vvvv <vvvv@yandex-team.com> commit_hash:cdca301a58a34e56d537a447b4ff779cd70faea6
* YQL-19747: Refactor sql/v1/complete usage of Future and Ptrvityaman2025-04-251-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - [x] Chained futures, add `CompleteAsync` method (then will migrate the YDB CLI on it). - [x] Removed deadlined and fallback NameService as unused - [x] Annotate thread-safe methods with `const` and use `AtomicSharedPtr` for them. - [x] Move `name` to `name/service` with backward compatibility with the YDB CLI. --- `CompletionEngine` is left thread-unsafe because of the dependency chain `CompletionEngine -> LocalSyntaxAnalysis -> C3Engine` which is thread-unsafe, but readonly indexed data structures such as `Ranking` and `NameService` are annotated with const and distributed via shared pointers. I removed deadlined and fallback name services because the first is stupid the second is ahead of its time and is better to be added later to keep interfaces as minimal as possible. --- The migration on async complete plan: 1. Introduce CompleteAsync 2. Migrate clients on CompleteAsync 3. Make Complete to return Future 4. Migrate clients on Complete 5. Remove CompleteAsync --- - Related to https://github.com/ydb-platform/ydb/issues/9056 - Related to https://github.com/vityaman/ydb/issues/33 - Related to https://github.com/vityaman/ydb/issues/31 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1241 Co-authored-by: vvvv <vvvv@yandex-team.com> Co-authored-by: vvvv <vvvv@yandex-team.com> commit_hash:497cc081ab78bebf7354e0acfaa418d936cc8240
* Intermediate changesrobot-piglet2025-04-223-2/+29
| | | | commit_hash:112bf21627e2883a424e58d1a65caf7af62c24c8
* YQL-19861 abi, udf resolvers, test, pass via yt gatewaysvvvv2025-04-214-5/+9
| | | | commit_hash:6e3f5fac6a8598586987b52d749644d1ce1fccbe
* UdfResolver analyticsmrlolthe1st2025-04-181-2/+2
| | | | commit_hash:393ec43ede4bf529dd68413165afce4bb49a43db
* YQL-19845 support of lang version checking inside facadevvvv2025-04-163-0/+21
| | | | commit_hash:5cfb2a0aa2904106df4ae69b9311bcc5a695928d
* YQL-19616 refactor test lexers from sql2yql, supported facade run toolsvvvv2025-04-145-68/+39
| | | | commit_hash:fb1727dda2b8c7d2ff42d4436c54cb7aa1ce4bc2
* Intermediate changesrobot-piglet2025-04-112-10/+32
| | | | commit_hash:3130610c0735089d0be0e14d07555480bbed5a19
* Intermediate changesrobot-piglet2025-04-111-5/+16
| | | | commit_hash:2f615b4a2a2726593dd70b36499819265862155f
* YQL-19747 Improve yql_complete tool and add input validationvityaman2025-04-082-1/+22
| | | | | | | | | No description --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1185 commit_hash:1def5874ff6a9a5b3dcdd0ad285d2e64b16c9306
* YQL-19747 Introduce types and functions rankingvityaman2025-04-022-2/+40
| | | | | | | | | | | | - [x] Fix bug with incorrect no-case sorting. - [x] Get names from `sql_functions.json` and `types.json`. - [x] Add types and functions ranking according to `rules_corr_basic.json` data via a `PartialSort`. - [x] Add benchmark workspace. --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1167 commit_hash:84d93265fb69bf5651f905d6af038056657e9a16
* Intermediate changesrobot-piglet2025-04-023-14/+17
| | | | commit_hash:35e335cd8fb87b060881460b5b592519967d5ca0
* YQL-19747 sql functionsvvvv2025-03-285-0/+95
| | | | commit_hash:9f628fe1894ee7dcdcbdd161855b668ca6e7380f
* YQL-19616 Convert YQL lexer grammar to regexesvityaman2025-03-281-2/+2
| | | | | | | | | | | | | | | | | - [x] Parse YQL grammar to extract lexer grammar into `TLexerGrammar`. - [x] Translate `TLexerGrammar` into regexes. - [x] Implement a lexer via regexes `TRegexLexer` to test generated regexes validity. - [x] Test on `Default` syntax mode. - [x] Test on `ANSI` syntax mode. --- - Related to https://github.com/ydb-platform/ydb/issues/15129 - Requirement for https://github.com/ytsaurus/ytsaurus/pull/1112 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1127 commit_hash:03ffffe81cdafe7f93a4d3fd9a3212fe67f1c72d
* YQL-19747 typesvvvv2025-03-285-0/+111
| | | | commit_hash:b710713239241d2c02cad4138362ef0da67faa93
* Intermediate changesrobot-piglet2025-03-271-0/+1
| | | | commit_hash:334467ee716dce69171d491a61aa6f9b5f914080
* Intermediate changesrobot-piglet2025-03-252-28/+63
| | | | commit_hash:e2b7b2f9068bb480c3779b387c101673cc6cf7a7
* Intermediate changesrobot-piglet2025-03-192-0/+56
| | | | commit_hash:50f35111dfe21322f7d24f449ffb9d644521d601
* YQL-19724 logger for udf resolvingvvvv2025-03-193-13/+45
| | | | commit_hash:c019511f90871e0a4d783856db0fa2272e21a336
* YQL-19694 ABI logger interfacevvvv2025-03-142-2/+2
| | | | commit_hash:b673d403e9bfb2ac31eedd8d2231ac018a8f36dd
* YQL-19701 linter extension for unknown clustersvvvv2025-03-131-0/+6
| | | | commit_hash:79c042af0cf2c51389b5a22bd866cd211b6acf64
generated by cgit v1.2.3 (git 2.25.1) at 2025-07-27 15:25:48 +0000