summaryrefslogtreecommitdiffstats
path: root/yql/essentials/core/facade
Commit message (Collapse)AuthorAgeFilesLines
* Do not lose exceptions from CloseLastSessionaneporada11 days1-8/+14
| | | | commit_hash:1d47a3ab4f80db28fd14fb009140ac0951cbbe7d
* YQL-19813: Send runtime settings statsatarasov52026-05-222-5/+0
| | | | commit_hash:e8ea8f3c4365ed8b87ced31aa1fa34ca0686758c
* YQL-19813: Save and load qplayeratarasov52026-05-201-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | **Режим capture** (qContext.CanWrite()) 1. Проходим по всем элементам source с индексом idx. 2. Для каждого элемента вызываем filter(item) ровно один раз (фильтр может иметь побочные эффекты — например, запись статистики об активации). 3. Элементы, прошедшие фильтр, добавляются в возвращаемый результат. 4. Сохраняем индексы всех прошедших фильтр элементов в QStorage в формате V2: \{"version": "v2", "indexes": \[0, 2, 5, ...\]\} --- **Режим replay** (qContext.CanRead()) 1. Читаем YSON-запись из QStorage по ключу \{Component="Activation", Label=label\}. 2. Определяем версию формата по наличию ключа "version": **Формат V1** (старый, обратная совместимость) — ключ "version" отсутствует: - Структура: \{"имя\_флага": сериализованный\_proto, ...\} - Десериализуем каждый флаг через ParseFromString, возвращаем список напрямую. - Фильтр не вызывается. Список source игнорируется. **Формат V2 (текущий)** — "version": "v2": - Структура: \{"version": "v2", "indexes": \[0, 2, 5, ...\]\} - Читаем сохранённое множество индексов. - Проходим по source с *индексом* idx: - Элемент без условия активации (!HasActivation()) → всегда включается (такие элементы не зависят от активации). - Элемент с условием активации (HasActivation()) → включается только если его idx есть в сохранённом множестве. - Фильтр не вызывается. commit_hash:306113465bcd614cd3c0cd311ab20542d1f8e254
* [yql plugin] Make aborts more robustngc2242026-05-122-16/+24
| | | | commit_hash:5ff8bec51c31adf2b1c45f579dd9854027f19007
* YQL-19813: Pass runtime settings to minikql + YT + minirunatarasov52026-04-292-1/+5
| | | | commit_hash:054395f57e37951159c1184eae2e6d4bc81245f8
* YQL-20810: New lineage formatmaxkovalev2026-04-171-0/+7
| | | | commit_hash:2f752d8d575fe0f6b939cbc9805f2f266493234e
* YQL-21105 use poly args during partial typecheckvvvv2026-04-161-1/+1
| | | | commit_hash:c7f4632e6e68bb621cce71755c1ed377c5bc69cd
* YQL-21139 real typecheck for librariesvvvv2026-04-091-1/+1
| | | | commit_hash:22ad329cdab32f45b12bf010f61fd7f57a1f44f9
* Secure tmp foldersziganshinmr2026-04-081-0/+6
| | | | | Add support for automated allocation of secure TmpFolder on YT clusters for each user commit_hash:2d06fc7616f65d9814c7a5ca33a4da582fb5b016
* YQL-21105 partial Udf resolver for Udf/ScriptUdfvvvv2026-04-031-2/+3
| | | | commit_hash:7abbae4a7b1c438affd630ba9dd02622ecbea891
* Use GatewaysConfig from QContext everywhere - second attemptziganshinmr2026-04-032-106/+46
| | | | | | | | | | | | | Повторная попытка влить <https://nda.ya.ru/t/jg-Sfxls7YQrme> Исправления относительно предыдущей: - Исправил загрузку SqlFlags в HandleTranslationSettings при реплее, упростил код вокруг (перенес отсюда <https://nda.ya.ru/t/b-IweA-p7YQrmi>) - приводило к отключению SQL фич на реплее и соответствующим падениям (например, DistinctOverWindow) - Исправил создание ModuleResolver, теперь он создается с правильными SqlFlags (тоже самое, но в модулях) - Теперь прикапываю полный конфиг, не только избранные секции (приводит к падениям вида Unknown DataSource: solomon) * Раньше не стреляло, потому что фактически использовался внешний конфиг, в котором были соответствующие секции, теперь везде используется прикопанный Каждое исправление в отдельном коммите commit_hash:e11fc737f3f7cef33e059f99e83da5ce71d0ca17
* Revert commit rXXXXXX, Use GatewaysConfig from QContext everywhereziganshinmr2026-04-012-25/+58
| | | | commit_hash:99d6ca3cadc8392f047b6b9d06609e9c31d96e8d
* YQL-21112: Add memory and time stats for Lineagemaxkovalev2026-03-311-0/+14
| | | | commit_hash:2b6cb5cab108d776184b553f675bf1d31c5b4660
* Use GatewaysConfig from QContext everywhereziganshinmr2026-03-312-58/+25
| | | | | Use gateways config from replay data \+ patch everywhere (except SqlTranslation due to custom save/load logic (patch applied)) commit_hash:0125d63d98767309f7d009df054a4c72c5537bc5
* YQL-20095: Enable readability-avoid-const-params-in-declsvitya-smirnov2026-03-312-6/+6
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/readability/avoid-const-params-in-decls.html commit_hash:17e1ec5c3849a38bcb76cd4927e66979bee6c2ec
* YQL-20095: Enable modernize-use-designated-initializersvitya-smirnov2026-03-171-20/+20
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/modernize/use-designated-initializers.html commit_hash:d73eb463c7bec2bda4c362aab10af49979a7ddd3
* YQL-20793 Introduced universal fuzzer (disabled by now)vvvv2026-03-162-0/+6
| | | | commit_hash:fb4b261fd65c7efb90b2275bbf69935d3087b5b9
* YQL-20861: introduce untyped lambda fuzzervvvv2026-03-102-0/+6
| | | | commit_hash:09458afa76df2a5ac04b35e483807b1d8a742dad
* YQL-20998: Remove EmitReadsForExistsvitya-smirnov2026-03-051-1/+0
| | | | | | | Removed a check and usages of `EmitReadsForExists` from the `yql/essentials`. There are a lot of YQLs code recanonized because sometimes an extra block with return was emitted and sometimes is not, but the YQLs is equivalent. commit_hash:a4ec2a575177eff4063da017b4d9ee96e06f3740
* YQL-20095: Enable modernize-pass-by-valuevitya-smirnov2026-03-022-32/+34
| | | | commit_hash:4939dfad654f18bb31e40711ee0c39063889f17b
* YQL-20958: Pass translator flags for sql viewatarasov52026-02-202-0/+4
| | | | | Описание проблемы есть в тикете. commit_hash:61b421f6650963cb6b156498b2a19e1c4f63adc8
* YQL-20095: Enable modernize-concat-nested-namespacesvitya-smirnov2026-02-171-4/+2
| | | | commit_hash:2c0e0389bf5eca0c8334d55143674a8acf94a88d
* YQL-20811: Add limiting allocator for lineage calculationmaxkovalev2026-02-041-18/+23
| | | | commit_hash:3cb9bcc764d8fa20ff0b30696012df1b18750b46
* YQL-20889 allow customization of how issues are reportedvvvv2026-01-292-4/+15
| | | | commit_hash:d6bdb7d568294394ee54f95f39f008a3485e12ce
* YQL-20095: Enable google-explicit-constructorvitya-smirnov2026-01-231-1/+1
| | | | commit_hash:4d77ad10fd4db303459ec4e45e139967c7fc8196
* [Query replay] Fixes at replay sideziganshinmr2026-01-131-2/+2
| | | | | | | - Use read-only mode during full replay - Use random suffixes for non-existent paths to avoid locking problems during concurrent full replays - Fix ReplaceTablesWithDump logic for queries with multiple epoches commit_hash:dd8437c86ef231af604340196bb2f0fd172b7898
* YQL-20095: Enable modernize-use-overridevitya-smirnov2026-01-131-1/+1
| | | | | | | | | | | | | | | | | | | The check `modernize-use-override` is useful as it: 1. Removes redundant `override` when it is used with a `final`. 2. Removes redundant `virtual` or replace it with a `override`. So it is more clean for a reader, that overriding happens. It is enabled not out of order, as it is just an alias to `cppcoreguidelines-explicit-virtual-functions`. I also decided to switch a strategy of enabling checks. Now I will enable only a single rule with a single PR and prefer rules with a non-breaking autofix. In the new year with new linter checks! 🎄 commit_hash:e6e233baa90b31e5f65e11837546690c47f71ab5
* YQL-20793 pass config provider (w/o gw)vvvv2025-12-261-1/+5
| | | | commit_hash:ac0e9b65e8d927bbe02fdf31a3cc5ed1f6c03906
* Enhance token resolutionngc2242025-12-251-1/+7
| | | | commit_hash:7f10df1e62935e3145c9bd8312b2e44ef8bf0bda
* YQL-20793 facade toolvvvv2025-12-232-0/+13
| | | | commit_hash:7b01dbf55375a4de6e870ce6215836017dae6fc8
* YQL-20756: Limit lineage size before export to logbrokermaxkovalev2025-12-101-0/+8
| | | | commit_hash:7ff640cbd3da0ddba8253308c014fff0f2765c52
* YQL-20654: Move filtration of robot requests into qplayer uploadermaxkovalev2025-11-261-0/+4
| | | | commit_hash:442b5248041453617e9174033558828d1cba7fd5
* YQL-20675: Improve lineage metricsmaxkovalev2025-11-261-2/+2
| | | | | Fix the case when standalone lineage is used, but operation is failed before lineage calculation. Before it goes to CorrectLineage = 1, which is wrong. commit_hash:f8f30e458faae5a4b01617ebb8b49ccb0f56a743
* YQL-20675: Fix Standalone Lineage metricsmaxkovalev2025-11-251-1/+1
| | | | commit_hash:0fbbfd565a1de16651cd0595e0cb8ebcff598879
* YQL-20367: Support an activation for SQL flagsvitya-smirnov2025-11-242-36/+48
| | | | | | | | | | | | | | | | | | | | | | | | We need to control feature activation not only for core YQL components, but also for the SQL translator. This patch enables SQL features activation via the new `ExtendedTranslationFlags` configuration property. Example usage: ```scala SqlCore { ExtendedTranslationFlags: { Name: "DisableExceptIntersectBefore202503" Activation: { IncludeUsers: [ "xxx" ] } } } ``` commit_hash:a60dbeb68b73cd0d5f1c1831fecdde19544f12e1
* YQL-20086: Add yql/essentials Clang Tidy configvitya-smirnov2025-11-211-5/+5
| | | | | | | | | This patch introduces an extension configuration for the Clang Tidy. It is merged with Arcadia Clang Tidy configuration. To begin with, more checks for identifiers naming are added. Documentation: https://nda.ya.ru/t/AhbDZbiF7MKe3M. commit_hash:3481da4c8df0a4d23a991d4a660ae050d2dc5d33
* YQL-20072: Support mrrun + yqlworkermrlolthe1st2025-10-292-3/+17
| | | | commit_hash:a70465d9a63f8a86c6990ae04e9c615827498fe0
* YQL-19542: Add metric for Standalone Lineagemaxkovalev2025-10-241-3/+10
| | | | commit_hash:6f153d77b4cdefe9e1908df8d37387d597366a94
* YQL query dumper fixesziganshinmr2025-10-242-4/+7
| | | | | | | - transfer user attributes from original tables to dumped ones - check file count limit before dump (per Dump method call, aka per YT operation) - do full capture commit earlier commit_hash:0f6a3592b2d05c61f3df4f6eb41861aea1502c90
* YQL query dumperziganshinmr2025-10-212-1/+31
| | | | | | Реализация full capture/replay (см тикет для информации) commit_hash:fbde9af7b610c053ee5e0e8c4936ac426aa9c827
* YQL-19542: Save lineage in qstorage and check at replaymaxkovalev2025-10-202-4/+9
| | | | commit_hash:3693b0059b05bcf38d734e2d395dc3378902675c
* YQL-20504: Fix formatting check in QPlayersvitya-smirnov2025-10-131-0/+4
| | | | commit_hash:cbb6bbe39c72e2322d57a38ded86cda07c68a419
* YQL-20086 invert flagvvvv2025-10-101-2/+0
| | | | commit_hash:a6b640bc576263b62884a0b4187ba79c893e13d9
* YQL-20445: Calculate lineage in testsmaxkovalev2025-10-091-2/+10
| | | | commit_hash:6bf28c5a731c7325efa6bbe915c4a4920673c844
* YQL-20491: Fix ambiguity detection at YQLFacadeRunvitya-smirnov2025-10-092-10/+14
| | | | commit_hash:9e956b00ed2c0891c42c9d432b62bd7a6edc8202
* YQL-20086 core (part1)vvvv2025-10-083-251/+246
| | | | commit_hash:12dbda4defcaef8dd708a69552fc19eba832ce2f
* QPlayer - handle SqlTranslation section from gateways patchziganshinmr2025-09-242-2/+17
| | | | commit_hash:ac2cdbe3d5001baccbd9b9c00becaebe8981fbca
* Don't add diagnostics for system queriesvvvv2025-09-221-0/+4
| | | | commit_hash:3bbbdf333ab388eccf27a7cfa448a2b0a815a3db
* YQL-20327: Fix testsmrlolthe1st2025-08-271-1/+3
| | | | commit_hash:fc598869ffb5c4ffdb7db4064127be297787bc7f
* YQL-20327: Add qplayer support of UrlListerManagermrlolthe1st2025-08-273-1/+4
| | | | commit_hash:9fe6c02c88ec05197f58ac06a008beeea18fc7c1