summaryrefslogtreecommitdiffstats
path: root/yql/essentials/minikql/computation
Commit message (Collapse)AuthorAgeFilesLines
* Support Uuid and DyNumber in minikql blocks and Arrowxyligansereja12 days2-2/+18
| | | | | | | | | | | | | | | | Изменения в рамках этого тикета <https://github.com/ydb-platform/ydb/issues/44190> #### Support Uuid and DyNumber in minikql blocks and Arrow ✎ - Added support for Uuid and DyNumber data types within MiniKQL blocks and Arrow computations, enabling their use in block-based operations and serialization - Implemented proper conversion, serialization, and deserialization logic for both data types in the Arrow format - Extended block item handling to support Uuid and DyNumber, including comparator and hasher implementations - Added comprehensive unit tests covering roundtrip operations, serialization, comparison, and conversion for both data types - Integrated Uuid and DyNumber support into built-in functions like Min/Max and their aggregate variants - Updated type system and block builder components to recognize and handle the new data types correctly - Added necessary includes and utility functions to work with Uuid and DyNumber in MiniKQL contexts <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:d1ab82c060cfa90b7cd13a1cb3efbcb9615e6291
* YQL-21101: Make ToFlow dependent args requiredimunkin12 days1-3/+3
| | | | commit_hash:bc73ed520d5d4ef210b03b983720e6e8a6996db5
* Fix use-after-dtor in TDirectArrayHolderInplacemakxenov13 days1-4/+6
| | | | | | | | #### Fix use-after-dtor in TDirectArrayHolderInplace ✎ - Replaced the traditional `operator delete` with a destroying delete operator to ensure proper destruction order - The new implementation explicitly calls the destructor before freeing memory, preventing use-after-destructor issues commit_hash:9669691da2c478864eab809124405fc6cc31e57d
* YQL-21315: Implement variant expensive validationatarasov513 days1-26/+71
| | | | | | | | | | | | | #### Implement expensive datum validation for variant types ✎ - Introduce comprehensive validation for variant data types that checks offset invariants to ensure data integrity - Add support for passing validation mode through fuzzer infrastructure to enable both cheap and expensive validation paths - Extend test helpers to support different validation modes and integrate validation into various test cases - Modify datum validation logic to differentiate between cheap and expensive validation modes, with expensive mode performing additional checks on dense union structures - Update fuzzer components to validate data at multiple points during transformation to catch potential issues early <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:eccd98ccb2ffdda6ebb1d19c7256d41abe424757
* Preparing for LLVM18. The first step.Anton Romanov13 days1-1/+1
| | | | | | | | | | Type: refactoring Component: query-tracker --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/1762 commit_hash:dcf0b6e086145d4d593c0691c38846ac4d87f36f
* YQL-21387: Introduce TStrongAliasatarasov52026-07-071-1/+1
| | | | | | | | | | | | | #### Introduce TStrongAlias type to prevent type confusion ✎ - Introduces `TStrongAlias` template to create distinct types for different conceptual uses of the same underlying data, preventing accidental mixing of semantically different values - Replaces direct `TString` usage with `TStrongAlias<class TRuntimeSettingsStableHashTag, TString>` for runtime settings hash to enforce type safety - Updates build configuration to include new `strong_alias` source files - Fixes a build issue in `mkql_computation_pattern_cache_ut.cpp` by properly accessing the `resize` method on the hash object - Provides comprehensive implementation of `TStrongAlias` including comparison, hashing, and stream output operators for type-safe usage <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:0c856e748ee2198d8545f1a96d24837132cf7d64
* YQL-20875: Pass validation flag to dq transport layeratarasov52026-06-305-42/+17
| | | | | | | | | | | | | | #### Pass validation flag to DQ transport layer ✎ - Introduce and propagate datum validation mode through the DQ transport layer to ensure consistent validation behavior across serialization and deserialization operations - Update transport serializers and deserializers to accept and utilize the validation mode parameter - Pass validation settings from task runners and compute actors to maintain end-to-end validation consistency - Add runtime settings serialization support to enable validation mode propagation in distributed scenarios - Extend channel service components to handle validation mode in both input and output serializers - Update various components including PQ read actors, wide combine operations, and spiller adapters to use the new validation parameter <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:c93ab318c05269f0e8402259c94ea52ab03bc4fa
* YQL-20095: Tune bugprone-argument-commentvitya-smirnov2026-06-3018-189/+189
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/bugprone/argument-comment.html commit_hash:780ff6a63be44998cb2336a05f3dc33e68a676bf
* YQL-21253: Simplify trimmer logicatarasov52026-06-262-26/+14
| | | | | | | | | | | #### Simplify trimmer and transport logic for dense unions ✎ - Refactored dense union trimming logic to use new helper functions that calculate child usage and adjust value offsets in a more efficient and reusable way - Introduced dedicated functions for adjusting dense union value offsets, both as a separate operation and in-place, reducing code duplication and improving maintainability - Updated transport logic to leverage the new helper functions, streamlining the process of handling dense union arrays during data processing <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:637d983c584cc0e0b02a8ac21946d168fe736770
* YQL-21207: Add langver and settings hash to cacheatarasov52026-06-254-51/+211
| | | | | | | | | | | | #### `YQL-21207`: Enhance cache key with langver and settings hash ✎ - Replaced serialized program string with a composite key consisting of language version, runtime settings hash, and serialized program to uniquely identify computation patterns. - Updated cache lookup, insertion, and notification mechanisms to use the new composite key for improved cache accuracy and consistency. - Modified pattern compilation and subscription logic to utilize the enhanced key for better cache management and pattern reuse. - Added unit tests to verify that the new key correctly distinguishes between different combinations of language version, settings, and program content. <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:db8a7b700579271bf301f1a2d40f662d77da424f
* YQL-20095: Enable performance-move-const-argvitya-smirnov2026-06-246-22/+24
| | | | | | | | | | | | | https://clang.llvm.org/extra/clang-tidy/checks/performance/move-const-arg.html This check useful, as it shows, when a `std::move` is useless, so to expectations of a programmer are not aligned with reality. The most useful profit is to see `const T&` arguments, that are potentially can be replaced with `T`. Also disabled `CheckTriviallyCopyableMove`, see https://nda.ya.ru/t/Emvgx5Z67fpZY5 why. commit_hash:c80c264a9774721aabbac85b350ccdbb8b9a39a2
* Intermediate changesrobot-piglet2026-06-165-104/+98
| | | | commit_hash:2cae56a990383c528801f71d03c3dffae2160ade
* YQL-20875: Enable apache arrow datum light checkatarasov52026-06-0410-56/+59
| | | | commit_hash:ca028259d6fbf7b46aa0cc392187b8b153716d62
* YQL-21018: Implement BlockVariant validatoratarasov52026-06-041-1/+29
| | | | commit_hash:5334d8fbea8ccff97821995e01cbb7229aa822f9
* YQL-21018: Implement builder and readers for block variantatarasov52026-06-016-11/+283
| | | | commit_hash:6514925c5290f805d279e2db85468c53c3db8f5d
* Change "yql/essentials/minikql/computation/mkql_computation_node_graph.cpp"vokayndzop2026-06-011-1/+2
| | | | commit_hash:594788b63fc30985620719d27c63a136eaab1363
* Use flushing mode flag instead finish fetch statusartemmashin2026-05-262-0/+14
| | | | commit_hash:3cfe2e66c9cf5391f2befa804ea429436660b222
* support max size configuration without cache drop outgvit2026-05-213-43/+139
| | | | | while reconfiguring the cache at i faced with a latency spikes because it's impossible to increase cache without full cache drop out commit_hash:2d090f8dd2348b7dc42d19082aec04d38da8c9df
* YQL-20162: A tuple's child array must have the same size as the tuple itselfatarasov52026-05-181-1/+3
| | | | commit_hash:a508756f74a720b541b3e8eca19cc54024451006
* YQL-20095: Enable readability-static-definition-in-anonymous-namespacevitya-smirnov2026-05-152-19/+19
| | | | commit_hash:f7485dac5115e73f75a5edccb3c65c0b657dd8e5
* YQL-19813: Pass owning ptr to computation contextatarasov52026-05-152-8/+15
| | | | commit_hash:62b0f7b453641a0f14878dfdaae79ceda2c2c506
* YQL-20095: Enable performance-trivially-destructiblevitya-smirnov2026-05-142-3/+1
| | | | commit_hash:80e99229c5978038c8f209c23696c2a03b7c103a
* YQL-20095: Enable modernize-use-emplacevitya-smirnov2026-05-132-27/+27
| | | | commit_hash:4d6e2f6fcc1639f09725c0c96de8d2f7f0f70404
* YQL-21018: Prepare test utils for block variant supportatarasov52026-05-131-8/+14
| | | | commit_hash:d08046f19590c93e827909f0bb9e28cfa829ffb7
* YQL-20095: Enable readability-uppercase-literal-suffixvitya-smirnov2026-05-076-53/+53
| | | | commit_hash:41791bb9a63f1993010fb68562e9a5607927307d
* YQL-19813: Udf implementationatarasov52026-05-075-6/+15
| | | | commit_hash:183e3a952a021c4701c20d6677800f245239d822
* YQL-20875: Small validator refactoringatarasov52026-05-051-11/+15
| | | | commit_hash:b9b2091c5f8842b4ce188be446252a575ab74397
* YQL-19813: Pass runtime settings to minikql + YT + minirunatarasov52026-04-294-82/+176
| | | | commit_hash:054395f57e37951159c1184eae2e6d4bc81245f8
* YQL-20095: Enable readability-inconsistent-declaration-parameter-namevitya-smirnov2026-04-284-28/+29
| | | | commit_hash:9589937209af8e742c0c6401bd1c232f073856bf
* YQL-19526: Purge GetDependencesCountimunkin2026-04-171-5/+0
| | | | commit_hash:8cd02e39e574c9e99cb36c6bc9a12acb1a037c18
* YQL-21164: Fix chain1 map callatarasov52026-04-161-2/+5
| | | | commit_hash:7cef97dc90e03e9f773a44e4bd51a51388a8d954
* YQL-20095: Enable readability-isolate-declarationvitya-smirnov2026-04-133-10/+21
| | | | commit_hash:c180c2db4897962cb70063ffdc2ddcd21e5e3418
* YQL-20873: Range PG supportatarasov52026-04-131-0/+1
| | | | commit_hash:9e799ea42a2692eb96ebc792b48e46dd060c182b
* YQL-20095: Enable readability-container-data-pointervitya-smirnov2026-04-082-3/+3
| | | | commit_hash:6bd18cff912ed7cc4b2bedd531c80cc43bdcd584
* YQL-20095: Enable readability-const-return-typevitya-smirnov2026-04-061-1/+1
| | | | commit_hash:8c898c65c0bdf92423256a1e752b13cc3ffd364a
* YQL-20095: Enable readability-avoid-const-params-in-declsvitya-smirnov2026-03-312-10/+10
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/readability/avoid-const-params-in-decls.html commit_hash:17e1ec5c3849a38bcb76cd4927e66979bee6c2ec
* YQL-20095: Enable modernize-use-designated-initializersvitya-smirnov2026-03-173-9/+9
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/modernize/use-designated-initializers.html commit_hash:d73eb463c7bec2bda4c362aab10af49979a7ddd3
* YQL-21012: Emulate lazy iterablesimunkin2026-03-053-0/+24
| | | | commit_hash:13b14443208137aa4f70d1aa4a17a076f371ee7b
* YQL-20972: Rewrite methods that has UV as output parameter.atarasov52026-03-058-1/+214
| | | | commit_hash:6068d33bd6ed2bb8bdfa7836ca5229b841dcd207
* YQL-20095: Enable modernize-use-usingvitya-smirnov2026-03-045-22/+22
| | | | commit_hash:ea1f0987ec40e3e683c35bffb64b7f5ab35e73ed
* YQL-20095: Enable modernize-use-equals-deletevitya-smirnov2026-03-031-2/+3
| | | | | https://clang.llvm.org/extra/clang-tidy/checks/modernize/use-equals-delete.html commit_hash:7ee40c7692cab9e1c16070f7f61d10f70f14c0bc
* YQL-20095: Enable modernize-pass-by-valuevitya-smirnov2026-03-029-39/+54
| | | | commit_hash:4939dfad654f18bb31e40711ee0c39063889f17b
* YQL-20095: Enable modernize-loop-convertvitya-smirnov2026-02-272-9/+9
| | | | | | | | - https://clang.llvm.org/extra/clang-tidy/checks/modernize/loop-convert.html Semi-automatic translation was performed. Manually rewritten some types and names. commit_hash:0ad921f0d512dd4a8ccc8af557197ce6a02582e1
* Refactor codegen for function callsimunkin2026-02-204-61/+44
| | | | commit_hash:72b10ed4677b5440bf8308bec7a0c1b21ab185c4
* YQL-20095: Enable bugprone-exception-escapeatarasov52026-02-201-0/+2
| | | | commit_hash:a511b90dbd2eadcf32cc5d75130da6c9d4efaa52
* YQL-20095: Enable modernize-avoid-c-arraysvitya-smirnov2026-02-1911-66/+63
| | | | commit_hash:da491ee93c4f4d3c885c7908a22b4d5d66c80388
* YQL-20095: Enable modernize-concat-nested-namespacesvitya-smirnov2026-02-1733-145/+64
| | | | commit_hash:2c0e0389bf5eca0c8334d55143674a8acf94a88d
* mkql_computation_node_graph: disallow MultiHoppingCore cachingyumkam72026-02-091-1/+2
| | | | | | as it contains `&`reference to TDqTaskRunner (that's, of cause, fragile and should be eventually fixed) Triggers intermittent failures in contrib/ydb/tests/fq/streaming/test_watermarks.py commit_hash:26b7a37167ac6cd8fa9d84f0cfded8ece9f9e20d
* YQL-19485: Fix ChainMap and Chain1Map multi usageimunkin2026-02-061-3/+30
| | | | commit_hash:6982601bd53c3783e4e3dbe2c726d6b41e767cb1
* YQL-20095: Enable misc-redundant-expressionvitya-smirnov2026-02-021-0/+1
| | | | | - https://clang.llvm.org/extra/clang-tidy/checks/misc/redundant-expression.html commit_hash:eb365e8e841251ac378b8dbb0d0f9456c8b52361