ydb/yql/essentials/core/services, branch main

YQL-20445: Lineage support for multi-input reduce

2026-07-14T08:48:13Z

#### Lineage support for multi-input reduce operations ✎ - Enhanced lineage tracking to properly handle multi-input reduce operations by capturing and propagating data flow information across multiple input streams - Extended lineage collection logic to process complex nested operations including `Mux`, `Chopper`, `Condense1`, and updated `LMap`/`OrderedLMap` handlers - Improved schema reference handling and field lineage propagation for structured data types in reduce operations - Added new test cases and validation to ensure correct lineage generation for multi-input reduce scenarios - Updated lineage collection for various operators to maintain consistency and accuracy in data dependency tracking Autodescription by Yandex Code Assistant commit_hash:73935e78374633a17d6558ce5ba0102f911a666e

YQL-21370: Support TCoreAttr::Args at SqlCore

2026-07-10T10:56:42Z

#### Support TCoreAttr::Args at SqlCore ✎ - Introduces support for extended SQL flags with arguments in the SqlCore configuration, allowing flags to carry additional parameters for more granular control - Refactors internal flag handling to use a map-based structure instead of a simple set, enabling storage and processing of flag arguments - Updates module resolver and translation settings parsing to work with the new extended flag format, ensuring proper flag propagation and application - Adds new infrastructure for parsing and managing SQL translation flags with arguments, including dedicated parsing logic for specific flag types - Maintains backward compatibility while enabling new functionality for SQL flag configuration through gateways and command-line options Autodescription by Yandex Code Assistant commit_hash:8b26974b3bf4ff2bdaf76715cbb210a8a15e1dad

YQL-21375: Add AssumeUnique and AssumeDistinct callables to Lineage

2026-07-09T12:37:11Z

#### Add AssumeUnique and AssumeDistinct Callables to Lineage ✎ - Extend lineage tracking to include new `AssumeUnique` and `AssumeDistinct` callables, enabling more precise dependency analysis for SQL operations that assume uniqueness or distinctness of data. - Introduce additional related callables (`AssumeUniqueHint`, `AssumeDistinctHint`, etc.) to support enhanced lineage computation for various optimization hints and constraints. - Add comprehensive test cases and validation to ensure correct handling of these new callables in SQL-to-YQL conversion and lineage generation. Autodescription by Yandex Code Assistant commit_hash:42b9290cd290b6c5113fe1875fc7c215f4e0070d

YQL-21358: Skip lineage calculation for system columns

2026-07-03T13:28:42Z

#### Skip lineage calculation for system columns ✎ - Skip lineage computation for columns with names starting with the system prefix to avoid unnecessary processing - Modify field access logic to conditionally handle system columns by returning empty lineage instead of processing their structure - Update lineage merging logic to bypass system columns when building field relationships and avoid potential errors during struct item processing - Ensure system columns are excluded from both direct field access and nested struct item handling during lineage calculation Autodescription by Yandex Code Assistant commit_hash:3541fea8fcc7b94954902168adbeffe9f378309d

YQL-21358: Lineage support for CalcOverWindowGroup

2026-07-01T20:46:01Z

#### Lineage support for CalcOverWindowGroup ✎ - Added support for tracking lineage information in CalcOverWindowGroup operations, ensuring proper propagation of data dependencies through windowing functions - Implemented handling for session columns in window group operations, correctly merging lineage from initialization and update handlers - Enhanced lineage collection logic to properly process session window traits and their associated column dependencies - Introduced new test cases covering lineage tracking for window session pushdown scenarios to validate the implementation Autodescription by Yandex Code Assistant commit_hash:bb0e1d37e9a97550157088c5579dc9fd1b762898

YQL-21358: Fix lineage for empty struct

2026-06-30T18:58:05Z

#### Lineages flatten_list_over_udf: https://nda.ya.ru/t/dtjLiZWf7h4EfF join_empty_struct: https://nda.ya.ru/t/a1IqkmOD7h4EfJ #### Fix lineage handling for empty structs and flatten operations ✎ - Added safety check when accessing struct items to prevent crashes when dealing with empty structs - Enhanced lineage tracking for flatten operations over UDFs to ensure proper field resolution - Improved handling of empty struct cases during join operations to maintain accurate lineage information - Introduced new test cases to validate the fix for both flatten and join operations with empty structs Autodescription by Yandex Code Assistant commit_hash:019667e4f4a9194ab429f5f07ed5defd305ee814

YQL-20095: Tune bugprone-argument-comment

2026-06-30T14:16:39Z

https://clang.llvm.org/extra/clang-tidy/checks/bugprone/argument-comment.html commit_hash:780ff6a63be44998cb2336a05f3dc33e68a676bf

YQL-20095: Enable performance-move-const-arg

2026-06-24T10:13:06Z

https://clang.llvm.org/extra/clang-tidy/checks/performance/move-const-arg.html This check useful, as it shows, when a `std::move` is useless, so to expectations of a programmer are not aligned with reality. The most useful profit is to see `const T&` arguments, that are potentially can be replaced with `T`. Also disabled `CheckTriviallyCopyableMove`, see https://nda.ya.ru/t/Emvgx5Z67fpZY5 why. commit_hash:c80c264a9774721aabbac85b350ccdbb8b9a39a2

YQL-21344: Lineage support for PushdownFiltersOverWindow

2026-06-24T09:35:52Z

#### Lineage support for PushdownFiltersOverWindow optimization ✎ - Added logic to skip WinFilter nodes during lineage analysis when PushdownFiltersOverWindow optimization is enabled, ensuring accurate lineage tracking for window operations - Introduced comprehensive test cases covering the new lineage behavior for window functions with filter pushdown optimization - Updated test result files to include the new lineage test scenarios and their expected outputs - Enhanced the lineage computation to properly handle window filter operations while maintaining correctness of data dependencies Autodescription by Yandex Code Assistant commit_hash:41388aaa9d8fdcccd3194781c992ac5de80fab17

Use Cons! in translator instead of Nth

2026-06-17T10:32:02Z

commit_hash:ec28efb62da755bd372bba274c8eaa0f3f5233f3