ydb/yt/yql/tests/sql/suites, branch main

Support proper write to sorted yt table

2026-07-17T09:58:08Z

commit_hash:572af6eec0409e60c1c7a234f7b60275da0aaf37

YQL-20445: Lineage support for multi-input reduce

2026-07-14T08:48:13Z

#### Lineage support for multi-input reduce operations ✎ - Enhanced lineage tracking to properly handle multi-input reduce operations by capturing and propagating data flow information across multiple input streams - Extended lineage collection logic to process complex nested operations including `Mux`, `Chopper`, `Condense1`, and updated `LMap`/`OrderedLMap` handlers - Improved schema reference handling and field lineage propagation for structured data types in reduce operations - Added new test cases and validation to ensure correct lineage generation for multi-input reduce scenarios - Updated lineage collection for various operators to maintain consistency and accuracy in data dependency tracking Autodescription by Yandex Code Assistant commit_hash:73935e78374633a17d6558ce5ba0102f911a666e

Change `MATERIALIZE` grammar to exclude `WITH` statement ambiguity

2026-07-10T15:57:46Z

#### Change MATERIALIZE grammar to exclude hints ambiguity ✎ - Restructured the MATERIALIZE statement grammar to resolve ambiguity between table hints and cluster specification by reordering clauses to place hints after the target cluster - Updated minimum language version requirement for the MATERIALIZE feature to 2026.02 - Modified format tests and validation logic to align with the new grammar structure - Added tests for single and multiple hints to ensure proper parsing and handling - Updated canonical test outputs to reflect the new syntax order with hints positioned after the INTO clause and before the ON clause Autodescription by Yandex Code Assistant commit_hash:0dec4e34cf45e66962a8e8884c6cee893ad3dfb2

Fix YQL native YT type flags: Complete Edition

2026-07-10T13:22:51Z

- Cherry-picked original "Fix YQL native YT type flags" and "Fix YT native types handling for aux columns - 2" with additional fixes (previously reverted) - Enforce mandatory usage of the type v3 schema for output tables - Major refactoring of Skiff encoder/decoder to fix non-complex nativeness support commit_hash:2b4241624a261a690c916a7386b84cb3d483a373

Support PruneUnusedColumns in Materialize

2026-07-10T09:30:27Z

#### Support PruneUnusedColumns in Materialize ✎ - Adds support for the `prune_unused_columns` setting in Materialize operations, enabling optimization to remove unused columns from materialized tables - Extends the YtProvider to recognize and validate the new PruneUnusedColumns setting for both Materialize and Persist operations - Implements optimizations to handle column pruning in Materialize operations, including handling ExtractMembers over Materialize cases and multi-usage scenarios - Updates physical finalizing logic to properly handle Persist operations with PruneUnusedColumns setting - Adds new test cases to verify the functionality of column pruning in Materialize operations with various filtering scenarios - Modifies existing tests to reflect changes in behavior and ensure compatibility with the new optimization feature Autodescription by Yandex Code Assistant commit_hash:83c18981b8767ac2b789c1b1ae81aaa1ee164a92

YQL-21375: Add AssumeUnique and AssumeDistinct callables to Lineage

2026-07-09T12:37:11Z

#### Add AssumeUnique and AssumeDistinct Callables to Lineage ✎ - Extend lineage tracking to include new `AssumeUnique` and `AssumeDistinct` callables, enabling more precise dependency analysis for SQL operations that assume uniqueness or distinctness of data. - Introduce additional related callables (`AssumeUniqueHint`, `AssumeDistinctHint`, etc.) to support enhanced lineage computation for various optimization hints and constraints. - Add comprehensive test cases and validation to ensure correct handling of these new callables in SQL-to-YQL conversion and lineage generation. Autodescription by Yandex Code Assistant commit_hash:42b9290cd290b6c5113fe1875fc7c215f4e0070d

YQL-21363: Support EvaluateAtom source on YqlSelect

2026-07-08T11:45:02Z

#### Support EvaluateAtom source in YqlSelect ✎ - Introduces support for `EvaluateAtom` as a source in YqlSelect, enabling dynamic cluster and key resolution at query execution time - Replaces literal string fields with deferred atom types to allow expression evaluation for cluster and key identifiers - Adds logic to convert deferred atoms to `EvaluateAtom` nodes during query compilation, supporting complex expressions in table references - Enables usage of variables and string concatenation in cluster and table path specifications, enhancing query flexibility - Updates parsing and building logic to handle deferred atoms in table references while maintaining backward compatibility - Adds new test cases to verify the functionality with variable expressions and dynamic table paths Autodescription by Yandex Code Assistant commit_hash:89e4e90dd2d018de373373af560f48a1015e01e8

Push Any in EquiJoin tree

2026-07-06T16:08:27Z

#### Push Any in EquiJoin tree ✎ - Introduces logic to push "Any" hints through EquiJoin tree structures to optimize join operations - Adds support for all join types (Inner, Left, Right, Full, Semi, etc.) when pushing Any hints - Moves PruneKeys functionality to the leaves of EquiJoin tree and enhances its behavior - Implements new optimization passes that improve pruning and hint propagation in join operations - Updates test suite with comprehensive test cases covering various join types and key shapes - Refactors existing code by moving EquiJoin-related optimizations into a dedicated flow step Autodescription by Yandex Code Assistant commit_hash:fda17ab32277b4da545c8df1393eaeb8a7e5c229

Support new Materialize in YT provider

2026-07-03T19:55:44Z

#### Support new Materialize in YT provider ✎ - Introduces support for the new Materialize operation in the YT provider, enabling materialization of query results into temporary tables - Adds necessary type annotations, constraint handling, and execution logic for the Materialize operation - Implements physical optimization rules to properly handle Materialize operations during query planning - Includes support for persisting materialized data and integrating it with existing YT operations like Publish and Copy - Adds comprehensive test cases covering various Materialize scenarios including basic usage, sorting preservation, and complex expressions - Updates SQL-to-YQL conversion to properly handle Materialize statements in SQL queries Autodescription by Yandex Code Assistant commit_hash:f915520020d0958e0e8c2a298b197564d3298675

YQL-19699: Keep World for AND/OR Absorption

2026-07-03T14:03:53Z

#### `YQL-19699`: Keep World for AND/OR Absorption ✎ - Introduces logic to preserve world information during AND/OR absorption optimizations to prevent incorrect side effect handling - Adds validation to ensure side effects are properly considered when determining if expressions can be safely absorbed - Updates optimization passes to maintain world context in cases where logical absorption would otherwise alter execution semantics - Includes comprehensive test coverage for various side effect scenarios in logical absorption cases - Ensures that optimizations respect the presence of side effects in expressions to maintain correct evaluation order and behavior Autodescription by Yandex Code Assistant commit_hash:5802b1e45ce9c14cafddb9ba5e0356406a6d8fe3