ydb/library/cpp/yt/misc/property.h, branch CLI_2.21.0Mirror of YDB github reposhttps://code.mastervirt.ru/ydb/atom?h=CLI_2.21.02025-03-05T22:55:54ZYT-21910: Master compact table schema2025-03-05T22:55:54Zcherepashkacherepashka@yandex-team.com2025-03-05T22:26:29Zurn:sha1:16867b871a3abf548c504976fb8ca49c882b1ffd
- Changelog entry
Type: feature
Component: master
Introduce TCompactTableSchema, that holds wire protobuf schema representation and lighter than TTableSchema
commit_hash:21801854b37fc25c5004ee01e5b79a3b3b6ea983
YT-20614: Change cross-cell copy format (in preparation for Sequoia)2024-07-08T15:23:19Zh0plessh0pless@yandex-team.com2024-07-08T15:08:58Zurn:sha1:8da74912ee34eca48725266dc7db2f757c6d7a2a
The new format is better optimized for VectorizedRead, which is needed in Sequoia.
Previously, the output for the BeginCopy verb was a serialized subtree plus the list of opaque children. In a non-Sequoia world, that is useful and easy to work with. However, in Sequoia, a subtree might not be contained on the same cell, which makes it difficult to use the old data transfer format.
Now it's a vector of nodes with clear separation between them. This change makes it easier to work with VectorizedRead since the conversion between BeginCopy return and VectorizedRead(BeginCopy) return is very straight-forward. Additionally, this change helps with copying from Cypress to Sequoia, since now it's much easier to process each node individually (which is needed for Sequoia to work and not clog up one cell).
In the next PR, I'm planning on:
1. Making BeginCopy a read-request (removing snapshot locks). So the verb will only return meta-information about the requested nodes.
2. Adding a verb, executed before BeginCopy, where the locks would be taken and the general structure of the tree is returned.
017ec9971e8e0a611a7286ed748b6071cfc89048
Intermediate changes2024-02-02T18:40:11Zrobot-pigletrobot-piglet@yandex-team.com2024-02-02T18:28:02Zurn:sha1:7975803ac2bf9fa5ee89888743a50cd3b382d7c7Get rid of TClusterResourceLimits::operator+()2023-09-21T21:34:09Zkvk1920kvk1920@yandex-team.com2023-09-21T21:20:05Zurn:sha1:e74e887de43ac6520b91832a062ff9478c3167c9YT-19210: expose YQL shared library for YT.2023-07-28T21:02:16Zmax42max42@yandex-team.com2023-07-28T21:02:16Zurn:sha1:73b89de71748a21e102d27b9f3ed1bf658766cb5
After this, a new target libyqlplugin.so appears. in open-source cmake build.
Diff in open-source YDB repo looks like the following: https://paste.yandex-team.ru/f302bdb4-7ef2-4362-91c7-6ca45f329264Revert "YT-19324: move YT provider to ydb/library/yql"2023-06-30T08:13:34Zmax42max42@yandex-team.com2023-06-30T08:13:34Zurn:sha1:3e1899838408bbad47622007aa382bc8a2b01f87
This reverts commit ca272f12fdd0e8d5c3e957fc87939148f1caaf72, reversing
changes made to 49f8acfc8b0b5c0071b804423bcf53fda26c7c12.YT-19324: move YT provider to ydb/library/yql2023-06-30T00:37:03Zmax42max42@yandex-team.com2023-06-30T00:37:03Zurn:sha1:fac2bd72b4b31ec3238292caf8fb2a8aaa6d6c4a
This commit is formed by the following script: https://paste.yandex-team.ru/6f92e4b8-efc5-4d34-948b-15ee2accd7e7/text.
This commit has zero effect on all projects that depend on YQL.
The summary of changes:
- `yql/providers/yt -> ydb/library/yql/providers/yt `- the whole implementation of YT provider is moved into YDB code base for further export as a part of YT YQL plugin shared library;
- `yql/providers/stat/{expr_nodes,uploader} -> ydb/library/yql/providers/stat/{expr_nodes,uploader}` - a small interface without implementation and the description of stat expr nodes;
- `yql/core/extract_predicate/ut -> ydb/library/yql/core/extract_predicate/ut`;
- `yql/core/{ut,ut_common} -> ydb/library/yql/core/{ut,ut_common}`;
- `yql/core` is gone;
- `yql/library/url_preprocessing -> ydb/library/yql/core/url_preprocessing`.
**NB**: all new targets inside `ydb/` are under `IF (NOT CMAKE_EXPORT)` clause which disables them from open-source cmake generation and ya make build. They will be enabled in the subsequent commits.remove kikimr/driver DEPENDS2022-12-02T08:31:25Zqrortqrort@yandex-team.com2022-12-02T08:31:25Zurn:sha1:b1f4ffc9c8abff3ba58dc1ec9a9f92d2f0de6806validate canons without yatest_common2022-11-30T20:47:12Zqrortqrort@yandex-team.com2022-11-30T20:47:12Zurn:sha1:22f8ae0e3f5d68b92aecccdf96c1d841a0334311fix ya.make2022-07-07T11:41:37Zmonstermonster@ydb.tech2022-07-07T11:41:37Zurn:sha1:06e5c21a835c0e923506c4ff27929f34e00761c2