diff options
author | alexelexa <alexelexa@yandex-team.com> | 2024-11-19 18:55:36 +0300 |
---|---|---|
committer | alexelexa <alexelexa@yandex-team.com> | 2024-11-19 19:08:49 +0300 |
commit | ee98714b4bafd7ac4bc0b68e563b752cbdb7af52 (patch) | |
tree | 530ad247715172e066754e784e857334aac70273 /yql/essentials/core/yql_udf_index.cpp | |
parent | 2aee27a94a33a27354bf51c3e9cc58d7dd4efa42 (diff) | |
download | ydb-ee98714b4bafd7ac4bc0b68e563b752cbdb7af52.tar.gz |
YT-20044: Remote copy for dynamic tables with hunk chunks
Support remote copy for dynamic table with hunk chunks.
- Still doesn't work for tables with compression dictionaries.
- Still doesn't work for tables with erasure encoded hunks, mainly due to unsupported remote copy for tables with striped erasure.
Remote copy scheme:
* fetch hunk chunk specs (same as for regular chunks);
* remote copy hunk chunks (TRemoteCopyHunkTask), each job returns HunkChunkIdMapping (old -\> new);
* add HunkChunkIdMapping to remote copy spec to patch chunk meta;
* remote copy chunks (TRemoteCopyTask);
* get hunk chunk list ids for output table;
* attach hunks to chunk lists in which tablets they are used.
Throw an error if the table has compression dictionary config in `@mount_config`.
Throw an error if a static table somehow has a non-empty HunkChunks list.
### Changelog entry
Type: feature
Component: controller-agents, dynamic-tables
commit_hash:bdc959e21c5ea1182ed0ea8268fee3d91e40a427
Diffstat (limited to 'yql/essentials/core/yql_udf_index.cpp')
0 files changed, 0 insertions, 0 deletions