diff options
| author | mfilitov <[email protected]> | 2025-08-26 14:39:22 +0300 |
|---|---|---|
| committer | mfilitov <[email protected]> | 2025-08-26 14:57:45 +0300 |
| commit | a6de3ae0a30f46f7f8fa776b9b512190a9a6dde8 (patch) | |
| tree | 882983f58e67369a2b73d0c7fff8beedd0584a94 /library/cpp/unified_agent_client/backend_creator.h | |
| parent | 5302ae7ceeccd12004b7b30551baa7fb960d8f0e (diff) | |
[WideCombine] Added spiller memory tracking
When spilling data to disk, the system uses a packer and its packed objects. These objects are allocated via tcmalloc and therefore are not tracked by mkqlalloc. Normally this is not an issue, since spilling objects are relatively small and temparary. However, on a cluster many tasks may spill simultaneously, which can lead to significant untracked memory usage - as happened here: <https://github.com/ydb-platform/ydb/issues/21494>
To address this, I am adding memory tracking for spilling. From now on, spilling will notify the resource manager directly about the memory it consumes.
**Note:** this PR also changes contrib to prevent compilation errors. We agreed to sync these changes carefully.
commit_hash:86ff64f5de313d6d5edad5f780fd8ec2a3f85fce
Diffstat (limited to 'library/cpp/unified_agent_client/backend_creator.h')
0 files changed, 0 insertions, 0 deletions