| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
| |
commit_hash:a6b640bc576263b62884a0b4187ba79c893e13d9
|
|
|
|
| |
commit_hash:b776960a1c683287ff0b5b23d95b2d48b0edccb5
|
|
|
|
| |
commit_hash:2026d14a75fbe4bd05e203b0be13d604f519ced3
|
|
|
|
| |
commit_hash:e96f7390db5fcbe7e9f64f898141a263ad522daa
|
|
|
|
| |
commit_hash:d2cc5bdd92d46a975e2bf20b3b97e2b5db7b1fa1
|
|
|
|
| |
commit_hash:e110161b40adda83e1919789419ff2a0529b4f29
|
|
|
|
| |
commit_hash:d470719c41ed5a4d1d5b5b4f33b736137bcdd35f
|
|
|
|
|
| |
init
commit_hash:2361e5be62a52d87831827081133ecaf8b183abc
|
|
|
|
|
|
|
| |
funcs
init
commit_hash:e51fcff5b11ce252174d946af23ba9b3727f0ec3
|
|
|
|
| |
commit_hash:a3bbef18870abda431203c08f773634bd3a776f7
|
|
|
|
|
|
|
|
|
| |
When spilling data to disk, the system uses a packer and its packed objects. These objects are allocated via tcmalloc and therefore are not tracked by mkqlalloc. Normally this is not an issue, since spilling objects are relatively small and temparary. However, on a cluster many tasks may spill simultaneously, which can lead to significant untracked memory usage - as happened here: <https://github.com/ydb-platform/ydb/issues/21494>
To address this, I am adding memory tracking for spilling. From now on, spilling will notify the resource manager directly about the memory it consumes.
**Note:** this PR also changes contrib to prevent compilation errors. We agreed to sync these changes carefully.
commit_hash:86ff64f5de313d6d5edad5f780fd8ec2a3f85fce
|
|
|
|
| |
commit_hash:d3b2d5b7f166b837c20902da616785f358666a4a
|
|
|
|
| |
commit_hash:297647045a9ca9c90137f0ec6488181f81fe2447
|
|
|
|
| |
commit_hash:c22dc757dcd7996bac8fb892184281503a2ab003
|
|
|
|
|
|
|
|
| |
В данном пулреквесте я добавил поддержку сериализации tuple/struct массивов с разными оффсетами.
Сделал это через новый флаг `EValuePackerVersion::{V0, V1}`.
Также нужно будет сделать коммит в contrib/ydb
commit_hash:79709ad660a4295958e5488d3dd24d660f32ca9a
|
|
|
|
|
|
|
|
| |
В данном PR включена поддержка валидации Datum'ов на соответствие `MKQL type <-> arrow type <-> arrow array data structure.`
Выявленные проблемы:
1\. `AllocateResizableBuffer(size_t size)` возвращает массив длины 0 вместо size. Поэтому есть ошибка в работе с датами в некоторых нодах
commit_hash:122f2bd114dec50993131391a3793d9540877cb4
|
|
|
|
| |
commit_hash:8d3031aaf3f344572e98e205b92760187a97dd95
|
|
|
|
| |
commit_hash:15146ac1817e0abc0483b2c138207daf3b63fdd5
|
|
|
|
|
| |
Allow multiple dependent nodes for Flow mkql callables
commit_hash:c895960db965367ca567923755fd29547c2d23f1
|
|
|
|
| |
commit_hash:c35c972d6708fb1b3f34fa34a42cdae1ddf11cdc
|
|
|
|
| |
commit_hash:0f93920592ababed5f28efbe4d25c9651f578c8b
|
|
|
|
|
| |
Воспользовавшись недавно добавленной метрикой про wasted-память стало понятно, что текущий универсальный размер страниц в `TPagedBuffer` слишком велик. В этом ПР добавляется возможность устанавливать размер страниц снаружи - отдельно для каждого объекта `TPagedBuffer`.
commit_hash:f82fa4e6162a129bb4442f18657c32b074cb07f7
|
|
|
|
|
| |
YQL fixed string block transport
commit_hash:03c8000cbc64db248ba74bf3b0c57b4c35bf0f98
|
|
|
|
|
|
|
| |
fix
YQL-18878: Provide regex error from 2025.03 version
commit_hash:fdaeba4009bfbedccd39942909bcd303ae4ae932
|
|
|
|
| |
commit_hash:9e278f075e1a9c899d4ef9c137eee25958597358
|
|
|
|
| |
commit_hash:ecdd6fac555c33978a3faed996a8cb2d996958b9
|
|
|
|
| |
commit_hash:6e3f5fac6a8598586987b52d749644d1ce1fccbe
|
|
|
|
| |
commit_hash:df32357c7548d7667ae0e67e2cced1d4313e81b6
|
|
|
|
| |
commit_hash:a9fe597dbe3726828f1048c3f67f861e511dbecb
|
|
|
|
| |
commit_hash:bae79a39ae78ceed103c460f7949d1a2483e0b73
|
|
|
|
|
|
|
| |
Семантика ноды ListToBlocks - преобразование списка структур в список блочных структур:`List<Struct<a:T1,...>> -> List<Struct<a:Block`<T1>`, ... ,_yql_block_len:Scalar`<Uint64>`>` (как WideToBlocks, но для списков)
На вход ожидается ленивый список, на выход также выдается ленивый список
commit_hash:0b364f55810a492fdcce7dc06b1e69701a1db01f
|
|
|
|
| |
commit_hash:9a814af3b8bd51c53939aa6ffde2e981ad8ea150
|
|
|
|
|
| |
Added block trimming in transport
commit_hash:9794613300322045a81a9b40d4ebe519d30937a4
|
|
|
|
| |
commit_hash:ec5e09d191b714b8465756189e5d0898ba6ce92a
|
|
|
|
|
| |
init
commit_hash:6178c9e20a737d499b13f1b38fdfb621f2d8db2f
|
|
|
|
| |
commit_hash:b673d403e9bfb2ac31eedd8d2231ac018a8f36dd
|
|
|
|
| |
commit_hash:57e4f4066d30b24b967f1c4cb57bfafbd7948d34
|
|
|
|
|
| |
Added sub buffers size into block trimer
commit_hash:c1c708e6807c8e5b2ef7210dd13fe54216faa110
|
|
|
|
| |
commit_hash:2ec2671384dd8e604d41bc5c52c2f7858e4afea6
|
|
|
|
| |
commit_hash:2bcb57a12fbb750db7b33872e2cfbec66bdf6405
|
|
|
|
| |
commit_hash:1334e5c0fb5ff26fd40681059409f46cf49ec025
|
|
|
|
| |
commit_hash:3bc8ebae176007863577966a476425b34ea54698
|
|
|
|
| |
commit_hash:216229b0558e1004453dedddbec8b767b2dab9c6
|
|
|
|
| |
commit_hash:b046f9169a163726d8afeab5f5b58bc8450d0e1b
|
|
|
|
| |
commit_hash:997d731b3d106421ee68aa2e3e18f18b03ea7a66
|
|
|
|
| |
commit_hash:5357736eed7a221ff5844d4351abe23e65930632
|
|
|
|
| |
commit_hash:ffdd14a35d07660b4bebf2a6471da83349a37d78
|
|
|
|
| |
commit_hash:f304439abe934725ac66892a05e5a4656e4c12e3
|
|
|
|
| |
commit_hash:fc1f44ff256c759953b54e2ccac3277dc66c1165
|
|
|
|
| |
commit_hash:c166e0d029d87d2a10e5adfc3acf20a849670881
|