summaryrefslogtreecommitdiffstats
path: root/yql/essentials/minikql/computation
Commit message (Collapse)AuthorAgeFilesLines
* YQL-20086 invert flagvvvv10 days3-6/+0
| | | | commit_hash:a6b640bc576263b62884a0b4187ba79c893e13d9
* YQL-20350: Fix singular typesatarasov511 days8-31/+224
| | | | commit_hash:b776960a1c683287ff0b5b23d95b2d48b0edccb5
* YQL-20425: Fix ubsan failed tests (Part 7)atarasov511 days1-5/+10
| | | | commit_hash:2026d14a75fbe4bd05e203b0be13d604f519ced3
* YQL-20086 minikqlvvvv11 days65-6459/+7372
| | | | commit_hash:e96f7390db5fcbe7e9f64f898141a263ad522daa
* YQL-20425: Fix ubsan tests (part 6)atarasov52025-10-061-1/+1
| | | | commit_hash:d2cc5bdd92d46a975e2bf20b3b97e2b5db7b1fa1
* YQL-20425: Fix ubsan failed tests (Part 2)atarasov52025-10-011-1/+1
| | | | commit_hash:e110161b40adda83e1919789419ff2a0529b4f29
* YQL-20083: Fix tagged typesatarasov52025-09-191-2/+4
| | | | commit_hash:d470719c41ed5a4d1d5b5b4f33b736137bcdd35f
* YQL-20339 abi & udfvvvv2025-09-181-0/+1
| | | | | init commit_hash:2361e5be62a52d87831827081133ecaf8b183abc
* YQL-20339 mkql types & funcsvvvv2025-09-121-0/+4
| | | | | | | funcs init commit_hash:e51fcff5b11ce252174d946af23ba9b3727f0ec3
* YQL-20309: Purge TStatefulWideFlowCodegeneratorNodeimunkin2025-08-293-276/+0
| | | | commit_hash:a3bbef18870abda431203c08f773634bd3a776f7
* [WideCombine] Added spiller memory trackingmfilitov2025-08-267-42/+316
| | | | | | | | | When spilling data to disk, the system uses a packer and its packed objects. These objects are allocated via tcmalloc and therefore are not tracked by mkqlalloc. Normally this is not an issue, since spilling objects are relatively small and temparary. However, on a cluster many tasks may spill simultaneously, which can lead to significant untracked memory usage - as happened here: <https://github.com/ydb-platform/ydb/issues/21494> To address this, I am adding memory tracking for spilling. From now on, spilling will notify the resource manager directly about the memory it consumes. **Note:** this PR also changes contrib to prevent compilation errors. We agreed to sync these changes carefully. commit_hash:86ff64f5de313d6d5edad5f780fd8ec2a3f85fce
* YQL-20304: Handle Skip for singular multi type properlyimunkin2025-08-151-1/+1
| | | | commit_hash:d3b2d5b7f166b837c20902da616785f358666a4a
* YQL-20229: Add WideMap stream overloadatarasov52025-08-011-0/+1
| | | | commit_hash:297647045a9ca9c90137f0ec6488181f81fe2447
* YQL-20230: Handle singular types in DoConvertScalaratarasov52025-07-231-0/+4
| | | | commit_hash:c22dc757dcd7996bac8fb892184281503a2ab003
* YQL-19995: Fix block serialization for child data with different offsetsatarasov52025-07-236-293/+959
| | | | | | | | В данном пулреквесте я добавил поддержку сериализации tuple/struct массивов с разными оффсетами. Сделал это через новый флаг `EValuePackerVersion::{V0, V1}`. Также нужно будет сделать коммит в contrib/ydb commit_hash:79709ad660a4295958e5488d3dd24d660f32ca9a
* YQL-20102: Enable debug arrow validationatarasov52025-07-106-13/+172
| | | | | | | | В данном PR включена поддержка валидации Datum'ов на соответствие `MKQL type <-> arrow type <-> arrow array data structure.` Выявленные проблемы: 1\. `AllocateResizableBuffer(size_t size)` возвращает массив длины 0 вместо size. Поэтому есть ошибка в работе с датами в некоторых нодах commit_hash:122f2bd114dec50993131391a3793d9540877cb4
* Fix Arrow Buffer untracking for imported buffersilezhankin2025-07-101-2/+2
| | | | commit_hash:8d3031aaf3f344572e98e205b92760187a97dd95
* YQL-19536: Block ifpresentatarasov52025-07-082-4/+4
| | | | commit_hash:15146ac1817e0abc0483b2c138207daf3b63fdd5
* Allow multiple dependent nodes for Flow mkql callablesziganshinmr2025-06-302-43/+52
| | | | | Allow multiple dependent nodes for Flow mkql callables commit_hash:c895960db965367ca567923755fd29547c2d23f1
* YQL-20086 minikqlvvvv2025-06-2330-1822/+1828
| | | | commit_hash:c35c972d6708fb1b3f34fa34a42cdae1ddf11cdc
* YQL-19536: Block scalar versions of nodesatarasov52025-06-171-4/+4
| | | | commit_hash:0f93920592ababed5f28efbe4d25c9651f578c8b
* Allow to modify the default buffer page size in TPagedBufferilezhankin2025-06-163-8/+13
| | | | | Воспользовавшись недавно добавленной метрикой про wasted-память стало понятно, что текущий универсальный размер страниц в `TPagedBuffer` слишком велик. В этом ПР добавляется возможность устанавливать размер страниц снаружи - отдельно для каждого объекта `TPagedBuffer`. commit_hash:f82fa4e6162a129bb4442f18657c32b074cb07f7
* YQL fixed block transport in case of null columnsgrigoriypisar2025-06-101-4/+1
| | | | | YQL fixed string block transport commit_hash:03c8000cbc64db248ba74bf3b0c57b4c35bf0f98
* fix re2 langvervvvv2025-05-281-0/+1
| | | | | | | fix YQL-18878: Provide regex error from 2025.03 version commit_hash:fdaeba4009bfbedccd39942909bcd303ae4ae932
* YQL-19765: Store IHash, ICompare, IEquate by type value instead of pointeratarasov52025-05-143-16/+18
| | | | commit_hash:9e278f075e1a9c899d4ef9c137eee25958597358
* YQL-19014: Fix Convert codegen for Bool target typeimunkin2025-05-131-4/+4
| | | | commit_hash:ecdd6fac555c33978a3faed996a8cb2d996958b9
* YQL-19861 abi, udf resolvers, test, pass via yt gatewaysvvvv2025-04-215-24/+41
| | | | commit_hash:6e3f5fac6a8598586987b52d749644d1ce1fccbe
* YQL-19520: Move function to NInternal namespaceatarasov52025-04-021-2/+11
| | | | commit_hash:df32357c7548d7667ae0e67e2cced1d4313e81b6
* YQL-19520: Missing pragmaatarasov52025-03-311-0/+2
| | | | commit_hash:a9fe597dbe3726828f1048c3f67f861e511dbecb
* ListFromBlocks computation nodeziganshinmr2025-03-271-1/+5
| | | | commit_hash:bae79a39ae78ceed103c460f7949d1a2483e0b73
* ListToBlocks computation nodeziganshinmr2025-03-253-13/+23
| | | | | | | Семантика ноды ListToBlocks - преобразование списка структур в список блочных структур:`List<Struct<a:T1,...>> -> List<Struct<a:Block`<T1>`, ... ,_yql_block_len:Scalar`<Uint64>`>` (как WideToBlocks, но для списков) На вход ожидается ленивый список, на выход также выдается ленивый список commit_hash:0b364f55810a492fdcce7dc06b1e69701a1db01f
* YQL-19520: msan + codegen = <3atarasov52025-03-248-20/+258
| | | | commit_hash:9a814af3b8bd51c53939aa6ffde2e981ad8ea150
* YQL mkql blocks transport, added triming by MinFillPercentagegrigoriypisar2025-03-195-49/+170
| | | | | Added block trimming in transport commit_hash:9794613300322045a81a9b40d4ebe519d30937a4
* Remove unused macro - used for YDB compatibilityilezhankin2025-03-191-2/+0
| | | | commit_hash:ec5e09d191b714b8465756189e5d0898ba6ce92a
* YQL-19712 RuntimeLogLevel setting, mrjob loggervvvv2025-03-182-6/+16
| | | | | init commit_hash:6178c9e20a737d499b13f1b38fdfb621f2d8db2f
* YQL-19694 ABI logger interfacevvvv2025-03-144-6/+23
| | | | commit_hash:b673d403e9bfb2ac31eedd8d2231ac018a8f36dd
* Handle potential race in computation pattern cacheilezhankin2025-03-123-108/+69
| | | | commit_hash:57e4f4066d30b24b967f1c4cb57bfafbd7948d34
* YQL mkql blocks trimmer, added size for sub buffersgrigoriypisar2025-03-103-23/+122
| | | | | Added sub buffers size into block trimer commit_hash:c1c708e6807c8e5b2ef7210dd13fe54216faa110
* Intermediate changesrobot-piglet2025-03-053-38/+0
| | | | commit_hash:2ec2671384dd8e604d41bc5c52c2f7858e4afea6
* Implement and use a page arena for small Arrow allocationsilezhankin2025-03-031-1/+1
| | | | commit_hash:2bcb57a12fbb750db7b33872e2cfbec66bdf6405
* YQL-18276: Block singular type implementationatarasov52025-03-034-3/+100
| | | | commit_hash:1334e5c0fb5ff26fd40681059409f46cf49ec025
* Fix building ydbd on linux-aarch64thegeorg2025-02-281-3/+14
| | | | commit_hash:3bc8ebae176007863577966a476425b34ea54698
* YQL-19593 better error handling for Udfvvvv2025-02-211-0/+5
| | | | commit_hash:216229b0558e1004453dedddbec8b767b2dab9c6
* YQL-19618: Fix codegen in SafeUnRefUnboxedArrayimunkin2025-02-211-4/+3
| | | | commit_hash:b046f9169a163726d8afeab5f5b58bc8450d0e1b
* YQL-19535: Fix wrong scalar conversionatarasov52025-02-101-2/+8
| | | | commit_hash:997d731b3d106421ee68aa2e3e18f18b03ea7a66
* MR: aggregation in MEASURESvokayndzop2025-01-291-1/+6
| | | | commit_hash:5357736eed7a221ff5844d4351abe23e65930632
* Use type dispatching traits in Arrow array buildersziganshinmr2025-01-204-6/+14
| | | | commit_hash:ffdd14a35d07660b4bebf2a6471da83349a37d78
* fix loadinst typevvvv2025-01-151-3/+3
| | | | commit_hash:f304439abe934725ac66892a05e5a4656e4c12e3
* Drop broken windows LLVM supportvvvv2025-01-154-220/+61
| | | | commit_hash:fc1f44ff256c759953b54e2ccac3277dc66c1165
* minikql - llvm16 compatibility (opaque pointers and some other stuff)vvvv2025-01-146-92/+151
| | | | commit_hash:c166e0d029d87d2a10e5adfc3acf20a849670881