summaryrefslogtreecommitdiffstats
path: root/yt/cpp/mapreduce
Commit message (Collapse)AuthorAgeFilesLines
* YT-27970: add opt-in native client side multiplexingachains7 days2-4/+15
| | | | commit_hash:87de51fe271596eaf0354bc99ef472e3a3c29d0f
* YT-28161: Add Commit optionsachains8 days6-11/+13
| | | | commit_hash:254111f674ff4126bd7781741ad035f436bfa073
* YT-28451: Add tagged logging API and opaque event payloadbabenko9 days1-2/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Replace `TLogEvent::MessageRef` with an opaque `Payload` that carries the message together with structured key/value tags, deferring tag rendering to the consumer (logging thread). - Add the `TTaggedPayloadWriter`/`TTaggedPayloadReader` codec (`NDetail`), with a per-thread chunk-cached builder so tagged logging does no per-message heap allocation. - Model the payload as a typed `TLogEventPayload` — a `std::variant` of the opaque strong typedefs `TTaggedLogEventPayload` and `TStructuredLogEventPayload` (each over `TSharedRef`). The active alternative identifies the event kind, so the separate `ELogMessageKind` enum and `TLogEvent::MessageKind` field are removed; consumers dispatch via `std::holds_alternative`/`std::get` instead of a tag. - Add the fluent `YT_TLOG_*` API: `YT_TLOG_INFO("Message").With(key, value)` and `.With(key, value, "%spec")`; disabled levels skip argument evaluation. - Add well-known tags: `.With(value)` attaches a value under a statically known key resolved by ADL (e.g. `.With(error)` for the `Error` tag). - Teach the plain-text and structured formatters to render tags; add the `enable_native_tags` knob to emit tags into a nested structured attribute. - Add producer-side benchmarks. The tagged API is cheaper than `YT_LOG_*` for tagged calls and on par for tag-free ones: #| || **Producer call** | **`YT_LOG_*`** | **`YT_TLOG_*`** | **Δ** || || no tags | 81 ns | 82 ns | +2% || || 1 tag | 124 ns | 88 ns | -29% || || 2 tags | 140 ns | 101 ns | -28% || || 3 tags | 372 ns | 283 ns | -24% || |# -- #| || **<a href="https://nda.ya.ru/t/p0sVNSOC7ijzFF" target="_blank">![](https://nda.ya.ru/t/mAiQIjHx7Mm3JC =30x) Echo tests</a>** || |# commit_hash:70efc90e5c2b71e5311415a4e4508db42ff28971
* Revert "YT-27827: TPingerTransaction use BlockingGet instead of WaitFor in ↵ermolovd2026-07-039-130/+80
| | | | | | | | destructor" This reverts commit 90bbe36635e0d48c81c153567dcedf28f103efbe, reversing changes made to 270d7be117d1eacc9c8aff93d9aaeb510fa910e2. commit_hash:23c13dd27b089f56e049580d1416d17a22c4bc80
* retry MasterDisconnected errorermolovd2026-07-012-0/+2
| | | | commit_hash:c69288b219a7b906cc9427b23ddc599f149fb77c
* YT-28516: Don't initialize storage for streamspavook2026-06-221-1/+1
| | | | commit_hash:f8f1ac8f679dae4ba11c4c52582798b12b550552
* YT-28380: Add CheckClusterLiveness to C++ SDKdagorokhov2026-06-1517-0/+110
| | | | | | | | | * Changelog entry Type: feature Component: cpp-sdk Add CheckClusterLiveness handle commit_hash:9b3f23b70fb639693a67edbe9ed2b80683fea61b
* YT-22593: Migrate TOperationIdOrAlias alias to std::stringbabenko2026-06-141-1/+1
| | | | | | | Change the alias alternative of the operation id-or-alias variant to std::string and propagate through the visitor lambdas, ResolveOperationAlias, the driver OperationAlias field and the clickhouse handler. commit_hash:6aab0b10eeb1367a1ec4c4d829855c7dd3cf4347
* YT-22593: Migrate TString to std::string in yt/yt/client/api option fieldsbabenko2026-06-142-6/+6
| | | | | | | | Migrate the string option/struct fields in the api headers to std::string and propagate the change through the native client attribute helpers, list_operations, operation cache and the api-bound driver accessors. A cold to_lower boundary keeps a TString cast. commit_hash:2541bfe57f03e50212c1b8f9abb394d403a9dafb
* YT-28419: Drop redundant guard #undef from -inl.h filesbabenko2026-06-142-2/+0
| | | | | | The `.h` owns the #undef of its `<NAME>_INL_H_` guard; duplicating it in the `-inl.h` is redundant. Align the minority that did so with the majority. commit_hash:51be59f9d1b93ad152ed5cb07c76088edd6c3e36
* YT-22593: No more TString in yt/yt/loggingbabenko2026-06-131-2/+2
| | | | commit_hash:84184765a016035a2569741c83f1920d893ce503
* YT-28161: Prerequisite options for cypress and transactions requestmaybenotilya2026-06-0910-59/+164
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Add prerequisite options for cypress and transactions requests. commit_hash:4288a35e2237cfaa015ff3990e2be909d18cd6b0
* YT-28163: followup fixachains2026-06-061-1/+6
| | | | commit_hash:040e99384dca2ee377657c6bfd7120c56614d5e1
* YT-27835: Add tracing for readers and writersmaybenotilya2026-06-0111-17/+135
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Trace readers and writers with same trace_id commit_hash:89a881e5bf608ca03821f248ef784f5f4771f532
* add LockType option to TInsertRowsOptions in yt/cpp/mapreducealkaline2026-05-302-0/+28
| | | | | | | | | | | | | | | | | YT-драйвер уже принимает параметр lock_type для insert_rows (<https://nda.ya.ru/t/y1DKR88L7dogTW>), но C\+\+ mapreduce-клиент не пробрасывает его дальше, поэтому вызывающий код всегда использует ELockType::Exclusive. В груте есть задача инициализации табличных (внешних) счётчиков: тасклет считает map-reduce-ом дельты по всем владельцам и батчами пишет их в общую динтаблицу (<https://nda.ya.ru/t/4G2o2Jdo7dogTX> и аналоги), куда рантайм одновременно дописывает инкременты на каждое событие в источнике. Колонка `value` в такой таблице — aggregate-sum; рантайм через NApi пишет в неё с lock_type=shared_write, чтобы параллельные записи не конфликтовали. Тасклет инциализации счетчика же ходит через mapreduce-клиент и в нем тоже хочется уметь брать shared_write lock. (<https://nda.ya.ru/t/WrJ9_kf77dogTb>). commit_hash:7cbcd19f8d0532d6cf0e7f48abe197bb7fda99d3
* YT-28163: fix tx pinger tsan raceachains2026-05-291-7/+6
| | | | commit_hash:c55147c95565f8451f2a0ccfcc72e6818bb35959
* YT-27970: Multiplexing for RPC requestsmaybenotilya2026-05-202-0/+8
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Mark light and heavy RPC requests with different multiplexing bands. Only for PingTransaction for now commit_hash:9177c1e3811a5108933a87dd3f241d235490ce2d
* YT-28161: Add Prerequisite options to C++ SDKmaybenotilya2026-05-153-0/+87
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Add Prerequisite options similar to native client ones. Only for Cypress Get for now commit_hash:6c3c0fe7e6540754033486f785f3b1b3c313808e
* Added exec_attributes & cookie to TJobAttributesvvvv2026-05-042-0/+14
| | | | commit_hash:2d046575e0ff49456bd9d4133e7e6df4f09dfc0d
* Intermediate changesrobot-piglet2026-04-291-2/+10
| | | | commit_hash:b31aa3f19215eafb0fc58edc6708d9238e0fe295
* YT-27835: Add client tracing option serializationmaybenotilya2026-04-281-0/+2
| | | | commit_hash:a6b82620aa36e6007d645613916485de78eff6da
* YT-27827: TPingerTransaction use BlockingGet instead of WaitFor in destructorermolovd2026-04-2810-88/+139
| | | | commit_hash:90bbe36635e0d48c81c153567dcedf28f103efbe
* YT-26179: lazy read requestachains2026-04-242-3/+38
| | | | commit_hash:a3758715df7ff97a0a471492dd907f949744e4d7
* YT-27835: Client tracingmaybenotilya2026-04-249-0/+238
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Create trace\_id on client side commit_hash:270019c138bed296ed934649a0b157f514fca0cb
* YT-27848: add FetchCookieNodeDescriptors flag in C++ SDKachains2026-04-233-0/+8
| | | | commit_hash:2b3c252afc470f808af644051444907eddc53c04
* throw TErrorResponse instead of TTransportErrorermolovd2026-04-234-27/+16
| | | | commit_hash:c4f32aac4b251cfb981bc2549522fa92881ae370
* - retry "cluster read-only mode is active" yt errorsvoevodskiy2026-04-211-6/+14
| | | | commit_hash:3a945a41d4fea6c28be0beed7e87ccd816d65218
* Revert "YT-27972: mapreduce over rpc_proxy client, write data in small chunks"ermolovd2026-04-201-26/+4
| | | | | | This reverts commit 0f1a13799f52c8f40eba1dfd4151f26230fa038d, reversing changes made to abdd5e068aae03e749b503803a5e76e0f59ab88a. commit_hash:56f46e8526f7525e83147900ef65065541248d92
* Add noexcept to move constuctors and assignments in yt/cpp/mapreduceosidorkin2026-04-195-9/+9
| | | | commit_hash:986e542ff1ba68798aae6017ee09bd0cc4d55200
* YT-26179: Add Abort for readersmaybenotilya2026-04-1746-84/+674
| | | | | | | | | * Changelog entry Type: feature Component: cpp-sdk Add Abort for table readers commit_hash:be5026883c90d18333f20468946f1e5a5b71839b
* temporary workaround for cannot findermolovd2026-04-161-0/+6
| | | | commit_hash:52d8ab2fc6d5aee52a3470c91fc4fff607e2768e
* YT-27972: mapreduce over rpc_proxy client, write data in small chunksermolovd2026-04-131-4/+26
| | | | | to avoid generating large attachments commit_hash:0f1a13799f52c8f40eba1dfd4151f26230fa038d
* YT-27970: two connections for rpc proxyermolovd2026-04-134-77/+97
| | | | commit_hash:1618b38398bb1e77dc7300b85a47c8a84979e91f
* [trivial] virtual -> override for destructortobo2026-04-081-1/+1
| | | | commit_hash:4d6894b64b7cc24e27cdfd53182cdbff2c6b0e3f
* Intermediate changesrobot-piglet2026-04-061-1/+1
| | | | commit_hash:c148ad6a0b118c22f7657f45ff68f0664429aaa0
* Support passing jobstate via env variable in operation specaneporada2026-04-036-9/+71
| | | | commit_hash:dc21655a5449d9e1d58b46e933baa3eae2c6e04a
* YT-18571: Use modern [[likely]] and [[unlikely]] attributes instead of ↵babenko2026-03-302-2/+2
| | | | | | Y_LIKELY and Y_UNLIKELY commit_hash:173b92b35ceecd79eb9e76015470804c9e54f268
* YT-27710: Add RPC to TransactionPingermaybenotilya2026-03-305-118/+116
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Allow TransactionPinger to ping via RPC if is being used in RPC Client. commit_hash:9b38ce40b5667f107d6f23e40bf07dcf80ac11c7
* make FileCacheReplicationFactor dynamic in cpp sdko-gulyaev2026-03-245-7/+15
| | | | | | | | | | | Мы делаем минимальную версию кластера с replication factor 1, чтобы внешние юзеры могли развернуть кластер для тестирования функциональности на минимуме ресурсов на одной машике с одной датанодой. Необходимость этих фиксов всплыла, когда я заметил, что YQL запрос при подготовке операции грузит в Кипарис различные файлы – .so-шки с библиотеками, mrjob и прочее. Все это грузилось с дефолтными константами rf, сделал так, чтобы их можно было переопределить. * Changelog entry Type: feature Component: cpp-sdk make option `file_cache_replication_factor` dynamic commit_hash:900ea0d6483926e7a444c5b593cf661544744590
* fetch dynamic config through cache, don't scare the users with expected errorsermolovd2026-03-123-12/+32
| | | | commit_hash:03d0aeb6901ca96aae2f8570482204f0ca707c88
* YT-26837: expect finished transaction error during pingachains2026-02-271-3/+11
| | | | commit_hash:734149847d3afaf0d980696fbfc2b15a64015d5b
* fix write file options rpc serializatoro-gulyaev2026-02-261-1/+1
| | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Fix WriteFile options rpc serializator commit_hash:72571cc4756ce667348933d5d4e62e4ce9046f1f
* Renaming .Get() -> .BlockingGet() for futures with regexp in ytpechatnov2026-02-262-9/+9
| | | | | | Замена с помощью регулярок вида https://nda.ya.ru/t/OEChuUHd7VNnpo commit_hash:9e41613fde698b4df7eda66bff52116c2ba232ba
* YT-26837: do not log at Error level if error is expectedachains2026-02-235-4/+96
| | | | | | | | | | | * Changelog entry Type: fix Component: cpp-sdk Introduce TExpectedErrorGuard that prevents logging expected error at Error level in the scope. <Message for release notes> commit_hash:e11ec54f57024002d18c26edd3fdfc9a9bf1e3a7
* YT-27432: support create with IgnoreTypeMismatch in C++ SDKachains2026-02-183-0/+8
| | | | | | | | | | * Changelog entry Type: cpp-sdk <Message for release notes> Support TCreateOptions::IgnoreTypeMismatch in C\+\+ SDK commit_hash:5d45311d21562502b1df035fa6edbacb720a34a0
* YT-21148 Serialize deleted columns according to new designs-berdnikov2026-02-185-10/+80
| | | | | | | | | | | * Changelog entry Type: fix Component: master Deleted columns are now stored in table schema attributes instead of being represented as regular columns with `deleted` field. commit_hash:bbcf72019585ce99df10ce93efe3995111f50f58
* YT-21148 Cosmetics: Get rid of unnecessary `NYT::` prefixs-berdnikov2026-02-161-17/+13
| | | | commit_hash:2e5e3acfca62d960733f102bd0dd56fc5a464e0e
* YT-26760: operation_link_pattern is taken from dynamic configurationermolovd2026-02-099-9/+117
| | | | | | | | | * Changelog entry Type: feature Component: cpp-sdk C++ SDK supports operation_link_pattern dynamic configuration commit_hash:a937500f7ce866436ee8732c923fb4b362e199a1
* operation_preparer uses IClient methods instead of IRawClient to enable retriesermolovd2026-02-021-12/+8
| | | | commit_hash:067376925c20e9ab7e1bf25d91ebb5e17b692c51
* Wrap system error on first http chunkngc2242026-01-305-13/+235
| | | | commit_hash:c6605e1048c62c06a7e7ab4dd26acabfd1538f30
generated by cgit v1.3 (git 2.53.0) at 2026-07-26 12:44:15 +0000