summaryrefslogtreecommitdiffstats
path: root/yt/cpp/mapreduce
Commit message (Collapse)AuthorAgeFilesLines
* YT-23442: set nirvana context in operation specermolovd2024-11-291-10/+28
| | | | commit_hash:0c8ecc6b08a1735f8aa861055d52c1ba152aa710
* YT-23645: mapreduce client can use yt/core log managerermolovd2024-11-286-20/+57
| | | | commit_hash:7007a3c7f56a6f271073811160f00f03162aaaa6
* YT-23568: Skip checking table existence if table is located on different clusterv-a-zolotov2024-11-281-0/+1
| | | | commit_hash:b5a8081be739437ebced2083440e22295ce64255
* YT-23568: `create` attribute in RichYPathermolovd2024-11-263-6/+21
| | | | | | | | | | * Changelog entry Type: feature Component: cpp-sdk Add support for `create` attribute in RichYPath. Don't create paths explicitly if `create` attribute is specified. commit_hash:52e77ce4cf5e21fae6d6e510ffb0edba35ec2a1d
* Open log file in append mode by defaultermolovd2024-11-251-1/+1
| | | | commit_hash:477d8692ac2c591d770fdf64664aa0be17d7d7b9
* fix buffered stream interleaving for proto formatermolovd2024-11-232-0/+21
| | | | commit_hash:66e6b75f97ea253ddbf4c97a180f9f971c59f93b
* YT-23422: do not write command line into attributes of operationsermolovd2024-11-235-44/+16
| | | | | | | | | * Changelog entry Type: feature Component: cpp-sdk C++ SDK doesn't write launching process command line to operation attributes. commit_hash:c50cbc2a31f5a3b733833767fe94019a0d7615d3
* YT-22455: Introduce list jobs continuation tokenomgronny2024-11-222-0/+21
| | | | | [nodiff:caesar] commit_hash:d45b3da99e7b19120e02298ca6e87c02cc800ea2
* Added cluster field to TRichYPathv-a-zolotov2024-11-212-0/+7
| | | | | | | | | Add cluster field to TRichYPath ### Changelog entry Type: feature Component: cpp-sdk commit_hash:eff6ccc4add04d64520c427c194424913ea2dfc4
* YT-22943: add context for system errorsermolovd2024-11-1912-144/+223
| | | | | | | * thrown system errors contain context (i.e. host method and request id that produced error) Type: feature Component: cpp-sdk commit_hash:af72a3a37785e9e373e816c2cc072df2076f821d
* cpp/mapreduce: fix styleermolovd2024-11-184-106/+108
| | | | commit_hash:4b9b636737f162b91295356e0ac17f0ea2beab20
* Intermediate changesrobot-piglet2024-11-161-3/+9
| | | | commit_hash:f2a9fd23d41396b6584b6d133ba2c57fa370863a
* add nirvana block url to started by blockermolovd2024-11-091-53/+94
| | | | commit_hash:0468f946ddc0d3a27c085e6e5ec4ce8121c4024d
* YT-23262: initialize client with JoblessInitialize if user didn'termolovd2024-11-083-7/+25
| | | | commit_hash:439622e771e7b7010609aa9974e9b82dcb0163ca
* YT-23387: Sort jobs by task nameomgronny2024-11-071-0/+1
| | | | commit_hash:eada58f1baf8c66541a6f4874a10034bd1a0632a
* YT-23262: send all logs to fileermolovd2024-11-021-1/+27
| | | | commit_hash:af0cfccef62a612208772fef9f0778b48ab16fda
* YT-23333: Add missing return statements in ↵k-gusev2024-10-311-0/+3
| | | | | | `yt/cpp/mapreduce/interface/operation-inl.h` commit_hash:4a4f867c892399e0ea27533653d089e1a98d01b0
* Fix regression: static anchors are not updated properlybabenko2024-10-301-4/+0
| | | | commit_hash:ab0bd9b2d0569820e495c714baecb05145ed35bf
* Use lowercase Data, Empty and Size in some code-generationsmikhnenko2024-10-281-6/+6
| | | | | [nodiff:caesar] commit_hash:13085d3e582f02071258318908bea6ef9c424fcb
* remove unused include util/generic/variant.htobo2024-10-241-1/+2
| | | | | **remove unused include** commit_hash:08519c51af040a565e794e13f44e5dd0e8eda713
* Introduce message_level_overrides to tune log message levels at runtimebabenko2024-10-201-2/+0
| | | | | | | | * Changelog entry Type: feature Add message_level_overrides option to logging config for better run-time tuning. commit_hash:07e9563fd111c437edf7ac0e5dd190781878d8fa
* YT-21938: Introduce get_job_traceomgronny2024-10-119-0/+159
| | | | | | | | | * Changelog entry\ Type: feature\ Component: proxy Add the handler that gets the job’s trace events. commit_hash:c9d1a6d57e886a266967d57065bd3948882808c7
* Use lower case for TString methods Data, Size and Empty in ysite, yt, ytech, ↵mikhnenko2024-10-094-5/+5
| | | | | | | | yweb Если вы считаете, что это pr сломал ваши тесты - смело откатываете.\ Если проблема нетривиальная - приходите в [саппорт](https://nda.ya.ru/t/a1JIzEbo78mtfQ) commit_hash:dee982cfbb70b978ace5417b4619e78212000179
* YT-22871: Disable option for switching to sync pingerermolovd2024-10-043-16/+10
| | | | | | | | | | * Changelog entry Type: feature Component: cpp-mapreduce-sdk Removed old style synchronous pinger commit_hash:111d1bdf6f21cc2eff949224eea06c219af70051
* Intermediate changesrobot-piglet2024-09-201-2/+0
| | | | commit_hash:918a0dcec668a251cd29324dc517406ad3be67ec
* Fix: reset RawTypeV3, when Type is set (and vice versa)ermolovd2024-09-193-6/+45
| | | | commit_hash:af63b4f5a0c2db692a0224330b79c5088c6982dc
* Support YT_KEEP_TEMP_TABLES environment variable in C++ SDKMaxim Akhmedov2024-09-022-0/+4
| | | | | | | | | No description --- c5f81efe57e11992b55a5cbbf3dfff08b790c28c Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/813
* Intermediate changesrobot-piglet2024-08-304-1/+13
|
* Better commentermolovd2024-08-271-0/+7
| | | | aa8b4c15efdb99c12a4ce5815d0d4f2d70620cb4
* GLOBAL OTBIVKA FIX ୧༼ಠ益ಠ༽୨pavook2024-08-2229-88/+88
| | | | | | | | | | Make all "otbivka" exactly 80 symbols. Command: ```bash sed -i 's#^//////////////\+$#////////////////////////////////////////////////////////////////////////////////#g' $(find yt \( -name '*.cpp' -or -name '*.h' -or -name '*.proto' \) -not -path 'yt/yt/experiments/private/tabletvis/imgui/*') ``` 30a0ba9f42ba1909d3cee11fe12bba14c7c8b039
* Fix transaction pinger tvm authiudovin2024-08-091-2/+5
| | | | 675586a233e3aba3e3f532d76dc228ad0f72ad93
* YT-22157 Interface part of HLL in columnar statisticsorlovorlov2024-07-312-0/+4
| | | | | Выделил в отдельный PR, чтобы над кодом в YT и в YQL можно было работать независимо. 4fb122ecc4a54b38b09d854d93ae23fd3f76677e
* [yt/cpp/mapreduce]Fix build with system protoc, std::string and system stlnadya732024-07-303-3/+2
| | | | | Fix build with system protoc, std::string and system stl 8b5b81b2d7855f6b0dcb4bb0583a6408e5b7d3f7
* [YT C++ API] Add NT_CHAOS_TABLE_REPLICA to ENodeTypeandreizdor2024-07-181-0/+1
| | | | ed1b1d78b17f3dd0512331892ee1c56247fb792f
* YT-22268: Support YT_LOG_PATH in c++ apiwhatsername2024-07-153-1/+5
| | | | | Проверил руками на тестах yt roren eb7589ac6894bffb1ebcd1d092f4eed6ca4cd975
* Intermediate changesrobot-piglet2024-07-092-12/+12
|
* Revert "YT-21253 Include HyperLogLog in YT table columnar statistics"orlovorlov2024-07-032-4/+0
| | | | | | This reverts commit b5399faf1a9757b07a2d2ee25bd16b8a27be7939, reversing changes made to d7e3e35dd1a856c587d7a9eb2e0dd180d3cf39ed. 82c6dea5d3958fc85ee39e7bcc23c6ec24d6aee9
* [yt/cpp/mapreduce] YT-21595: Use gtest instead of ytest in all mapreduce testsnadya732024-07-0248-2100/+3416
| | | | 85671f0cf4f45b4f015fa2cc0d195b81c16c6e8a
* YT-21253 Include HyperLogLog in YT table columnar statisticsorlovorlov2024-07-022-0/+4
| | | | | | тестирование HLL на случайно сгенерированных данных: p=10 показывает худшую погрешность в 9.9% (равномерное распределение на отрезке [0, 10^6), 10 HLL-групп, 1М значений, 631К уникальных b5399faf1a9757b07a2d2ee25bd16b8a27be7939
* YT-22026: Fix GetTableColumnarStatisticswhatsername2024-06-201-1/+1
| | | | ffe12e02d72e467f8713fec022f9c523bb135b77
* YT-21308: Minor codestyle tweakapachee2024-06-171-3/+3
| | | | | Fix indent a6a3500f712f343a6127243f63bb9d798e358fb3
* Intermediate changesrobot-piglet2024-06-161-1/+1
|
* [yt/cpp/mapreduce] Update misleading commenteak1mov2024-06-051-1/+2
| | | | | | Похоже в rXXXXXX по ошибке перенесли комментарий из `Abort()` в `Finish()`: https://a.yandex-team.ru/arcadia/commit/rXXXXXX#file-mapreduce/yt/interface/io.h:L208 c182c2732c309d8c5371e3ef8071ecd07aa54928
* YT-21868: Static analysis of format string in loggingarkady-e1ppa2024-05-302-2/+7
| | | | | | | | | | | | | Added static analysis to format of YT_LOG_XXX macro's. We expect you to write format string as first or the second argument and follow the rules as if you are writing arguments for `NYT::Format`, which match those of printf: https://en.cppreference.com/w/cpp/io/c/fprintf plus few extra flags like 'v'. At the moment analyser checks if flags sequences is 1. Correctly terminated 2. Only contains specifiers valid for a given argument (if we are parsing nth argument of type T, then T must have all specifiers from its list of Conversion or Flag specifiers. (2) Also means that the number of flag sequences must match the number of arguments supplied to format. You can specialize `TFormatArg<T>` which is used to determine allowed Conversion and Flag specifiers to customise rules of static analysis. E.g. you can introduce new flags to the mix which you promise to parse in the related FormatValue function. If you feel like this produces to much overhead in terms of compile time, you are free to use macro YT_DISABLE_FORMAT_STATIC_ANALYSIS to turn the entire thing into a no-op. We have measured compile time to be affected by roughly 3-5% in a log intensive files. ae6def509474e8a42027bb4ed84ac040509b7c85
* YT-21308: Add redirect_stdout_to_stderr flag for C++ clientapachee2024-05-249-4/+53
| | | | | Adds redirect_stdout_to_stderr spec option for operations that allows writing to stdout as if it was stderr. 6a8ac5f21955a79848d86f72715628c7b8bb65c4
* Fix typo: comitted, commited -> committedEgor Chunaev2024-05-031-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | I left only these typos: ```cpp # Build. build/scripts/link_sbom.py 61: res["properties"].append({'name': 'has_uncommited_changes', 'value': True}) # Contrib. contrib/clickhouse/src/Coordination/KeeperLogStore.h 19: /// Read log storage from filesystem starting from last_commited_log_index 20: void init(uint64_t last_commited_log_index, uint64_t logs_to_keep); contrib/clickhouse/src/Coordination/KeeperStateManager.h 36: void loadLogStore(uint64_t last_commited_index, uint64_t logs_to_keep); contrib/clickhouse/src/Coordination/Changelog.h 100: void readChangelogAndInitWriter(uint64_t last_commited_log_index, uint64_t logs_to_keep); contrib/clickhouse/src/Databases/DatabaseReplicatedSettings.h 13: M(UInt64, wait_entry_commited_timeout_sec, 3600, "Replicas will try to cancel query if timeout exceed, but initiator host has not executed it yet", 0) \ contrib/clickhouse/src/Databases/DatabaseReplicatedWorker.cpp 337: size_t max_iterations = database->db_settings.wait_entry_commited_timeout_sec; contrib/python/pytest-benchmark/pytest_benchmark/utils.py 77: parts.append("uncommited-changes") contrib/libs/poco/Data/include/Poco/Data/Transaction.h 57: /// commited automatically. If no error occurs, rollback is disabled and does 85: /// Rolls back the current database transaction if it has not been commited contrib/clickhouse/src/Storages/StorageMergeTree.cpp 2061: /// and we should be able to rollback already added (Precomitted) parts # Kinda contrib. yt/spark/spark/sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala 1048: // Reload the store from the commited version and repeat the above test. # Metrics tag :( yt/yt/server/master/security_server/security_manager.cpp 595: TWithTagGuard guard(&buffer, "status", "commited"); 599: TWithTagGuard guard(&buffer, "status", "uncommited"); ``` The only backwards incompatible place is: https://github.com/ytsaurus/ytsaurus/blob/091bcf82fe4fc8d9a967eb36beddf5767e92e659/yt/python/yt/wrapper/dynamic_table_commands.py#L26-L27 --- 9f6a944af13ef3fbf3f25c15b2c2d3982ed7e39b Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/566 Co-authored-by: ignat <[email protected]>
* [yt/cpp/mapreduce] YT-21465: Pass table index via SkiffRowHintsnadya732024-04-251-1/+8
| | | | | Pass table index via SkiffRowHints 73ade54789f2bab159368dfcc876b0a6121b4e7a
* [yt/cpp/mapreduce] YT-21405: Don't ignore backoff and pass actual exception ↵nadya732024-04-1816-44/+77
| | | | | | | in Retry() Don't ignore backoff and pass actual exception in Retry() b821c02fd21c9f8115cd2a4896372a9fda69e5f6
* Fix more problems with RetryfulWriterV2ermolovd2024-04-175-20/+43
| | | | 404e999bcffb20d5497161a98f48f566b5245704
* BufferMemory usage for retryful writer v2ermolovd2024-04-132-0/+7
| | | | ca66c0e73475f3596f6fb2e4e655f2ec378a71a9