summaryrefslogtreecommitdiffstats
path: root/yt/cpp
Commit message (Collapse)AuthorAgeFilesLines
...
* YT-22157 Interface part of HLL in columnar statisticsorlovorlov2024-07-312-0/+4
| | | | | Выделил в отдельный PR, чтобы над кодом в YT и в YQL можно было работать независимо. 4fb122ecc4a54b38b09d854d93ae23fd3f76677e
* [yt/cpp/mapreduce]Fix build with system protoc, std::string and system stlnadya732024-07-303-3/+2
| | | | | Fix build with system protoc, std::string and system stl 8b5b81b2d7855f6b0dcb4bb0583a6408e5b7d3f7
* [YT C++ API] Add NT_CHAOS_TABLE_REPLICA to ENodeTypeandreizdor2024-07-181-0/+1
| | | | ed1b1d78b17f3dd0512331892ee1c56247fb792f
* YT-22268: Support YT_LOG_PATH in c++ apiwhatsername2024-07-153-1/+5
| | | | | Проверил руками на тестах yt roren eb7589ac6894bffb1ebcd1d092f4eed6ca4cd975
* Intermediate changesrobot-piglet2024-07-092-12/+12
|
* Revert "YT-21253 Include HyperLogLog in YT table columnar statistics"orlovorlov2024-07-032-4/+0
| | | | | | This reverts commit b5399faf1a9757b07a2d2ee25bd16b8a27be7939, reversing changes made to d7e3e35dd1a856c587d7a9eb2e0dd180d3cf39ed. 82c6dea5d3958fc85ee39e7bcc23c6ec24d6aee9
* [yt/cpp/mapreduce] YT-21595: Use gtest instead of ytest in all mapreduce testsnadya732024-07-0248-2100/+3416
| | | | 85671f0cf4f45b4f015fa2cc0d195b81c16c6e8a
* YT-21253 Include HyperLogLog in YT table columnar statisticsorlovorlov2024-07-022-0/+4
| | | | | | тестирование HLL на случайно сгенерированных данных: p=10 показывает худшую погрешность в 9.9% (равномерное распределение на отрезке [0, 10^6), 10 HLL-групп, 1М значений, 631К уникальных b5399faf1a9757b07a2d2ee25bd16b8a27be7939
* YT-22026: Fix GetTableColumnarStatisticswhatsername2024-06-201-1/+1
| | | | ffe12e02d72e467f8713fec022f9c523bb135b77
* YT-21308: Minor codestyle tweakapachee2024-06-171-3/+3
| | | | | Fix indent a6a3500f712f343a6127243f63bb9d798e358fb3
* Intermediate changesrobot-piglet2024-06-161-1/+1
|
* [yt/cpp/mapreduce] Update misleading commenteak1mov2024-06-051-1/+2
| | | | | | Похоже в rXXXXXX по ошибке перенесли комментарий из `Abort()` в `Finish()`: https://a.yandex-team.ru/arcadia/commit/rXXXXXX#file-mapreduce/yt/interface/io.h:L208 c182c2732c309d8c5371e3ef8071ecd07aa54928
* YT-21868: Static analysis of format string in loggingarkady-e1ppa2024-05-302-2/+7
| | | | | | | | | | | | | Added static analysis to format of YT_LOG_XXX macro's. We expect you to write format string as first or the second argument and follow the rules as if you are writing arguments for `NYT::Format`, which match those of printf: https://en.cppreference.com/w/cpp/io/c/fprintf plus few extra flags like 'v'. At the moment analyser checks if flags sequences is 1. Correctly terminated 2. Only contains specifiers valid for a given argument (if we are parsing nth argument of type T, then T must have all specifiers from its list of Conversion or Flag specifiers. (2) Also means that the number of flag sequences must match the number of arguments supplied to format. You can specialize `TFormatArg<T>` which is used to determine allowed Conversion and Flag specifiers to customise rules of static analysis. E.g. you can introduce new flags to the mix which you promise to parse in the related FormatValue function. If you feel like this produces to much overhead in terms of compile time, you are free to use macro YT_DISABLE_FORMAT_STATIC_ANALYSIS to turn the entire thing into a no-op. We have measured compile time to be affected by roughly 3-5% in a log intensive files. ae6def509474e8a42027bb4ed84ac040509b7c85
* YT-21308: Add redirect_stdout_to_stderr flag for C++ clientapachee2024-05-249-4/+53
| | | | | Adds redirect_stdout_to_stderr spec option for operations that allows writing to stdout as if it was stderr. 6a8ac5f21955a79848d86f72715628c7b8bb65c4
* Fix typo: comitted, commited -> committedEgor Chunaev2024-05-031-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | I left only these typos: ```cpp # Build. build/scripts/link_sbom.py 61: res["properties"].append({'name': 'has_uncommited_changes', 'value': True}) # Contrib. contrib/clickhouse/src/Coordination/KeeperLogStore.h 19: /// Read log storage from filesystem starting from last_commited_log_index 20: void init(uint64_t last_commited_log_index, uint64_t logs_to_keep); contrib/clickhouse/src/Coordination/KeeperStateManager.h 36: void loadLogStore(uint64_t last_commited_index, uint64_t logs_to_keep); contrib/clickhouse/src/Coordination/Changelog.h 100: void readChangelogAndInitWriter(uint64_t last_commited_log_index, uint64_t logs_to_keep); contrib/clickhouse/src/Databases/DatabaseReplicatedSettings.h 13: M(UInt64, wait_entry_commited_timeout_sec, 3600, "Replicas will try to cancel query if timeout exceed, but initiator host has not executed it yet", 0) \ contrib/clickhouse/src/Databases/DatabaseReplicatedWorker.cpp 337: size_t max_iterations = database->db_settings.wait_entry_commited_timeout_sec; contrib/python/pytest-benchmark/pytest_benchmark/utils.py 77: parts.append("uncommited-changes") contrib/libs/poco/Data/include/Poco/Data/Transaction.h 57: /// commited automatically. If no error occurs, rollback is disabled and does 85: /// Rolls back the current database transaction if it has not been commited contrib/clickhouse/src/Storages/StorageMergeTree.cpp 2061: /// and we should be able to rollback already added (Precomitted) parts # Kinda contrib. yt/spark/spark/sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala 1048: // Reload the store from the commited version and repeat the above test. # Metrics tag :( yt/yt/server/master/security_server/security_manager.cpp 595: TWithTagGuard guard(&buffer, "status", "commited"); 599: TWithTagGuard guard(&buffer, "status", "uncommited"); ``` The only backwards incompatible place is: https://github.com/ytsaurus/ytsaurus/blob/091bcf82fe4fc8d9a967eb36beddf5767e92e659/yt/python/yt/wrapper/dynamic_table_commands.py#L26-L27 --- 9f6a944af13ef3fbf3f25c15b2c2d3982ed7e39b Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/566 Co-authored-by: ignat <[email protected]>
* [yt/cpp/mapreduce] YT-21465: Pass table index via SkiffRowHintsnadya732024-04-251-1/+8
| | | | | Pass table index via SkiffRowHints 73ade54789f2bab159368dfcc876b0a6121b4e7a
* [yt/cpp/mapreduce] YT-21405: Don't ignore backoff and pass actual exception ↵nadya732024-04-1816-44/+77
| | | | | | | in Retry() Don't ignore backoff and pass actual exception in Retry() b821c02fd21c9f8115cd2a4896372a9fda69e5f6
* Fix more problems with RetryfulWriterV2ermolovd2024-04-175-20/+43
| | | | 404e999bcffb20d5497161a98f48f566b5245704
* BufferMemory usage for retryful writer v2ermolovd2024-04-132-0/+7
| | | | ca66c0e73475f3596f6fb2e4e655f2ec378a71a9
* Fix crash in retryful writer v2ermolovd2024-04-121-2/+2
| | | | d95cdb95b36efff7cbf942996a10ee4ff755bbfc
* YT-18503: Mirror Cypress Tx to Sequoia Groundkvk19202024-04-072-1/+15
| | | | e6d585180289325f8082f42f85a60478194ba266
* Fix preedirs yt/cpp/mapreduce/library/table_schemanadya022024-04-045-122/+0
| | | | | fix preedirs 6bb186d9bd0ececb764c3e8596d8360098ad5124
* YT: Apply aliasing rules in CreateClientImplpechatnov2024-04-041-3/+1
| | | | | Поддерживаю алиасинг урлов для функции NYT::CreateClient c111a561639e4c8fdd73d9df66f41ec29e4dbe5e
* Cosmetic import_tablenadya022024-04-023-0/+106
| | | | | mv 6604fca1567d9e8ecae8905f5eaed912cb7c475d
* Use async tx pinger by default once againermolovd2024-04-011-1/+1
| | | | 5c990fdee5899ef1cfcc5429f3631998277cd218
* Fix commentermolovd2024-03-241-0/+1
| | | | d547e94dc63865b96a5cdfbe9866d87b11a57193
* YT-18458: Introduce wide types into mapreduce interfacewhatsername2024-03-215-0/+57
| | | | 7ae047ef618cc44d7dd3e817dc27f2336d9e38c3
* Support building yt/cpp and yt/yt/core with vanilla protobufGrigory Reznikov2024-03-198-39/+62
| | | | | | | | | | | | | | After this PR yt/cpp and yt/yt/core are possible to be built both with Arcadia protobuf (that uses TString as a string) and vanilla protobuf (that uses std::string as a string). To achieve so, a couple of interoperability primitives are introduced. * `TProtobufString` is an alias to protobuf string type, i.e. it can be `TString` or `std::string` depending on the protobuf implementation. * `IsVanillaProtobuf` and `IsArcadiaProtobuf` are the constexpr boolean values that allow to check protobuf implementation both in the compile time and runtime. The most challenging interoperability issue solved here is a string copy between protobuf message and C++ code that has a form of `TString str = msg.str()`. This code works perfect with Arcadia protobuf but does not work with vanilla protobuf. To solve it, a previously introduced primitive `FromProto<TString>` is used. This expression makes the most efficient cast possible between protobuf string and C++ string. Internally, it is just a copy in both cases. Since TString is CoW by default, this expression is almost zero-cost (actually it's just one atomic operation), so no degradation is expected for YTsaurus server builds. The most hot code is handled differently to avoid even atomic operations (see `GetRequestTargetYPath`). In case of vanilla protobuf string is copied, however there are no places in C++ SDK where it might be a problem. If such issues would appear, performance-critial code can be rewritten in `GetRequestTargetYPath`-style. --- 1a6f3e02cb6e83915102c24b73bc8734f6a48e74 Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/466
* YT-21141 Avoid content deduplication for files under 10MBorlovorlov2024-03-184-5/+12
| | | | febae4e49cd0f600bf21616025f210e99235cfdc
* Intermediate changesrobot-piglet2024-03-132-0/+7
|
* add job_profile.cppuzhas2024-03-101-0/+141
| | | | 8571dcd93f2c4adc97e84f5a92373149b0d6e0f9
* Intermediate changesrobot-piglet2024-03-101-5/+5
|
* Intermediate changesrobot-piglet2024-02-271-1/+33
|
* Intermediate changesrobot-piglet2024-02-151-1/+1
|
* Intermediate changesrobot-piglet2024-02-123-22/+10
|
* Intermediate changesrobot-piglet2024-02-071-4/+3
|
* Intermediate changesrobot-piglet2024-01-303-12/+0
|
* Intermediate changesrobot-piglet2024-01-251-0/+13
|
* YDB Import 552robot-ydb-importer2024-01-251-11/+4
|
* erm: Add new version for `@yatool/prebuilder`: `0.5.1` and set `0.5.1` as ↵robot-erm2024-01-259-8/+36
| | | | | | default Executed command: `./erm --verbose --profile update @yatool/prebuilder`
* feat contrib: aiogram 3armenqa2024-01-1963-2415/+0
| | | | Relates: https://st.yandex-team.ru/, https://st.yandex-team.ru/
* Library import 7 (#937)AlexSm2024-01-1112-105/+105
|
* Library import 5, delete go dependencies (#832)AlexSm2024-01-041-2/+2
| | | | | * Library import 5, delete go dependencies * Fix yt client
* Library import 2 (#639)AlexSm2023-12-221-5/+1
|
* External build system generator release 65robot-ya-builder2023-12-0510-30/+30
| | | | Update tools: yexport, os-yexport
* Increase timeout to decrease test flapsermolovd2023-12-051-2/+3
|
* ROREN-48: Use single table writer in TWriteProtoParDowhatsername2023-12-012-1/+41
|
* [yt/cpp/mapreduce] YT-20588: Add more logs for readers and fix client_reader ↵nadya732023-11-282-3/+7
| | | | retries
* YT-19269: table writer implementation that doesn't wait for complete buffer ↵ermolovd2023-11-2815-13/+657
| | | | before sending to network
* ROREN-48: Support multi table proto readwhatsername2023-11-282-7/+15
|