summaryrefslogtreecommitdiffstats
path: root/yt/cpp/mapreduce/client
Commit message (Collapse)AuthorAgeFilesLines
* Don't ignore backoff and pass actual exception in Retry() (#3664)Savchenko Nadezhda2024-04-182-6/+23
|
* Fix more problems with RetryfulWriterV2ermolovd2024-04-174-13/+43
| | | | 404e999bcffb20d5497161a98f48f566b5245704
* BufferMemory usage for retryful writer v2ermolovd2024-04-132-0/+7
| | | | ca66c0e73475f3596f6fb2e4e655f2ec378a71a9
* Fix crash in retryful writer v2ermolovd2024-04-121-2/+2
| | | | d95cdb95b36efff7cbf942996a10ee4ff755bbfc
* Fix preedirs yt/cpp/mapreduce/library/table_schemanadya022024-04-041-1/+0
| | | | | fix preedirs 6bb186d9bd0ececb764c3e8596d8360098ad5124
* YT: Apply aliasing rules in CreateClientImplpechatnov2024-04-041-3/+1
| | | | | Поддерживаю алиасинг урлов для функции NYT::CreateClient c111a561639e4c8fdd73d9df66f41ec29e4dbe5e
* YT-18458: Introduce wide types into mapreduce interfacewhatsername2024-03-211-0/+6
| | | | 7ae047ef618cc44d7dd3e817dc27f2336d9e38c3
* Support building yt/cpp and yt/yt/core with vanilla protobufGrigory Reznikov2024-03-191-8/+9
| | | | | | | | | | | | | | After this PR yt/cpp and yt/yt/core are possible to be built both with Arcadia protobuf (that uses TString as a string) and vanilla protobuf (that uses std::string as a string). To achieve so, a couple of interoperability primitives are introduced. * `TProtobufString` is an alias to protobuf string type, i.e. it can be `TString` or `std::string` depending on the protobuf implementation. * `IsVanillaProtobuf` and `IsArcadiaProtobuf` are the constexpr boolean values that allow to check protobuf implementation both in the compile time and runtime. The most challenging interoperability issue solved here is a string copy between protobuf message and C++ code that has a form of `TString str = msg.str()`. This code works perfect with Arcadia protobuf but does not work with vanilla protobuf. To solve it, a previously introduced primitive `FromProto<TString>` is used. This expression makes the most efficient cast possible between protobuf string and C++ string. Internally, it is just a copy in both cases. Since TString is CoW by default, this expression is almost zero-cost (actually it's just one atomic operation), so no degradation is expected for YTsaurus server builds. The most hot code is handled differently to avoid even atomic operations (see `GetRequestTargetYPath`). In case of vanilla protobuf string is copied, however there are no places in C++ SDK where it might be a problem. If such issues would appear, performance-critial code can be rewritten in `GetRequestTargetYPath`-style. --- 1a6f3e02cb6e83915102c24b73bc8734f6a48e74 Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/466
* YT-21141 Avoid content deduplication for files under 10MBorlovorlov2024-03-182-5/+8
| | | | febae4e49cd0f600bf21616025f210e99235cfdc
* add job_profile.cppuzhas2024-03-101-0/+141
| | | | 8571dcd93f2c4adc97e84f5a92373149b0d6e0f9
* Intermediate changesrobot-piglet2024-02-271-1/+33
|
* Intermediate changesrobot-piglet2024-02-122-21/+9
|
* YDB Import 552robot-ydb-importer2024-01-251-11/+4
|
* erm: Add new version for `@yatool/prebuilder`: `0.5.1` and set `0.5.1` as ↵robot-erm2024-01-256-6/+10
| | | | | | default Executed command: `./erm --verbose --profile update @yatool/prebuilder`
* feat contrib: aiogram 3armenqa2024-01-196-377/+0
| | | | Relates: https://st.yandex-team.ru/, https://st.yandex-team.ru/
* Library import 7 (#937)AlexSm2024-01-115-14/+14
|
* External build system generator release 65robot-ya-builder2023-12-051-3/+3
| | | | Update tools: yexport, os-yexport
* Increase timeout to decrease test flapsermolovd2023-12-051-2/+3
|
* [yt/cpp/mapreduce] YT-20588: Add more logs for readers and fix client_reader ↵nadya732023-11-281-2/+6
| | | | retries
* YT-19269: table writer implementation that doesn't wait for complete buffer ↵ermolovd2023-11-2813-13/+629
| | | | before sending to network
* YT-20315: Support retries of cross cell copyingnadya022023-11-241-2/+37
| | | | | | add options YT-20315: Support retries of cross cell copying
* Fix serialization of decimal type in TTableSchemaEgor Chunaev2023-11-231-2/+8
| | | | | | | | | | | | I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en Fix for https://github.com/ytsaurus/ytsaurus/issues/173 --- Pull Request resolved: https://github.com/ytsaurus/ytsaurus/pull/174 Co-authored-by: ermolovd <[email protected]>
* Revert "YT-20315: Support retries of cross cell copying"ermolovd2023-11-231-37/+2
| | | | | This reverts commit 9b45f88f366c2a170ab826922dd6eeaa64ea4192, reversing changes made to d6dc5a658da5b61fd71e72f1a60479989c5c64c5.
* YT-18863 Support 'deleted' field in NYT::TTableSchemaorlovorlov2023-11-221-0/+3
|
* YT-20315: Support retries of cross cell copyingnadya022023-11-221-2/+37
|
* add darwin-arm64 CMakeListsdcherednik2023-11-202-0/+73
|
* YT-20029: Support url schema for YT_PROXYwhatsername2023-11-151-6/+28
| | | | | Example YT_PROXY=https://freud.yt.yandex.net
* YT: fix duplicated proxy in url for write_file requestslysheva2023-11-151-1/+4
| | | | YT: fix duplicated proxy in url for write_file request
* add acquire buffer size to parallel file writeralxmopo3ov2023-10-312-0/+6
| | | | | | | | test with acquire ram buffers Add test on write with acquiring hard limit on file writer Implement acquire ram buffers setting for parallel file writer
* YT: yamaking missing cppleasid2023-10-286-0/+6
|
* YT-18571: Fix myriads of typosbabenko2023-10-231-1/+1
|
* add using http-proxy for reading table from YTannashest182023-10-225-1/+10
| | | | | | add using http-proxy for reading table from YT Нам нужна возможность ходить в YT через HTTP proxy для чтения таблиц, используя С++ клиент не из контура Яндекса, к сожалению, сейчас такой возможности нет. В этом ПР черновик изменения, которого нам достаточно https://a.yandex-team.ru/review/4676436/details - тут это же изменение в YT + коммит с тем, как мы планируем использовать
* Y_FAIL->Y_ABORT at '^yt'ilnurkh2023-10-173-7/+7
| | | | https://clubs.at.yandex-team.ru/arcadia/29404
* Possibility to get operation by its aliasermolovd2023-10-162-0/+12
|
* Y_VERIFY->Y_ABORT_UNLESS at ^ytilnurkh2023-10-0910-44/+44
| | | | https://clubs.at.yandex-team.ru/arcadia/29404
* support disk_request in user job specermolovd2023-09-281-0/+17
|
* YT-19885: Send impersonation in all requests when it existsmpereskokova2023-09-204-0/+23
|
* [yt/cpp/mapreduce] YT-19268: Lock memory for parallel writernadya732023-09-146-5/+28
|
* Add `layer_paths` user job spec option to the C++ interfacegaltsev2023-09-063-0/+12
|
* Fix input variable missprintsvidyuk2023-08-304-0/+24
|
* All .ll files support in LLVM_BCsvidyuk2023-08-304-24/+0
|
* Fix race in clientermolovd2023-08-242-3/+4
|
* YT-19445: do not write sort_by if it's emptyermolovd2023-08-091-1/+3
|
* YT-19210: expose YQL shared library for YT.max422023-07-2958-0/+11776
| | | | After this, a new target libyqlplugin.so appears. in open-source cmake build. Diff in open-source YDB repo looks like the following: https://paste.yandex-team.ru/f302bdb4-7ef2-4362-91c7-6ca45f329264
* Revert "YT-19324: move YT provider to ydb/library/yql"max422023-06-3053-11481/+0
| | | | This reverts commit ca272f12fdd0e8d5c3e957fc87939148f1caaf72, reversing changes made to 49f8acfc8b0b5c0071b804423bcf53fda26c7c12.
* YT-19324: move YT provider to ydb/library/yqlmax422023-06-3053-0/+11481
This commit is formed by the following script: https://paste.yandex-team.ru/6f92e4b8-efc5-4d34-948b-15ee2accd7e7/text. This commit has zero effect on all projects that depend on YQL. The summary of changes: - `yql/providers/yt -> ydb/library/yql/providers/yt `- the whole implementation of YT provider is moved into YDB code base for further export as a part of YT YQL plugin shared library; - `yql/providers/stat/{expr_nodes,uploader} -> ydb/library/yql/providers/stat/{expr_nodes,uploader}` - a small interface without implementation and the description of stat expr nodes; - `yql/core/extract_predicate/ut -> ydb/library/yql/core/extract_predicate/ut`; - `yql/core/{ut,ut_common} -> ydb/library/yql/core/{ut,ut_common}`; - `yql/core` is gone; - `yql/library/url_preprocessing -> ydb/library/yql/core/url_preprocessing`. **NB**: all new targets inside `ydb/` are under `IF (NOT CMAKE_EXPORT)` clause which disables them from open-source cmake generation and ya make build. They will be enabled in the subsequent commits.