summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* fix relations22.2.22alexnick2022-04-192-2/+0
| | | | | | | | fix relations REVIEW: 2455896 REVIEW: 2457133 x-ydb-stable-ref: 5123070da3815c351de94b3400369e17d105b4bd
* 22-2: Reduce queue_restore to 2 threads by default, KIKIMR-14692Alexey Borzenkov2022-04-181-1/+1
| | | | | | | Merge from trunk: r9334121 REVIEW: 2454367 x-ydb-stable-ref: b6eb47536c42075f0f6c9a23f9835351edb9e83d
* correct kinesis error codes in datastreamsalexnick2022-04-181-15/+14
| | | | | | | | correct error codes Note: mandatory check (NEED_CHECK) was skipped REVIEW: 2453925 x-ydb-stable-ref: 19728da96711de9e81de9ef2cf8067357c4f09b5
* support of http kinesis proxy inside ydb KIKIMR-14665 KIKIMR-14218alexnick2022-04-1852-70/+2403
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | switch metrics registry to shared_ptr KIKIMR-14218 REVIEW: 2369561 support of http kinesis proxy inside ydb KIKIMR-14665 REVIEW: 2445707 LOGBROKER-7369 Add TCP_USER_TIMEOUT option on client socket Unfortunately timeout issue can only be reproduced in special conditions: - tests are run locally - the order of tests is as follows: GoodRequestGetRecords and GoodRequestGetRecordsLongStreamName should be executed one after another. In debugger one can clearly see the infinite waiting in socket. Thereby the TCP_USER_TIMEOUT option fixes it. Moving GoodRequestGetRecordsLongStreamName up or to a different TEST_SUITE fix the issue as well though. REVIEW: 2433681 LOGBROKER-7298 Fix verify on GetRecords call Fix VERIFY issue REVIEW: 2406664 LOGBROKER-7373 Fix empty body in error response Fix empty body in error responce from http proxy REVIEW: 2396287 LOGBROKER-7369 Fix local run of http proxy tests Fix local run of http proxy tests Actor HTTP server listens on IPv6 localhost, e.g. [::] Tests send data to localhost. Resolving of localhost works differently from system to system. Replace localhost to 127.0.0.1 or :: depending on use case. REVIEW: 2393055 REVIEW: 2451066 x-ydb-stable-ref: 22bc438d32d05e166c59a3e0e4afb51da8103c3a
* remove usage scope validations for tenant and node type KIKIMR-14276Vitalii Gridnev2022-04-184-29/+1
| | | | | | | REVIEW: 2449087 REVIEW: 2453741 x-ydb-stable-ref: d75b8a63a96d690695b263fbf446189f2751d30a
* 22-2: Fix unprotected read commit flag check, KIKIMR-13910Alexey Borzenkov2022-04-182-3/+15
| | | | | | | Merge from trunk: r9329733 REVIEW: 2452031 x-ydb-stable-ref: 1c6954d8b25f3c623cda07eeeacd0b33e101b201
* 22-2: Drop index info at main table upon cancellation KIKIMR-14664Ilnaz Nizametdinov2022-04-1813-25/+195
| | | | | | | merge from trunk: r9327124 REVIEW: 2449821 x-ydb-stable-ref: 3e721c31fcf405448900453bbcab2fb74a692320
* bugfixes in pqlib YC-1022alexnick2022-04-182-4/+9
| | | | | | | | | | | fix for empty messages Note: mandatory check (NEED_CHECK) was skipped fix for YQ-1022 Note: mandatory check (NEED_CHECK) was skipped REVIEW: 2449884 x-ydb-stable-ref: e06cc260218d5d5123ea909d512ad31f003eba3f
* KIKIMR-14632 fix split/merge shards registration at rebootssvc2022-04-182-4/+60
| | | | | | | REVIEW: 2448468 REVIEW: 2449553 x-ydb-stable-ref: 3b70ae0924f3d19b5d160fe85ab4f1045525aaaf
* 22-2: Prepare to disallow downgrades below 22-2-20 in the future, KIKIMR-14656Alexey Borzenkov2022-04-181-2/+3
| | | | | REVIEW: 2444057 x-ydb-stable-ref: 27ed40f9a68a102d24254ad6aed5f6b74bddccb2
* Better snapshot handling in defrag code KIKIMR-14651Alexander Rutkovsky2022-04-182-22/+31
| | | | | | | REVIEW: 2441369 REVIEW: 2445813 x-ydb-stable-ref: bd25794124478009e2bf1dd9e2e9a612533ff7d6
* added embedded ui built from github repo to a stable-22 YDB-1501kovalad2022-04-18103-190/+247
| | | | | REVIEW: 2443558 x-ydb-stable-ref: 1a2a219c85d00f76f4d38f02c476c3ff4bc47995
* 22-2: Snapshot isolation with prioritized reads, KIKIMR-13910Alexey Borzenkov2022-04-1872-163/+2938
| | | | | | | Merge from trunk: r9171244, r9229795, r9244174, r9285534, r9300998, r9313872 REVIEW: 2435130 x-ydb-stable-ref: 9c878f6e7949737ee83323c98c1b7c64c372710e
* KIKIMR-14565: fix CSV load with --header option in cli (Cherry pick commit ↵Artem Zuikov2022-04-181-0/+1
| | | | | | | r9314037) REVIEW: 2440283 x-ydb-stable-ref: e957a0d7c0ae05e85fc97b3d4890d73bb374770e
* merge: enable logs in mirrorer and some fixesAlexey Bogolyubskiy2022-04-1821-230/+402
| | | | | | | | | | | | | | | | | | | | | do not override log formatter inside ydb_persqueue sdk fix fix REVIEW: 2435689 more information from mirrorer & fix commit problem LOGBROKER-7400 1) исправлена проблема коммита офсета - коммит делается через оригинальное вычитанное сообщение 2) отслеживается самая старая фьюча по которой нет ответа 3) правильная обработка WaitNextReaderEventInFlight 4) постоянно запрашивается partition status REVIEW: 2435480 enable sdk logs in mirrorer LOGBROKER-7400 enable logs REVIEW: 2432795 REVIEW: 2438061 x-ydb-stable-ref: 1f12597d5956d27d42acad88a0e9d13e9e0b4bff
* [merge to stable-22-2] Fix a segfault in debug mode when the allocated ↵sharpeye2022-04-181-3/+8
| | | | | | | | | | | | | memory accidentally contains 0xF0000000 Наш сервис при сборке с `ALLOCATOR(LF_DBG)` на старте падает [в этой строчке](https://a.yandex-team.ru/arc_vcs/commit/r7923656#file-library/cpp/lfalloc/lf_allocX64.h:R1901) при попытке разыменовать очевидно невалидный указатель. В gdb видно, что мы при попытке определить координаты фиктивного заголовка в `GetAllocHeader()` прочитали какие-то левые 32 бита в качестве `header->Tag`, и они по стечению обстоятельств оказались равны `0xF0000000` в нашем случае (просто не повезло). После этого мы решаем, что в `header->Size` лежит настоящий указатель на заголовок, хотя на самом деле там лежит тоже что-то рандомное. Решение, вроде бы, простое — когда формируем фиктивный заголовок, надо не обращать внимания на теги (потому что к этому моменту их ещё некому было записать). REVIEW: 2408267 REVIEW: 2438642 x-ydb-stable-ref: 02ccf11b927a06e81b968e8b45c287957b8e1d60
* KIKIMR-14636 write more data in order to trigger splitsvc2022-04-181-2/+1
| | | | | REVIEW: 2437567 x-ydb-stable-ref: d941f4937989aa9e44de8ab0e6990dbf81fcdde6
* [NBS] merge to stable 22-2sharpeye2022-04-181-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | NBS-2994: remove NonReplicatedIOFadingDuration REVIEW: 2436525 NBS-3174: mute E_IO REVIEW: 2435680 NBS-3088: implement QueryAvailableStorage REVIEW: 2429703 NBS-3088: rename StorageNodes to AgentIds REVIEW: 2432457 NBS-2833: new params for DM/CreateDisk REVIEW: 2428492 NBS-2833: tweak config REVIEW: 2428316 NBS-2833: forward parameters from CLI to DR REVIEW: 2427829 NBS-2833: fix allocation on target REVIEW: 2426618 [NBS] tweak allocation errors handing REVIEW: 2426249 NBS-2833: show storage pool name on mon pages REVIEW: 2425366 NBS-2833: specify constraints for AllocateDisk (nodes, pool tag) REVIEW: 2390736 more tests for rack ranking [fix]; NBS-3082 REVIEW: 2325078 more tests for rack ranking; NBS-3082 REVIEW: 2324675 [NBS] add STORAGE_MEDIA_SSD_LOCAL add STORAGE_MEDIA_SSD_LOCAL REVIEW: 2387176 NBS-3088: QueryAvailableStorage method REVIEW: 2323678 REVIEW: 2437421 x-ydb-stable-ref: 56fe522659dafb0b193acea558893e87d6c3f129
* Avoid compute results tx for simple scalar expressions + more efficient ↵Sergei Puchin2022-04-1819-111/+447
| | | | | | | | | physical plan for Length callable. (KIKIMR-14596) REVIEW: 2434345 REVIEW: 2436359 x-ydb-stable-ref: 41779084f0138d91336e32a7ea074805c2b0e9bc
* KIKIMR-14636 split after movesvc2022-04-185-8/+187
| | | | | | | REVIEW: 2433139 REVIEW: 2436301 x-ydb-stable-ref: 5eaa2d8a95381eb10a74e2f1ae5abde9d0a7e0b1
* dirty workaround for test KIKIMR-14624Alexey Efimov2022-04-189-4/+33
| | | | | REVIEW: 2432272 x-ydb-stable-ref: 3e2d81c436f4c80bb6d280dfcff7df6ce9bd3b8c
* KIKIMR-14630: get rid of separate phase for parameters repack for sql-in queriesIgor Makunin2022-04-182-5/+110
| | | | | | | REVIEW: 2430000 REVIEW: 2430904 x-ydb-stable-ref: 36fc9eaba7b128149b2959ea47e9715d6421070d
* KIKIMR-9748: safer default background compaction configEvgeniy Ivanov2022-04-181-2/+2
| | | | | REVIEW: 2430889 x-ydb-stable-ref: 90bd4cc9a33a75d2911d1585292fa873a291ac8e
* PR from branch users/eivanov89/KIKIMR-9748-compaction-fixes-22-2Evgeniy Ivanov2022-04-1826-189/+795
| | | | | | | | | | KIKIMR-9748: don't background compact neither source nor dst copy tables KIKIMR-14610: properly update active subqueue when update/remove compactionQueue REVIEW: 2424902 REVIEW: 2430085 x-ydb-stable-ref: 7aef143119eea20585494d986441e25ad0ebd994
* make available size filter exclusive KIKIMR-14624Alexey Efimov2022-04-181-2/+2
| | | | | REVIEW: 2430489 x-ydb-stable-ref: e9b28798844d16306b5a95676e989fb03e0402d8
* PR from branch users/yegorskii/merge-22-2yegorskii2022-04-181-41/+216
| | | | | | | | | | | NBS-3152: remove prefetch for blobsindex table and rework rebuild metadata for block count REVIEW: 2410706 NBS-3152: allow to precharge specified number of records REVIEW: 2418426 REVIEW: 2429185 x-ydb-stable-ref: 16ec1dfa5bc883acea4ddaceec375a90dd2efbde
* KIKIMR-14596: dont precompute parameterIgor Makunin2022-04-182-3/+8
| | | | | | | REVIEW: 2427622 REVIEW: 2428277 x-ydb-stable-ref: 63098b5777d3498334900c1e6acfa2abd919a6fd
* 22-2: Batch processing of sending notifications upon commit KIKIMR-14597Ilnaz Nizametdinov2022-04-181-6/+72
| | | | | | | merge from trunk: r9294377 REVIEW: 2427442 x-ydb-stable-ref: 57b7333387ffa67d0c728f84e8832ab205ecada5
* PR from branch users/spuchin/KIKIMR-14325Sergei Puchin2022-04-1814-230/+463
| | | | | | | | | | | Support ExtractMembers in SqlIn optimizer. (KIKIMR-14325) REVIEW: 2423187 Do not split reads on ExtractMembers. (KIKIMR-14325, KIKIMR-14498) REVIEW: 2416041 REVIEW: 2426829 x-ydb-stable-ref: 920e89b18455b2437fb171af35e1ef0575108f50
* [merge to 22-2] Add list of non chargeable users for YDSmokhotskii2022-04-183-28/+112
| | | | | | | | | CLOUD-95800 Add list of non chargeable users for YDS Add list of non chargeable users in YDS PQConfig REVIEW: 2426032 REVIEW: 2427364 x-ydb-stable-ref: 29d08de2c485e029b948fbd245969467382a2772
* 22-2: Validate cell sizes for columns, KIKIMR-14609Alexey Borzenkov2022-04-185-2/+81
| | | | | | | Merge from trunk: r9292957 REVIEW: 2426555 x-ydb-stable-ref: 1530dbb0378fd6c1658a48938752f54ec4cd4e8a
* [merge to 22-2] Fix typos in yds permissionsmokhotskii2022-04-181-2/+2
| | | | | | | | | LOGBROKER-7395 Fix typo in YDS permission name Fix typo in YDS permission name REVIEW: 2418302 REVIEW: 2420588 x-ydb-stable-ref: b9b26a2607c33a012e2132d6b83d37bd8b0b1420
* KIKIMR-14582: provide more info on failIgor Makunin2022-04-182-14/+32
| | | | | | | REVIEW: 2417903 REVIEW: 2418264 x-ydb-stable-ref: e9e36eb29682b6a1b4e88177e29e853b67eeb831
* fix BS_QUEUE log messages KIKIMR-9989monster2022-04-181-6/+26
| | | | | | | REVIEW: 2409477 REVIEW: 2412530 x-ydb-stable-ref: d2ff68dbc0487eda79306b4400fb9ae92d90d9fd
* PR from branch users/ildar-khisam/KIKIMR-14475-releaseildar-khisam2022-04-183-1/+58
| | | | | | | | | refactor new test Solve KIKIMR-14475: send TabletActive event only after all partitions initialized, if any; add test for events order REVIEW: 2412499 x-ydb-stable-ref: 4b56e3a587cc571510e3e8598535852d9d80e76b
* [kqp] increase lookup interval and introduce new config option KIKIMR-14574Vitalii Gridnev2022-04-182-5/+13
| | | | | | | REVIEW: 2413730 REVIEW: 2414118 x-ydb-stable-ref: b6dba35bf52e5204aff5de123504248429e7c4c6
* KIKIMR-14553: fix column table description in cli (Cherry pick commit r9269337)Artem Zuikov2022-04-186-3/+15
| | | | | REVIEW: 2409984 x-ydb-stable-ref: f77383492b2d4efa2439952fc4ef521a1a90423d
* DEPLOY-5331: column-table python sdk (Cherry pick commit r9273695)Artem Zuikov2022-04-181-0/+1
| | | | | REVIEW: 2413160 x-ydb-stable-ref: dc7ce7d92dd4abe1f36f66abd572c5ce590127ce
* add setting CheckMoveExpediency KIKIMR-14538Alexey Efimov2022-04-184-1/+14
| | | | | REVIEW: 2412278 x-ydb-stable-ref: 3415f1770cc30309fc0a9b51f8db84993c661efe
* add name_label page parameter for prometheus format KIKIMR-14564monster2022-04-183-3/+16
| | | | | | | REVIEW: 2409698 REVIEW: 2411265 x-ydb-stable-ref: d99e0a3a39cc18795ae54e62bddde7afe498eed2
* [merge to 22-2] Fix VERIFY root cause in YDS GetRecordsmokhotskii2022-04-189-73/+182
| | | | | | | | | Change SCHEME_ERROR to INTERNAL in case of pipe error Fix VERIFY issue REVIEW: 2410516 x-ydb-stable-ref: 402c098395ca1b49d8bdf5d377599fdfc58a0024
* add sensor label KIKIMR-12474monster2022-04-182-3/+4
| | | | | | | REVIEW: 2303139 REVIEW: 2410451 x-ydb-stable-ref: 95b2e3c75cb0fb13d7bf529b01abf42b006242bf
* merge 22-2: easy forwarding of PQReadSessionsInfoWorkerFactoryAlexey Bogolyubskiy2022-04-1823-125/+51
| | | | | | | | | easy forwarding of PQReadSessionsInfoWorkerFactory fix REVIEW: 2407377 REVIEW: 2409456 x-ydb-stable-ref: 058007882241f82ebebb6e82544d323c09fc0292
* reduce number of sensors in dsproxy KIKIMR-9501monster2022-03-232-10/+74
| | | | | | | REVIEW: 2391792 REVIEW: 2407361 x-ydb-stable-ref: dd498867a1ba13776dcf53ea613868a9a7dfad70
* PR from branch users/evgeniy-kozev/merge_to_22evgeniy-kozev2022-03-231-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | fixed use-after-move; NBS-3134; REVIEW: 2382180 use ServerStats instead of ClientStats REVIEW: 2384836 NBS-2927: User metrics are filled REVIEW: 2380168 NBS-2927: Trotler percentiles metris are added REVIEW: 2383979 NBS-2927: new page for user metrics is added REVIEW: 2319103 NBS-2927: Instance label is added to server_volume metrics REVIEW: 2336361 NBS-2927: new actor for user stats is added REVIEW: 2374359 NBS-2927: Client id is pushed to volume stats REVIEW: 2363532 REVIEW: 2406680 x-ydb-stable-ref: 5d67f4190501fb619404dd054d6f1bf5cf0fb969
* KIKIMR-14547: fix memory managementIgor Makunin2022-03-235-5/+74
| | | | | | | REVIEW: 2404181 REVIEW: 2405443 x-ydb-stable-ref: 41a028d6b4e52afce3628f206b32f580d7f4157b
* PR from branch users/xenoxeno/merge-KIKIMR-14545Alexey Efimov2022-03-2313-6/+174
| | | | | | | | | | | make TabletOwners synchronization more safe KIKIMR-14545 REVIEW: 2403058 distribute TabletOwners data to tenant hives KIKIMR-14545 REVIEW: 2402438 REVIEW: 2403497 x-ydb-stable-ref: 274df7e2e0d262b3aa24ffb55262c273e64db46f
* PR from branch users/xenoxeno/merge-to-22-2Alexey Efimov2022-03-2348-90/+467
| | | | | | | | | | | | | | | | | add web handler to move specific tablet to specific node KIKIMR-14409 REVIEW: 2347038 change CORS handling KIKIMR-14403 REVIEW: 2345681 return domain / subdomain tablets by path on tabletinfo handler KIKIMR-14408 REVIEW: 2343272 initialize root domain with default user, groups and access rights KIKIMR-14361 REVIEW: 2335998 REVIEW: 2400380 x-ydb-stable-ref: 83f6b5c6626f4cc55480995c24a571d87377cf36
* PR from branch users/qkrorlqr/users/qkrorlqr/NBS-1670-NBS-2891/22-2qkrorlqr2022-03-232-0/+8
| | | | | | | | | | | | extracted TPartitionRequestActor and InitPartitionRequests from volume_actor_forward.cpp into partition_requests.h; extracted some other code into separate files (by deps); NBS-2891 https://st.yandex-team.ru/NBS-2891#6238c4011678900d7c2ffcd5 REVIEW: 2401598 ignoring unknown stuff in log config; NBS-1670 REVIEW: 2379583 REVIEW: 2401761 x-ydb-stable-ref: a6c14e170ec201022cadf1ffe0880d310411d441
* forward PQReadSessionsInfoWorkerFactory LOGBROKER-7376alexnick2022-03-236-14/+67
| | | | | | | | | | fix crash from ui consumer info request: forward PQReadSessionsInfoWorkerFactory LOGBROKER-7376 fix build forward PQReadSessionsInfoWorkerFactory REVIEW: 2400220 REVIEW: 2402086 x-ydb-stable-ref: f9f4be418b9c346505ae7c251748d084a5e45b49