Mirror of YDB github repos https://code.mastervirt.ru/ydb/atom?h=CLI_2.19.0 2025-01-16T19:26:51Z 2025-01-16T19:26:51Z prettyboy prettyboy@yandex-team.com 2025-01-16T18:01:45Z urn:sha1:2f3fd95aac24e27a3b0aa2badda49db82bf36cc5 Режим позволяет перезапускать python тесты или интеграционные тесты на питон программы при внесении изменений в python файлы без перекомпиляции. Сценарий: - прогнали тесты - внесли изменение в `library/python/func/__init__.py` - перезапустили, смотрим на времена На примере интеграционного devtools/ya/handlers/analyze_make/tests в codenv (base конфигурация). #| || ya m -rA | ya m -rA --ext-py || || real 10m25,928s user 0m53,465s sys 1m14,791s ``` Total time by type: [935171 ms] [LD] [count: 3, ave time 311723.67 msec] [ 13657 ms] [prepare:AC] [count: 4, ave time 3414.25 msec] [ 10436 ms] [TM] [count: 1, ave time 10436.00 msec] [ 10387 ms] [prepare:get from local cache] [count: 1521, ave time 6.83 msec] [ 6480 ms] [TS] [count: 1, ave time 6480.00 msec] [ 3823 ms] [prepare:put into local cache, clean build dir] [count: 7, ave time 546.14 msec] [ 2279 ms] [CC] [count: 1, ave time 2279.00 msec] [ 1251 ms] [PY] [count: 1, ave time 1251.00 msec] [ 372 ms] [prepare:yt-store] [count: 2, ave time 186.00 msec] [ 154 ms] [AR] [count: 1, ave time 154.00 msec] ... ``` | real 0m22,094s user 0m26,372s sys 0m3,363s ``` Total time by type: [13140 ms] [TM] [count: 1, ave time 13140.00 msec] [ 351 ms] [prepare:yt-store] [count: 1, ave time 351.00 msec] [ 81 ms] [prepare:tools] [count: 8, ave time 10.12 msec] [ 32 ms] [prepare:AC] [count: 2, ave time 16.00 msec] [ 31 ms] [prepare:get from local cache] [count: 7, ave time 4.43 msec] [ 16 ms] [prepare:clean] [count: 3, ave time 5.33 msec] ``` || |# В codenv в base конфигуарции (4cpu) невероятно долго идёт линковка. Тот же самый сценарий, но на mous (54cpu) #| || ya m -rA | ya m -rA --ext-py || || real 0m25,435s user 0m40,242s sys 0m22,434s ``` Total time by type: [30958 ms] [prepare:get from local cache] [count: 1521, ave time 20.35 msec] [16293 ms] [prepare:AC] [count: 4, ave time 4073.25 msec] [11161 ms] [LD] [count: 3, ave time 3720.33 msec] [ 4256 ms] [TM] [count: 1, ave time 4256.00 msec] [ 3529 ms] [TS] [count: 1, ave time 3529.00 msec] [ 1542 ms] [CC] [count: 1, ave time 1542.00 msec] [ 635 ms] [PY] [count: 1, ave time 635.00 msec] ... ``` | real 0m18,321s user 0m21,673s sys 0m3,204s ``` Total time by type: [10786 ms] [TM] [count: 1, ave time 10786.00 msec] [ 1568 ms] [prepare:yt-store] [count: 1, ave time 1568.00 msec] [ 151 ms] [prepare:tools] [count: 8, ave time 18.88 msec] [ 61 ms] [prepare:get from local cache] [count: 7, ave time 8.71 msec] [ 48 ms] [prepare:AC] [count: 2, ave time 24.00 msec] [ 14 ms] [prepare:clean] [count: 3, ave time 4.67 msec] ``` || |# В новом режиме тест ожидаемо замедляется, так как все питон программы при каждом старте вынуждены читать файлы с фс (ещё через арк), а потом ещё и компилировать байткод, т.е. холодный запуск commit_hash:24c5a46a8385d3c065abfb6fc5b40f7ad24bb1cb 2024-12-13T06:07:25Z spreis spreis@yandex-team.com 2024-12-13T05:25:28Z urn:sha1:e90b83df32a421a93c021eaa91710c1193585f9a There is no runtime perf impact, but - The change reduces build graph by removing 2 nodes out of 5 for python which accelerates both configuration and build - surprisingly in all experiments there were positive impact on binary size about 2MiB commit_hash:909fdeeb91b7f20c749177d638e97d5a469e422d 2024-02-18T23:50:43Z thegeorg thegeorg@yandex-team.com 2024-02-18T23:38:52Z urn:sha1:d96fa07134c06472bfee6718b5cfd1679196fc99 * Move src/ subdir contents to the top of the layout * Rename self-written lib -> lib2 to avoid CaseFolding warning from the VCS * Regenerate contrib/libs/python proxy-headers accordingly 4ccc62ac1511abcf0fed14ccade38e984e088f1e 2023-09-29T09:41:34Z nkozlovskiy nmk@ydb.tech 2023-09-29T09:24:06Z urn:sha1:e0e3e1717e3d33762ce61950504f9637a6e669ed 2022-03-15T10:35:56Z arcadia-devtools arcadia-devtools@yandex-team.ru 2022-03-15T10:35:56Z urn:sha1:094638589de6a6c9f91fad0005843fc1c1adc957 ref:ca7a95e8c9a9d780f96497136a152091d54e61b5 2022-02-10T13:47:18Z abodrov abodrov@yandex-team.ru 2022-02-10T13:47:18Z urn:sha1:f02a874a7290593efbe4b3aeae69a04b46c1cc86 2022-02-10T13:47:18Z abodrov abodrov@yandex-team.ru 2022-02-10T13:47:18Z urn:sha1:1b8c043abfc689b3d27384c4202b20031fc4ae31 2022-02-10T13:47:13Z spreis spreis@yandex-team.ru 2022-02-10T13:47:13Z urn:sha1:b49848d6e361b76904f094b7d5e10d6edea75afe 2022-02-10T13:47:13Z spreis spreis@yandex-team.ru 2022-02-10T13:47:13Z urn:sha1:bcd1126cbd5d445cd0665d295198aa39c6ab8cbe 2022-02-10T13:46:57Z deshevoy deshevoy@yandex-team.ru 2022-02-10T13:46:57Z urn:sha1:28148f76dbfcc644d96427d41c92f36cbf2fdc6e