| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | feat python: always compile Python libs with -O3 | antoshkka | 2026-06-03 | 1 | -0/+4 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Many people use Python to test their C++ binaries built in Debug (that is a common case in RideTech). Debug built Python is very slow, almost noone debugs the Python interpreter itself, so this patch forces the Python to be always built with optimizations. Tests run (3 iteratons) with -O3 compiled Python (this patch): ``` real 5m20.239s user 17m51.171s sys 1m38.676s real 5m31.585s user 17m55.240s sys 1m38.903s real 5m20.914s user 17m57.854s sys 1m39.039s ``` Same tests (2 iterations) with default Python in debug (current trunk): ``` real 13m43.975s user 46m29.006s sys 2m13.313s real 13m29.301s user 46m55.216s sys 2m10.173s ``` For other service: ``` # This patch real 1m24.427s user 6m56.296s sys 0m39.936s real 1m12.953s user 7m34.245s sys 0m37.000s real 1m14.612s user 7m27.097s sys 0m36.839s # Trunk: real 1m59.555s user 13m40.203s sys 0m35.482s real 2m2.459s user 13m50.473s sys 0m34.215s real 1m59.250s user 13m34.304s sys 0m32.218s ``` And another service: ``` # This patch real 0m36.629s user 0m48.045s sys 0m2.074s # Trunk: real 1m56.316s user 2m16.525s sys 0m3.732s ``` commit_hash:9fa58184be777973e5f8c4aebc3811ca348299b6 | ||||
| * | add DUSE_PYTHON3_PREV support | kuzmich321 | 2025-08-04 | 1 | -2/+12 |
| | | | | | commit_hash:b2e89d949d9560889cc979429e8fa79494368f76 | ||||
| * | Subinterpretor compatible __res module (2nd attempt) | snermolaev | 2025-04-29 | 1 | -20/+16 |
| | | | | | | | | Cython is not yet subinterpreter compatible. There are no ETA when cython is going to support subinterpreters. This PR removes cython from hermetic python imoprt hooks in order to make them subinterpretr-compatible. commit_hash:427b6f9db6afa6695659ee147621e1ccb391d3cb | ||||
| * | Revert "Subinterpretor compatible __res module" rXXXXXX | snermolaev | 2025-04-15 | 1 | -16/+20 |
| | | | | | commit_hash:1d9f5675b9d3ddaa44db4472376a06ad3e811e2d | ||||
| * | Subinterpretor compatible __res module | snermolaev | 2025-04-14 | 1 | -20/+16 |
| | | | | | | | | Cython is not yet subinterpreter compatible. There are no ETA when cython is going to support subinterpreters. This PR removes cython from hermetic python imoprt hooks in order to make them subinterpretr-compatible. commit_hash:1b067c37f55a4f1d9a6172df7009c75231cc1e25 | ||||
| * | Prototype - external python files mode for tests | prettyboy | 2025-01-16 | 1 | -0/+10 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Режим позволяет перезапускать python тесты или интеграционные тесты на питон программы при внесении изменений в python файлы без перекомпиляции. Сценарий: - прогнали тесты - внесли изменение в `library/python/func/__init__.py` - перезапустили, смотрим на времена На примере интеграционного devtools/ya/handlers/analyze_make/tests в codenv (base конфигурация). #| || ya m -rA | ya m -rA --ext-py || || real 10m25,928s user 0m53,465s sys 1m14,791s ``` Total time by type: [935171 ms] [LD] [count: 3, ave time 311723.67 msec] [ 13657 ms] [prepare:AC] [count: 4, ave time 3414.25 msec] [ 10436 ms] [TM] [count: 1, ave time 10436.00 msec] [ 10387 ms] [prepare:get from local cache] [count: 1521, ave time 6.83 msec] [ 6480 ms] [TS] [count: 1, ave time 6480.00 msec] [ 3823 ms] [prepare:put into local cache, clean build dir] [count: 7, ave time 546.14 msec] [ 2279 ms] [CC] [count: 1, ave time 2279.00 msec] [ 1251 ms] [PY] [count: 1, ave time 1251.00 msec] [ 372 ms] [prepare:yt-store] [count: 2, ave time 186.00 msec] [ 154 ms] [AR] [count: 1, ave time 154.00 msec] ... ``` | real 0m22,094s user 0m26,372s sys 0m3,363s ``` Total time by type: [13140 ms] [TM] [count: 1, ave time 13140.00 msec] [ 351 ms] [prepare:yt-store] [count: 1, ave time 351.00 msec] [ 81 ms] [prepare:tools] [count: 8, ave time 10.12 msec] [ 32 ms] [prepare:AC] [count: 2, ave time 16.00 msec] [ 31 ms] [prepare:get from local cache] [count: 7, ave time 4.43 msec] [ 16 ms] [prepare:clean] [count: 3, ave time 5.33 msec] ``` || |# В codenv в base конфигуарции (4cpu) невероятно долго идёт линковка. Тот же самый сценарий, но на mous (54cpu) #| || ya m -rA | ya m -rA --ext-py || || real 0m25,435s user 0m40,242s sys 0m22,434s ``` Total time by type: [30958 ms] [prepare:get from local cache] [count: 1521, ave time 20.35 msec] [16293 ms] [prepare:AC] [count: 4, ave time 4073.25 msec] [11161 ms] [LD] [count: 3, ave time 3720.33 msec] [ 4256 ms] [TM] [count: 1, ave time 4256.00 msec] [ 3529 ms] [TS] [count: 1, ave time 3529.00 msec] [ 1542 ms] [CC] [count: 1, ave time 1542.00 msec] [ 635 ms] [PY] [count: 1, ave time 635.00 msec] ... ``` | real 0m18,321s user 0m21,673s sys 0m3,204s ``` Total time by type: [10786 ms] [TM] [count: 1, ave time 10786.00 msec] [ 1568 ms] [prepare:yt-store] [count: 1, ave time 1568.00 msec] [ 151 ms] [prepare:tools] [count: 8, ave time 18.88 msec] [ 61 ms] [prepare:get from local cache] [count: 7, ave time 8.71 msec] [ 48 ms] [prepare:AC] [count: 2, ave time 24.00 msec] [ 14 ms] [prepare:clean] [count: 3, ave time 4.67 msec] ``` || |# В новом режиме тест ожидаемо замедляется, так как все питон программы при каждом старте вынуждены читать файлы с фс (ещё через арк), а потом ещё и компилировать байткод, т.е. холодный запуск commit_hash:24c5a46a8385d3c065abfb6fc5b40f7ad24bb1cb | ||||
| * | Never compress python build resources to speedup python configuration and build | spreis | 2024-12-13 | 1 | -0/+1 |
| | | | | | | | | There is no runtime perf impact, but - The change reduces build graph by removing 2 nodes out of 5 for python which accelerates both configuration and build - surprisingly in all experiments there were positive impact on binary size about 2MiB commit_hash:909fdeeb91b7f20c749177d638e97d5a469e422d | ||||
| * | Sync contrib/tools/python3 layout with upstream | thegeorg | 2024-02-19 | 1 | -2/+2 |
| | | | | | | | | * Move src/ subdir contents to the top of the layout * Rename self-written lib -> lib2 to avoid CaseFolding warning from the VCS * Regenerate contrib/libs/python proxy-headers accordingly 4ccc62ac1511abcf0fed14ccade38e984e088f1e | ||||
| * | add ydb deps | nkozlovskiy | 2023-09-29 | 1 | -0/+43 |
| | | |||||
| * | intermediate changes | arcadia-devtools | 2022-03-15 | 1 | -49/+0 |
| | | | | | ref:ca7a95e8c9a9d780f96497136a152091d54e61b5 | ||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | abodrov | 2022-02-10 | 1 | -4/+4 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | abodrov | 2022-02-10 | 1 | -4/+4 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | spreis | 2022-02-10 | 1 | -2/+2 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | spreis | 2022-02-10 | 1 | -2/+2 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | deshevoy | 2022-02-10 | 1 | -2/+2 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | deshevoy | 2022-02-10 | 1 | -2/+2 |
| | | |||||
| * | Restoring authorship annotation for Nikita Slyusarev ↵ | Nikita Slyusarev | 2022-02-10 | 1 | -6/+6 |
| | | | | | <[email protected]>. Commit 2 of 2. | ||||
| * | Restoring authorship annotation for Nikita Slyusarev ↵ | Nikita Slyusarev | 2022-02-10 | 1 | -6/+6 |
| | | | | | <[email protected]>. Commit 1 of 2. | ||||
| * | Restoring authorship annotation for Vlad Yaroslavlev <[email protected]>. ↵ | Vlad Yaroslavlev | 2022-02-10 | 1 | -2/+2 |
| | | | | | Commit 2 of 2. | ||||
| * | Restoring authorship annotation for Vlad Yaroslavlev <[email protected]>. ↵ | Vlad Yaroslavlev | 2022-02-10 | 1 | -2/+2 |
| | | | | | Commit 1 of 2. | ||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | cerevra | 2022-02-10 | 1 | -1/+1 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | cerevra | 2022-02-10 | 1 | -1/+1 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | snermolaev | 2022-02-10 | 1 | -10/+10 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | snermolaev | 2022-02-10 | 1 | -10/+10 |
| | | |||||
| * | Restoring authorship annotation for Anton Samokhvalov <[email protected]>. ↵ | Anton Samokhvalov | 2022-02-10 | 1 | -7/+7 |
| | | | | | Commit 2 of 2. | ||||
| * | Restoring authorship annotation for Anton Samokhvalov <[email protected]>. ↵ | Anton Samokhvalov | 2022-02-10 | 1 | -7/+7 |
| | | | | | Commit 1 of 2. | ||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | orivej | 2022-02-10 | 1 | -10/+10 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | orivej | 2022-02-10 | 1 | -10/+10 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 2 of 2. | shadchin | 2022-02-10 | 1 | -5/+5 |
| | | |||||
| * | Restoring authorship annotation for <[email protected]>. Commit 1 of 2. | shadchin | 2022-02-10 | 1 | -5/+5 |
| | | |||||
| * | intermediate changes | Devtools Arcadia | 2022-02-07 | 1 | -0/+49 |
| ref:cde9a383711a11544ce7e107a78147fb96cc4029 | |||||
