summaryrefslogtreecommitdiffstats
path: root/library/python/runtime_py3/importer.pxi
Commit message (Collapse)AuthorAgeFilesLines
* [library/python/runtime_py3] Made Y_PYTHON_SOURCE_ROOT bytes againprettyboy2025-01-231-1/+1
| | | | commit_hash:3433c11c4d386c785422b1e149e9a3a8de7f4f0f
* [devtools/ya] Dont' write __pycache__ to the arcadia in external-py-files modeprettyboy2025-01-231-1/+29
| | | | | | | | | В репозитории больше не будет `__pycache__` при запусках через ya make / test На примере devtools/ya/handlers/analyze_make/tests Время конфигурации в горячем сценарии в режиме --ext-py при изменении одного питонфайлика: `Configure time - 6.1 s` Время конфигурации в горячем сценарии в режиме --ext-py при изменении одного питонфайлика с текущими правками: `Configure time - 4.6 s` commit_hash:adf5219cd4f347bb572393d4a6debd1436dc0815
* [library/python/runtime_py3] Added bytecode support for external-py-files modeprettyboy2025-01-181-9/+64
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Добавляется поддержка стандартной работы с байткодом для бинарей собранных с --ext-py (HIDDEN_URL На примере импорт теста для `devtools/ya/bin` `time Y_PYTHON_ENTRY_POINT=library.python.testing.import_test.import_test:main YA_TEST_CONTEXT_FILE=/tmp/test.context ./ya-bin >/dev/null` #| || Без патча ya m -r | real 0m2,934s user 0m2,772s sys 0m0,157s || || Без патча ya m -r --ext-py | real 0m10,916s user 0m9,927s sys 0m0,368s || || C патчем ya m -r | real 0m2,931s user 0m2,774s sys 0m0,156s || || C патчем ya m -r --ext-py первый запуск с записью байткода | real 0m7,482s user 0m5,174s sys 0m0,620s || || C патчем ya m -r --ext-py последующие запуски с использованием байткода с фс | real 0m3,550s user 0m2,801s sys 0m0,262s || |# commit_hash:84f7bb273b09d51b88eb5c5b6dfcd3bb7c108307
* Prototype - external python files mode for testsprettyboy2025-01-161-9/+36
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Режим позволяет перезапускать python тесты или интеграционные тесты на питон программы при внесении изменений в python файлы без перекомпиляции. Сценарий: - прогнали тесты - внесли изменение в `library/python/func/__init__.py` - перезапустили, смотрим на времена На примере интеграционного devtools/ya/handlers/analyze_make/tests в codenv (base конфигурация). #| || ya m -rA | ya m -rA --ext-py || || real 10m25,928s user 0m53,465s sys 1m14,791s ``` Total time by type: [935171 ms] [LD] [count: 3, ave time 311723.67 msec] [ 13657 ms] [prepare:AC] [count: 4, ave time 3414.25 msec] [ 10436 ms] [TM] [count: 1, ave time 10436.00 msec] [ 10387 ms] [prepare:get from local cache] [count: 1521, ave time 6.83 msec] [ 6480 ms] [TS] [count: 1, ave time 6480.00 msec] [ 3823 ms] [prepare:put into local cache, clean build dir] [count: 7, ave time 546.14 msec] [ 2279 ms] [CC] [count: 1, ave time 2279.00 msec] [ 1251 ms] [PY] [count: 1, ave time 1251.00 msec] [ 372 ms] [prepare:yt-store] [count: 2, ave time 186.00 msec] [ 154 ms] [AR] [count: 1, ave time 154.00 msec] ... ``` | real 0m22,094s user 0m26,372s sys 0m3,363s ``` Total time by type: [13140 ms] [TM] [count: 1, ave time 13140.00 msec] [ 351 ms] [prepare:yt-store] [count: 1, ave time 351.00 msec] [ 81 ms] [prepare:tools] [count: 8, ave time 10.12 msec] [ 32 ms] [prepare:AC] [count: 2, ave time 16.00 msec] [ 31 ms] [prepare:get from local cache] [count: 7, ave time 4.43 msec] [ 16 ms] [prepare:clean] [count: 3, ave time 5.33 msec] ``` || |# В codenv в base конфигуарции (4cpu) невероятно долго идёт линковка. Тот же самый сценарий, но на mous (54cpu) #| || ya m -rA | ya m -rA --ext-py || || real 0m25,435s user 0m40,242s sys 0m22,434s ``` Total time by type: [30958 ms] [prepare:get from local cache] [count: 1521, ave time 20.35 msec] [16293 ms] [prepare:AC] [count: 4, ave time 4073.25 msec] [11161 ms] [LD] [count: 3, ave time 3720.33 msec] [ 4256 ms] [TM] [count: 1, ave time 4256.00 msec] [ 3529 ms] [TS] [count: 1, ave time 3529.00 msec] [ 1542 ms] [CC] [count: 1, ave time 1542.00 msec] [ 635 ms] [PY] [count: 1, ave time 635.00 msec] ... ``` | real 0m18,321s user 0m21,673s sys 0m3,204s ``` Total time by type: [10786 ms] [TM] [count: 1, ave time 10786.00 msec] [ 1568 ms] [prepare:yt-store] [count: 1, ave time 1568.00 msec] [ 151 ms] [prepare:tools] [count: 8, ave time 18.88 msec] [ 61 ms] [prepare:get from local cache] [count: 7, ave time 8.71 msec] [ 48 ms] [prepare:AC] [count: 2, ave time 24.00 msec] [ 14 ms] [prepare:clean] [count: 3, ave time 4.67 msec] ``` || |# В новом режиме тест ожидаемо замедляется, так как все питон программы при каждом старте вынуждены читать файлы с фс (ещё через арк), а потом ещё и компилировать байткод, т.е. холодный запуск commit_hash:24c5a46a8385d3c065abfb6fc5b40f7ad24bb1cb
* Simplify support `importlib.metadata`shadchin2024-04-131-0/+13
| | | | 996025a2ee725b626c3b77aac016d8f8c0ac4e76
* Probe bytes and str environment keysv-korovin2024-02-291-3/+18
| | | | 58bed0cef82a2a691f8f949d16c3d3b03d94f627
* Sync contrib/tools/python3 layout with upstreamthegeorg2024-02-191-1/+1
| | | | | | | * Move src/ subdir contents to the top of the layout * Rename self-written lib -> lib2 to avoid CaseFolding warning from the VCS * Regenerate contrib/libs/python proxy-headers accordingly 4ccc62ac1511abcf0fed14ccade38e984e088f1e
* Rework joinpath for importlib.resourcesshadchin2024-02-091-7/+6
|
* Import libs 3 (#679)AlexSm2023-12-221-1/+2
|
* Support override `distutils` from `setuptools`shadchin2023-12-121-0/+26
|
* First implementation is `importlib.resources.files`shadchin2023-11-261-15/+14
|
* Python Import Tracingkuzmich3212023-11-241-2/+7
|
* Add import callbacks for import hookkuzmich3212023-11-221-1/+20
| | | | | | * typo-fix * add before and after import callbacks
* add ydb depsnkozlovskiy2023-09-291-0/+609
|
* fix ya.makemonster2022-07-071-584/+0
|
* YMAKE-148: Don't follow symlinkssay2022-05-171-2/+11
| | | | ref:b200b70556036c6a735ab81b1414c4b334ba5958
* YMAKE-144: Fix RuntimeError: dictionary changed size during iterationsay2022-05-141-2/+6
| | | | ref:919db9913468e91d031bbd511beeacdcfdd74489
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.roboslone2022-02-101-1/+1
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.roboslone2022-02-101-1/+1
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.viknet2022-02-101-20/+20
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.viknet2022-02-101-20/+20
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.say2022-02-101-214/+214
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.say2022-02-101-214/+214
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.abodrov2022-02-101-5/+5
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.abodrov2022-02-101-5/+5
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.spreis2022-02-101-10/+10
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.spreis2022-02-101-10/+10
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.deshevoy2022-02-101-27/+27
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.deshevoy2022-02-101-27/+27
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.dvshkurko2022-02-101-1/+1
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.dvshkurko2022-02-101-1/+1
|
* Restoring authorship annotation for Mikhail Borisov ↵Mikhail Borisov2022-02-101-21/+21
| | | | <[email protected]>. Commit 2 of 2.
* Restoring authorship annotation for Mikhail Borisov ↵Mikhail Borisov2022-02-101-21/+21
| | | | <[email protected]>. Commit 1 of 2.
* Restoring authorship annotation for Anton Samokhvalov <[email protected]>. ↵Anton Samokhvalov2022-02-101-27/+27
| | | | Commit 2 of 2.
* Restoring authorship annotation for Anton Samokhvalov <[email protected]>. ↵Anton Samokhvalov2022-02-101-27/+27
| | | | Commit 1 of 2.
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.orivej2022-02-101-193/+193
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.orivej2022-02-101-193/+193
|
* Restoring authorship annotation for <[email protected]>. Commit 2 of 2.shadchin2022-02-101-51/+51
|
* Restoring authorship annotation for <[email protected]>. Commit 1 of 2.shadchin2022-02-101-51/+51
|
* intermediate changesDevtools Arcadia2022-02-071-0/+571
ref:cde9a383711a11544ce7e107a78147fb96cc4029
generated by cgit v1.3 (git 2.53.0) at 2026-07-28 18:03:21 +0000