summaryrefslogtreecommitdiffstats
path: root/build/scripts
Commit message (Collapse)AuthorAgeFilesLines
* move classpath related args into response filesvidyuk36 hours1-6/+3
| | | | | | classpath length is proportional to a number of a project transitive dependencies and is not limited by any reasonable upper bound. commit_hash:d9f3eb9016298ce371b2c632e70e78d60f7b3ee7
* Disable Java Annotation Processing by defaultdimdim118 days2-6/+7
| | | | commit_hash:b1d2bd3f39ea9039fb7bd70d18f20ff7cad737d2
* Use Local=False mode for make coverage datadimdim1111 days1-4/+21
| | | | | Use Local=False mode for make coverage data commit_hash:9ec3fd45232a4960081116b45a4e9bd8667ef5e1
* Implement PARALLEL_TESTS_WITHIN_NODE for javaayevttukh11 days1-0/+6
| | | | commit_hash:68b519ca14bc9c0656b7e38db569a04aca127e65
* remap -Xfriend-paths to interface jar when ijar is activeiniklyaev14 days1-0/+19
| | | | | | | | | | | | | When ijar compilation is active, the classpath contains X-interface.jar instead of X.jar. Kotlin only grants 'internal' visibility access via -Xfriend-paths when the specified path matches a classpath entry. Fix: in run_javac.py, for Kotlin compilations, rewrite any -Xfriend-paths=X.jar argument to -Xfriend-paths=X-interface.jar when X-interface.jar exists on disk. This restores access to 'internal' members for test modules that use -Xfriend-paths without requiring changes to user ya.make files. commit_hash:a11a6acd8994258a32090a71de9a55d5aeccc5dd
* Fix Windows go_tool.py linking + smoke testzienag2026-05-251-2/+15
| | | | | | | | | | | | | | | | | | Фикс go_tool.py + тест. go_tool.py пишет аргументы линкера в response file и зовёт `go link @file`. Линкер парсит файл через cmd/internal/objabi.DecodeArg, который трактует `\` как начало эскейпа и падает ("badly formatted input") на всём кроме `\\` и `\n`. На Windows-хосте пути вида `C:\place\...\main.a` валят сборку любой GO_PROGRAM. Фикс: писать аргументы через аналог Go EncodeArg (`\` → `\\`, `\n` → `\n`) и открывать tempfile с newline='\n', чтобы текстовый режим Python не подменял переводы строк на CRLF. Добавлен build/tests/scripts/go_win_smoke — крошечный GO_PROGRAM и PY3TEST, которые гоняются под common/arcadia/ya_make_windows на нативном Windows. commit_hash:ef8abe298a65d1cf1c1463a16f937a31db2b6fb2
* Tests for Go SSO script and minor fixes in go SSOdimdim112026-05-151-3/+12
| | | | | | Refactor tests and some fixes in Go SSO Tests for Go SSO script commit_hash:31a766a749be2a9ca05bbca314a2f159c2b6507d
* Fix clang analyzer after enabling debug section zstd compressionsvidyuk2026-05-141-0/+2
| | | | commit_hash:10a3174bd909631074d85243caff1e54ec53b646
* Support any one package name for Go 1.25 coveragedimdim112026-05-141-16/+32
| | | | | Support any one package name for Go 1.25 coverage commit_hash:c2c5ba2c3b4e18dddf4518abaf6dec045ef8c3cf
* feat all: use zstd compression of debug symbols on Linuxantoshkka2026-05-141-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | File sizes: ``` -g 910385468 Jan 1 1970 libyt-yt-client.a -g -gz 589148980 May 6 12:16 libyt-yt-client.a -g -gz=zstd 585019668 May 6 12:34 libyt-yt-client.a -g -gz=zstd 1674173480 May 6 13:27 drive-billing-exports -g -gz=zstd -Wl,--compress-debug-sections=zstd 899287344 May 6 14:00 drive-billing-exports ``` Mesured compile+link times with the following script: ``` arc checkout . sed -i "s/${SERVICE_NAME}/${SERVICE_NAME}_${I}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}/g" src/custom/dependencies.cpp OUTPUT=$(~/workspace/arcadia/ya make --stat 2>&1) echo "$OUTPUT" | grep -om1 "^\[.* \[LD\] .*${SERVICE_NAME}/${SERVICE_NAME}" >>ld.txt echo "$OUTPUT" | grep -om1 "^\[.* \[CC\] .*${SERVICE_NAME}/src/custom/dependencies.cpp" >>cc.txt echo "$OUTPUT" >>full.txt ``` Trunk times in milliseconds: CC: 8944 8405 8117 11203 19236 11660 9149 24319 21236 14753 25508 28099 9226 31387 9555 11268 9088 10640 13751 8855 11266 9141 8168 8712 11111 10235 28576 8996 9362 8973 9055 9822 LD: 5956 9394 15380 9055 7089 7308 15433 12948 14123 5524 4808 10559 6837 4906 18253 5208 16335 7493 5180 47220 12491 21603 34733 4432 5353 8633 4732 25937 19158 24316 5825 7357 ZSTD times in milliseconds: CC: 10180 8017 13135 8569 16033 17698 12524 8442 12902 7797 20236 7857 14715 8096 8541 9232 10839 8989 8988 17173 8211 8737 22424 8139 23770 8622 13765 12744 8204 23573 8358 8123 9091 18869 LD: 6125 5914 6975 21408 15227 7309 6401 13417 8862 24954 5509 33813 6207 5571 15423 5716 5807 6352 16953 6064 22793 14156 7203 10811 6287 15363 6259 5897 25905 5400 20217 5624 17351 6593 ``` | CC min | CC median | CC max | CC avg | LD min | LD median | LD max | LD avg ------|--------|-----------|--------|--------|--------|-----------|--------|------- Trunk | 8117 | 9822 | 31387 | 13369 | 4432 | 8633 | 47220 | 12612 ZSTD | 7797 | 9091 | 23770 | 12135 | 5400 | 6975 | 33813 | 11584 ``` **Compilation time and linking time drop down on ~10%** **Conclusion**: archive and binary sizes drop down on 33%-45%. As a result: * OS FS cache works better, less files required for compilation are flushed out from memory * linking touches smaller files and works faster * compilation produces smaller files and does less slow disk IO commit_hash:6053e4fe15a64966bd96c99dbc7a068c3a2cc0e7
* Fix unused _cover_xtest importborinskikh2026-05-121-1/+5
| | | | commit_hash:5fb76d5479c4990d9c9a2876f9e5753820f32ed1
* Revert "feat all: use zstd compression"antoshkka2026-05-101-2/+0
| | | | | | This reverts commit bebcd6cedb271b14b7d771d50924c005ab9375bf, reversing changes made to 700c24e95953f7be1a6c425a35dbf7d41492469a. commit_hash:e14a9ef12e284a3ba034063c3c03b0d57323e574
* feat all: use zstd compressionantoshkka2026-05-091-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | File sizes: ``` -g 910385468 Jan 1 1970 libyt-yt-client.a -g -gz 589148980 May 6 12:16 libyt-yt-client.a -g -gz=zstd 585019668 May 6 12:34 libyt-yt-client.a -g -gz=zstd 1674173480 May 6 13:27 drive-billing-exports -g -gz=zstd -Wl,--compress-debug-sections=zstd 899287344 May 6 14:00 drive-billing-exports ``` Mesured compile+link times with the following script: ``` arc checkout . sed -i "s/${SERVICE_NAME}/${SERVICE_NAME}_${I}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}_${RANDOM}/g" src/custom/dependencies.cpp OUTPUT=$(~/workspace/arcadia/ya make --stat 2>&1) echo "$OUTPUT" | grep -om1 "^\[.* \[LD\] .*${SERVICE_NAME}/${SERVICE_NAME}" >>ld.txt echo "$OUTPUT" | grep -om1 "^\[.* \[CC\] .*${SERVICE_NAME}/src/custom/dependencies.cpp" >>cc.txt echo "$OUTPUT" >>full.txt ``` Trunk times in milliseconds: CC: 8944 8405 8117 11203 19236 11660 9149 24319 21236 14753 25508 28099 9226 31387 9555 11268 9088 10640 13751 8855 11266 9141 8168 8712 11111 10235 28576 8996 9362 8973 9055 9822 LD: 5956 9394 15380 9055 7089 7308 15433 12948 14123 5524 4808 10559 6837 4906 18253 5208 16335 7493 5180 47220 12491 21603 34733 4432 5353 8633 4732 25937 19158 24316 5825 7357 ZSTD times in milliseconds: CC: 10180 8017 13135 8569 16033 17698 12524 8442 12902 7797 20236 7857 14715 8096 8541 9232 10839 8989 8988 17173 8211 8737 22424 8139 23770 8622 13765 12744 8204 23573 8358 8123 9091 18869 LD: 6125 5914 6975 21408 15227 7309 6401 13417 8862 24954 5509 33813 6207 5571 15423 5716 5807 6352 16953 6064 22793 14156 7203 10811 6287 15363 6259 5897 25905 5400 20217 5624 17351 6593 ``` | CC min | CC median | CC max | CC avg | LD min | LD median | LD max | LD avg ------|--------|-----------|--------|--------|--------|-----------|--------|------- Trunk | 8117 | 9822 | 31387 | 13369 | 4432 | 8633 | 47220 | 12612 ZSTD | 7797 | 9091 | 23770 | 12135 | 5400 | 6975 | 33813 | 11584 ``` **Compilation time and linking time drop down on ~10%** **Conclusion**: archive and binary sizes drop down on 33%-45%. As a result: * OS FS cache works better, less files required for compilation are flushed out from memory * linking touches smaller files and works faster * compilation produces smaller files and does less slow disk IO commit_hash:bebcd6cedb271b14b7d771d50924c005ab9375bf
* поправить скрипт распаковки output.tarbaymer2026-05-061-10/+20
| | | | | | | | | | | | | | | | | <section id="quibbler-autodescription"> #### Исправление скрипта распаковки tar-архива 📝 - 🛠️ Обновлён механизм распаковки tar-архива с использованием встроенного модуля `tarfile` в качестве резервного варианта, если системная команда `tar` недоступна. - 🧪 Добавлена проверка исполняемости команды `tar` перед её использованием, обеспечивая более надёжную работу скрипта. - 📦 Изменена логика работы с архивами: теперь поддерживается распаковка как через системную утилиту, так и через Python-модуль, что повышает совместимость. - 📁 Упрощён код основной функции, вынесена логика распаковки в отдельную функцию `unpack_dir` для лучшей читаемости и поддержки. - 📦 Обновлены параметры сборки: изменён формат архива с `.tar.gz` на `.tar.zst` и добавлен параметр сжатия `zstd`. - 🔄 Исправлен путь к скрипту распаковки в конфигурации сборки, теперь он указывает на актуальное расположение файла. <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> </section> commit_hash:b2b7d3aa3bb8543aae5627c43536c1bfca5a9cfe
* Добавить скрипт для распаковки output.tar под ↵baymer2026-05-051-0/+48
| | | | | | ya package commit_hash:61c6668829d1d4a00cae6e046cacdc31496010e3
* do not try to run compiler without sources.svidyuk2026-04-241-0/+3
| | | | | Print human readable description instead of misleading compiler help message. commit_hash:78aa6c12f5a3b88535805f3dc5f39565c1295493
* Support Go 1.25 coverage in configure under disabled feature flagdimdim112026-04-133-63/+395
| | | | commit_hash:8c93eea4565075c47db3532653529ae3b7a76e40
* response file for go program linkingvpozdyayev2026-04-092-3/+12
| | | | commit_hash:9d59413e4935e2c5b33c1a84bf6244c151fe16e7
* Use clang18 for BPFmikhnenko2026-03-261-2/+12
| | | | | | | | | | | | | #### Обновление clang до версии 18 и оптимизация фильтрации флагов для BPF 📝 - 🛠️ Обновлен инструмент компиляции с clang14 на clang18 для генерации eBPF-кода - 🧹 Удалены дублирующиеся флаги целевой архитектуры при сборке BPF-модулей - 📦 Оптимизирован фильтр флагов компилятора для исключения STL-заголовков в BPF-сборке - 📝 Удалены устаревшие флаги `-march=bpf`, так как они больше не требуются при использовании clang18 - 🧪 Уточнена конфигурация оптимизаций для BPF-модулей, включая флаги `-mcpu=v3` и `-O2` <a href="https://nda.ya.ru/t/qa0kX64r7DqvtN"><font size="2">Autodescription by Yandex Code Assistant</font></a> commit_hash:e4e0178f359b52d5961185edf15ec8a8648765e4
* Build bpf with clang14mikhnenko2026-03-251-3/+0
| | | | commit_hash:35714ea1cb62649a0482502ac3bf0912803e1ad6
* Use clang20 for bpfmikhnenko2026-03-241-2/+5
| | | | commit_hash:3b3a73c72b12bf59c5ff009a535b93abadb1f96a
* Fix after rXXXXXXshadchin2026-03-071-1/+0
| | | | commit_hash:ef7b604b707e213dbd9fbaf1cc1e7c4cbd7c4f4c
* ya tool black release 8robot-contrib2026-03-0733-75/+37
| | | | | #| || **<a href="https://nda.ya.ru/t/NmXL8DSH7W8pjd" target="_blank">![](https://nda.ya.ru/t/mAiQIjHx7Mm3JC =30x) Echo tests</a>** || |# commit_hash:595f1e5ce2f0b1215088b7c8d2b79f07955f9a4b
* Support building go_std for wasip1+wasmmikhnenko2026-02-201-2/+2
| | | | | | | | | | Тестировалось так: ``` mikhnenko@jakku:~/arcadia$ ya m devtools/dummy_arcadia/hello_go --target-platform=default-emscripten-wasm32 --sandboxing mikhnenko@jakku:~/arcadia$ wasmtime devtools/dummy_arcadia/hello_go/hello_go Hello, World! ``` commit_hash:95b3a3c437b7d0a64994c6b9aed97a1cc5ee8561
* create sanitizer toolchains with CUDAabityugov2026-02-161-3/+7
| | | | | Добавляю тулчейны asan и msan, собранные с CUDA commit_hash:3731067c580fc1343521a3a08cccbfb363f12ce2
* Enable lrodata resource insertionnechda2026-02-131-1/+1
| | | | commit_hash:e50a07bf54f78e9b26e88619aacf9ae76f68575b
* Insert large resources into lrodata (objcopy part)nechda2026-02-101-4/+25
| | | | commit_hash:24bf692e9b505b74d0b3cc7257a8ccb77c84ca64
* [build] cuda: Add .module_id sanity check to CUDA_SRCSdeshevoy2026-02-021-0/+11
| | | | | | | IDs generated by different cicc invocations should match ISSUE: commit_hash:7cd593cee44b31875e7166709d7614dcfa3f1f14
* [build] cuda: Introduce CUDA_SRCS macro utilizing parallelized device code ↵deshevoy2026-02-012-6/+30
| | | | | | | | | | | | | | | | compilation Instead of a single graph node launching NVCC to compile .cu for both host and all device architectures CUDA_SRCS generates multiple nodes: - node per each device architecture producing PTX and CUBIN - node merging all PTX and CUBIN files into a single FATBIN blob - node producing .cpp with host code - node compiling host .cpp with embedded FATBIN blob CUDA_ARCHITECTURES variable is used to determine the list of architectures to compile device code for. ISSUE: commit_hash:0a4c2797dd238ae062482af30694df6978301278
* Fix 'Argument list too long'say2026-01-152-2/+7
| | | | commit_hash:42cbe679894a95a825348d1af0e50bac0c87a7eb
* Split py3cc into slow & fastnechda2025-12-011-1/+2
| | | | commit_hash:d23fab7a0d429fff427da7d877e63fc4eee2ed4f
* DOCSBOOK is final target again; additional output preprocessed.tar.gz for ↵snermolaev2025-11-201-14/+2
| | | | | | DOCSBOOK commit_hash:5a3ad292b315b6435b4929ce2a5dfe5f9ffed7cf
* Mach-o objcopy resource insertion support (preparation only)nechda2025-11-181-35/+76
| | | | commit_hash:c8efa31c9cc0e080a87437782707506a75fbf48c
* docs.manifestsnermolaev2025-11-122-0/+114
| | | | commit_hash:650c7d56fe7044ca181cce3e6feac7b7f28b4e41
* Migrate to py3 java related scriptsnechda2025-11-082-3/+16
| | | | commit_hash:8bb7796dc00308eff1ba80875b36a09d2c23b366
* Migrate to py3 clang-tidy scriptsnechda2025-11-051-7/+17
| | | | commit_hash:a56e54a5e36856311957f70412a32eaab769532e
* Migrate wine & dsymutil to py3nechda2025-11-042-54/+55
| | | | commit_hash:6cec762a041602a74dce5a4c6c3828f032b4344f
* betterpg2025-10-291-1/+0
| | | | commit_hash:044bb76cacea25d38a1939236f98aa8e3d6b4def
* Migrate compile_cuda to py3 & use py2cc tools instead of scriptnechda2025-10-273-28/+2
| | | | commit_hash:3dfdf668eac73d56b978a7204a9de9976b59d763
* Refactor setup base Error Prone checks.nogert2025-10-231-12/+8
| | | | commit_hash:cc348cd44c4c6d2b32ccc6b36ee7210ac4585c54
* BUNDLE_OUTPUT macro for additional modules outputssnermolaev2025-10-212-0/+45
| | | | commit_hash:917e243f0ac57950881b0a52d975499ca0ed323f
* Use text output in check_outputnechda2025-10-201-1/+1
| | | | commit_hash:f944debcdcf04bf2cefe49621260f6ada3d4f68a
* More scripts py3 migrationnechda2025-10-202-2/+2
| | | | commit_hash:1a2377789930bc46d1b675e5efee76dd379cfc79
* [build][ya make] Go (1.24) for target-platform default-android-armv8agashamailov2025-10-171-1/+1
| | | | commit_hash:cbfbb9ac102550c76b7a7be979611fb28d7d92f8
* fix linters report for some build scriptssnermolaev2025-10-1012-28/+34
| | | | commit_hash:888d7a022d9df34de2db88254d47a466214ce963
* More scriptsnechda2025-10-081-0/+1
| | | | | | | | | | | | | | | | Migrated scripts: build/scripts/run\_tool.py build/scripts/yield\_line.py build/scripts/xargs.py build/scripts/f2c.py build/scripts/gen\_py\_reg.py build/scripts/gen\_py3\_reg.py build/scripts/configure\_file.py build/scripts/mkver.py build/scripts/symlink.py build/scripts/fetch\_from\_archive.py build/scripts/llvm\_opt\_wrapper.py commit_hash:6ae158c774ba30642a97b15dde78f7c2a539856f
* Import clang21-rt for NDK 29borman2025-10-081-1/+1
| | | | commit_hash:ed4caddc63014a5b74fd8dcfbd0929e49f914dab
* Bump CUDA_HOST_TOOLCHAINmikhnenko2025-10-071-0/+2
| | | | commit_hash:076fe96026b57c22a3f65ea7b482b7d880430570
* Untitled commitpg2025-10-011-0/+17
| | | | commit_hash:1df835645989214c763d35e0f22025e0c1418b75
* POC CUDA linkpg2025-09-303-3/+3
| | | | commit_hash:2cae8449b03db1757cf0f8cd7a226d806b1a4d91
generated by cgit v1.3 (git 2.53.0) at 2026-06-08 21:48:47 +0000