ydb/library/cpp/tld, branch 24.1.1Mirror of YDB github reposhttps://code.mastervirt.ru/ydb/atom?h=24.1.12024-01-31T11:23:59ZNew version of the tld SKIP_CHECK SKIP_REVIEW2024-01-31T11:23:59Zrobot-ratatoskrobot-ratatosk@yandex-team.com2024-01-28T13:13:30Zurn:sha1:273a1903865866db6b065e92527d19d3f51cd1a2New version of the tld SKIP_CHECK SKIP_REVIEW2024-01-26T17:49:15Zrobot-ratatoskrobot-ratatosk@yandex-team.com2024-01-25T14:37:36Zurn:sha1:8f02fda318bb8a50e1712350512d4cb82fff229bNew version of the tld SKIP_CHECK SKIP_REVIEW2024-01-24T12:02:11Zrobot-ratatoskrobot-ratatosk@yandex-team.com2024-01-23T13:58:21Zurn:sha1:f8ab4e37d44927a45eeeb13a2eb1947bb4b60befImport libs 4 (#758)2023-12-27T22:31:58ZAlexSmalex@ydb.tech2023-12-27T22:31:58Zurn:sha1:d67bfb4b4b7549081543e87a31bc6cb5c46ac973External build system generator release 652023-12-05T09:25:06Zrobot-ya-builderrobot-ya-builder@yandex-team.com2023-12-05T08:10:55Zurn:sha1:96458ea3c773a8a3edb707f73db0cdedbfcfad90
Update tools: yexport, os-yexport
add darwin-arm64 CMakeLists2023-11-20T11:34:20Zdcherednikdcherednik@ydb.tech2023-11-20T10:23:37Zurn:sha1:ffff7a34e41bf0dd7d5e0f3d78aeaebbf56200e6fix gen_tld.py on non-unicode locale encodings2023-06-28T14:27:42ZNikita Kozlovskiynikitka@gmail.com2023-06-28T14:27:42Zurn:sha1:61de4a67fa045e1281fb392df8cbfbcd890bc104
fix gen_tld.py on non-unicode locale encodings
In python versions prior to 3.7, as well as when using non-unicode locale encodings, the `gen_tld.py` script fails:
```
ydb/ydb/library/cpp/tld % git rev-parse head
97b1a695d3be4edc08550d3ae7d200f6d9f3d42e
ydb/ydb/library/cpp/tld % LC_CTYPE=C ~/.pyenv/versions/3.6.15/bin/python gen_tld.py tlds-alpha-by-domain.txt|md5
Traceback (most recent call last):
File "gen_tld.py", line 57, in <module>
main()
File "gen_tld.py", line 39, in main
sys.stdout.write('%s*/\n' % str.rstrip())
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-2: ordinal not in range(128)
```
This pull request fixes this behevaiour by explicit set output encoding to utf-8.
To ensure that I do not break anything, I checked the MD5 hash of the generated file before and after making my changes:
```
ydb/ydb/library/cpp/tld % git rev-parse head
97b1a695d3be4edc08550d3ae7d200f6d9f3d42e
ydb/ydb/library/cpp/tld % python3 gen_tld.py tlds-alpha-by-domain.txt|md5
564242d355d842db790977df3642a405
```
After
```
ydb/ydb/library/cpp/tld % git rev-parse head
1096dd7f034c573aabdf3bac2dc4b181a6688c71
ydb/ydb/library/cpp/tld % python3 gen_tld.py tlds-alpha-by-domain.txt|md5
564242d355d842db790977df3642a405
ydb/ydb/library/cpp/tld % LC_CTYPE=C ~/.pyenv/versions/3.6.15/bin/python gen_tld.py tlds-alpha-by-domain.txt|md5
564242d355d842db790977df3642a405
```
Pull Request resolved: #279add ymake export to ydb2023-06-13T08:05:01Zalexv-smirnovalex@ydb.tech2023-06-13T08:05:01Zurn:sha1:bf0f13dd39ee3e65092ba3572bb5b1fcd125dcd0External build system generator release 292023-04-19T11:10:48Zrobot-ya-builderrobot-ya-builder@yandex-team.com2023-04-19T11:10:48Zurn:sha1:887be65957040bac40fa22a2af242de88920eba7
Update tools: yexportRevert ymake build from ydb oss export2023-03-28T19:25:04Zalexv-smirnovalex@ydb.tech2023-03-28T19:25:04Zurn:sha1:b8a17f9b1c166d2e9a26b99348a4c29d972caf55