|  | Commit message (Collapse) | Author | Age | Files | Lines | 
|---|
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | 
| 
| 
| 
| 
| | ci: add comment posting to the pr with the test summary
Pull Request resolved: #353 | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | 
| 
| 
| 
| 
| | fix W605: Invalid escape sequence \\.
[fail] test.py::py3_flake8 [default-linux-x86_64-release] (0.00s) ydb/library/yql/tools/mrjob/test/test.py:24: [W605] invalid escape sequence '\.' | 
| | 
| 
| 
| | Passed counters and normalized lease updates. | 
| | |  | 
| | |  | 
| | |  | 
| | 
| 
| 
| | Sanitizers fix | 
| | |  | 
| | |  | 
| | 
| 
| 
| | Removed statistics and cost computation for EquiJoin | 
| | |  | 
| | |  | 
| | |  | 
| | 
| 
| 
| | Added secrets snapshot waiting timeout. | 
| | |  | 
| | |  | 
| | 
| 
| 
| 
| 
| 
| 
| 
| | From hash: [785893c161b89d2c9660deac25e627fe01389dbb](https://a.yandex-team.ru/arcadia/commit/785893c161b89d2c9660deac25e627fe01389dbb)
From revision: [12298702](https://a.yandex-team.ru/arcadia/commit/rXXXXXX)
[CI flow](https://a.yandex-team.ru/projects/ya_make/ci/releases/flow?dir=devtools%2Fya&id=release-ya-bin2-ya-bin3-tts&version=222)
Flow triggered by user: [prettyboy](https://staff.yandex-team.ru/prettyboy)
Update tools: ya_bin3, ya_bin, test_tool, test_tool3 | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | |  | 
| | 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| | With single poller thread on incoming connections, every OS scheduler latency on this thread wakeup directly affects requests timings. With oneshot poll events, we can poll on the same poller from many threads, and, if one thread has stalled for some reason, some other will take it's work on the next incoming event. So:
 - make vector of listener threads instead of single one;
 - add nListenerThreads option;
 - stop request queues and listening sockets from the last finished thread;
 - check incoming options and set OneShotPoll if needed.
There is a problem around removing connections on MaxConnections limit or ExpirationTimeout. There is no simple way to safely remove items from epoll (https://lwn.net/Articles/520012/) if it has raw pointers in event data. Try to handle it via postponed deletion of connection objects, wait until all listener threads are ready to reenter poller wait and there are no threads where deleted object can be used:
- close socket immediately after remove from poller, but instead of immediate TClientConnection destruction, put it to "pending delete" list;
 - add cleanup state with thread mask, each bit stating that corresponding thread should reenter poller;
- call Cleanup routine before each poller wait, it will switch to 0 current thread's bit for each pending connection;
- when thread mask becomes all zero, really delete the connection;
- force there is a timeout for poller wait, ensure that all threads do reenter;
- add more configurations for some tests.
There is no significant changes or overhead for standard case with single listener thread, cleanup and pending deletion are just skipped. Also there is no overhead for common case where removing connections is rare. Here is the same review with nListenerThreads = 4 by default https://a.yandex-team.ru/review/4413226. | 
| | 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| | Локально упавший тест выполняется
%%
vvvv@mr-nvme-testing-08:~/repo/arcadia/statbox/nile/tests/yql/py2/part_2$ arc checkout move_udf_test_and_refactor_tf
Switched to branch 'move_udf_test_and_refactor_tf'
vvvv@mr-nvme-testing-08:~/repo/arcadia/statbox/nile/tests/yql/py2/part_2$ ya make -tA -F '*test_unchanged_table*'
Warn[-WPluginErr]: in $B/statbox/nile/tests/yql/py2/part_2/libpy2-part_2.so: Requirement cpu is redefined 2 -> 4
Warn[-WPluginErr]: in $B/statbox/nile/tests/yql/py2/part_2/libpy2-part_2.so: Requirement ram is redefined 16 -> 9
Number of suites skipped by name: 2, by filter *test_unchanged_table*
Total 1 suite:
        1 - GOOD
Total 4 tests:
        4 - GOOD
Ok
%%
судя по ошибке он flaky | 
| | 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| | ```
/*
 * http://www.kurims.kyoto-u.ac.jp/~ooura/fft.html
 * Copyright Takuya OOURA, 1996-2001
 *
 * You may use, copy, modify and distribute this code for any purpose (include
 * commercial use) and without fee. Please refer to this package when you modify
 * this code.
 */
``` | 
| | |  | 
| | 
| 
| 
| | as-Clause additions | 
| | |  | 
| | 
| 
| 
| | Нужно заменить | 
| | |  | 
| | 
| 
| 
| | initial | 
| | 
| 
| 
| | Added typing support |