ydb/library/cpp/http/server, branch CLI_2.10.0Mirror of YDB github reposhttps://code.mastervirt.ru/ydb/atom?h=CLI_2.10.02024-06-05T00:57:22Z[kernel/server] [library/cpp/http/server] enable timeout for reading from socket by default2024-06-05T00:57:22Zilnurkhilnurkh@yandex-team.com2024-06-05T00:48:00Zurn:sha1:e16cc41459dc74c94769ca6b0693af2e4a86206a
анонс https://at.yandex-team.ru/clubs/arcadia/30286
77f0f6dfa6c3bc8c2a8428ecf91cd76b22bdb60e
Add THttpHeaders constructor from TArrayRef2024-04-16T06:47:02Zvadim-xdvadim-xd@yandex-team.com2024-04-16T06:38:35Zurn:sha1:ea11c4b61ef4e491c701847533ff93d3de81f127
351519c01d45a22beceb491029a8f516619673a0
DebugPrint for THttpServerOptions2024-04-10T06:57:42Zgous32gous32@yandex-team.com2024-04-10T06:48:27Zurn:sha1:1e986085fe84d3e9e16751d6bc590edba8b50b23
ddffb1ebbc56036902fc8b93aac08ff45a8ef547
feat contrib: aiogram 32024-01-19T10:10:03Zarmenqaarmenqa@yandex-team.com2024-01-19T09:23:50Zurn:sha1:2de0149d0151c514b22bca0760b95b26c9b0b578
Relates: https://st.yandex-team.ru/, https://st.yandex-team.ru/
Library import 7 (#937)2024-01-11T13:49:03ZAlexSmalex@ydb.tech2024-01-11T13:49:03Zurn:sha1:2e180154bd6a38b90a128ba0463d0dd2706a5ccfExternal build system generator release 652023-12-05T09:25:06Zrobot-ya-builderrobot-ya-builder@yandex-team.com2023-12-05T08:10:55Zurn:sha1:96458ea3c773a8a3edb707f73db0cdedbfcfad90
Update tools: yexport, os-yexport
add darwin-arm64 CMakeLists2023-11-20T11:34:20Zdcherednikdcherednik@ydb.tech2023-11-20T10:23:37Zurn:sha1:ffff7a34e41bf0dd7d5e0f3d78aeaebbf56200e6move version of SetContent2023-10-23T16:36:01Zaykeronaykeron@yandex-team.com2023-10-23T15:54:22Zurn:sha1:1d5fc29e2265eb3456c0b7db3f916b1095038dceПеренести проверку TTL до парсинга заголовков2023-09-11T19:13:09Zconterouzconterouz@yandex-team.com2023-09-11T18:51:16Zurn:sha1:6a7def716ee30ea697561451eb4a9a685c39c26bfinally, allow more than one listener thread2023-08-30T18:27:36Zkulikovkulikov@yandex-team.com2023-08-30T17:53:24Zurn:sha1:3f2ddee8b16d59a940bc71a44b6384e6382ad1a4
With single poller thread on incoming connections, every OS scheduler latency on this thread wakeup directly affects requests timings. With oneshot poll events, we can poll on the same poller from many threads, and, if one thread has stalled for some reason, some other will take it's work on the next incoming event. So:
- make vector of listener threads instead of single one;
- add nListenerThreads option;
- stop request queues and listening sockets from the last finished thread;
- check incoming options and set OneShotPoll if needed.
There is a problem around removing connections on MaxConnections limit or ExpirationTimeout. There is no simple way to safely remove items from epoll (https://lwn.net/Articles/520012/) if it has raw pointers in event data. Try to handle it via postponed deletion of connection objects, wait until all listener threads are ready to reenter poller wait and there are no threads where deleted object can be used:
- close socket immediately after remove from poller, but instead of immediate TClientConnection destruction, put it to "pending delete" list;
- add cleanup state with thread mask, each bit stating that corresponding thread should reenter poller;
- call Cleanup routine before each poller wait, it will switch to 0 current thread's bit for each pending connection;
- when thread mask becomes all zero, really delete the connection;
- force there is a timeout for poller wait, ensure that all threads do reenter;
- add more configurations for some tests.
There is no significant changes or overhead for standard case with single listener thread, cleanup and pending deletion are just skipped. Also there is no overhead for common case where removing connections is rare. Here is the same review with nListenerThreads = 4 by default https://a.yandex-team.ru/review/4413226.