summaryrefslogtreecommitdiffhomepage
path: root/src (follow)
AgeCommit message (Collapse)AuthorFilesLines
2020-08-25HTTP/3: drop the unwanted remainder of the request.Roman Arutyunyan2-0/+13
As per HTTP/3 draft 29, section 4.1: When the server does not need to receive the remainder of the request, it MAY abort reading the request stream, send a complete response, and cleanly close the sending part of the stream.
2020-08-25QUIC: send STOP_SENDING on stream closure.Roman Arutyunyan2-0/+49
The frame is sent for a read-enabled stream which has not received a FIN or RESET_STREAM.
2020-08-21QUIC: disabled bidirectional SSL shutdown after 09fb2135a589.Sergey Kandaurov1-0/+1
On QUIC connections, SSL_shutdown() is used to call the send_alert callback to send a CONNECTION_CLOSE frame. The reverse side is handled by other means. At least BoringSSL doesn't differentiate whether this is a QUIC SSL method, so waiting for the peer's close_notify alert should be explicitly disabled.
2020-08-21QUIC: stripped down debug traces that have served its purpose.Sergey Kandaurov3-63/+4
The most observable remainers are incoming packet and stream payload that could still be useful to debug various QUIC and HTTP/3 frames.
2020-08-21QUIC: dead code removed.Vladimir Homutov1-8/+0
This case was already handled in c70446e3d771.
2020-08-20QUIC: removed outdated TODOs.Vladimir Homutov1-3/+0
The logical quic connection state is tested by handler functions that process corresponding types of packets (initial/handshake/application). The packet is declined if state is incorrect. No timeout is required for the input queue.
2020-08-20QUIC: added version negotiation support.Vladimir Homutov3-8/+102
If a client attemtps to start a new connection with unsupported version, a version negotiation packet is sent that contains a list of supported versions (currently this is a single version, selected at compile time).
2020-08-20HTTP/3: special handling of client errors in the upstream module.Roman Arutyunyan1-0/+13
The function ngx_http_upstream_check_broken_connection() terminates the HTTP/1 request if client sends eof. For QUIC (including HTTP/3) the c->write->error flag is now checked instead. This flag is set when the entire QUIC connection is closed or STOP_SENDING was received from client.
2020-08-18HTTP/3: request more client body bytes.Roman Arutyunyan1-6/+0
Previously the request body DATA frame header was read by one byte because filters were called only when the requested number of bytes were read. Now, after 08ff2e10ae92 (1.19.2), filters are called after each read. More bytes can be read at once, which simplifies and optimizes the code. This also reduces diff with the default branch.
2020-08-19QUIC: fixed format specifiers.Sergey Kandaurov1-2/+2
2020-08-19QUIC: changed c->quic->pto_count type to ngx_uint_t.Sergey Kandaurov1-1/+1
This field is served as a simple counter for PTO backoff.
2020-08-19QUIC: do not artificially delay sending queued frames.Sergey Kandaurov2-19/+1
This interacts badly with retransmissions of lost packets and can provoke spurious client retransmits.
2020-08-19QUIC: do not arm loss detection timer on packet threshold.Sergey Kandaurov1-4/+4
2020-08-19QUIC: do not arm loss detection timer for succeeding packets.Sergey Kandaurov1-4/+9
2020-08-19QUIC: handling packets with send time equal to lost send time.Sergey Kandaurov1-1/+1
Previously, such packets weren't handled as the resulting zero remaining time prevented setting the loss detection timer, which, instead, could be disarmed. For implementation details, see quic-recovery draft 29, appendix A.10.
2020-08-19QUIC: sending probe packets on PTO timer expiration.Sergey Kandaurov1-59/+109
The PTO handler is split into separate PTO and loss detection handlers that operate interchangeably depending on which timer should be set. The present ngx_quic_lost_handler is now only used for packet loss detection. It replaces ngx_quic_pto_handler if there are packets preceeding largest_ack. Once there is no more such packets, ngx_quic_pto_handler is installed again. Probes carry unacknowledged data previously sent in the oldest packet number, one per each packet number space. That is, it could be up to two probes. PTO backoff is now increased before scheduling next probes.
2020-08-18QUIC: changed ctx->largest_ack initial value to type maximum.Sergey Kandaurov1-1/+2
In particular, this prevents declaring packet number 0 as lost if there aren't yet any acknowledgements in this packet number space. For example, only Initial packets were acknowledged in handshake.
2020-08-18HTTP/3: fixed context storage in request body parser.Sergey Kandaurov1-1/+1
2020-08-18Merged with the default branch.Roman Arutyunyan13-111/+282
2020-08-18QUIC: coalesce neighbouring stream send buffers.Roman Arutyunyan1-110/+166
Previously a single STREAM frame was created for each buffer in stream output chain which is wasteful with respect to memory. The following changes were made in the stream send code: - ngx_quic_stream_send_chain() no longer calls ngx_quic_stream_send() and got a separate implementation that coalesces neighbouring buffers into a single frame - the new ngx_quic_stream_send_chain() respects the limit argument, which fixes sendfile_max_chunk and limit_rate - ngx_quic_stream_send() is reimplemented to call ngx_quic_stream_send_chain() - stream frame size limit is moved out to a separate function ngx_quic_max_stream_frame() - flow control is moved out to a separate function ngx_quic_max_stream_flow() - ngx_quic_stream_send_chain() is relocated next to ngx_quic_stream_send()
2020-08-14QUIC: packet based bytes_in_flight accounting.Sergey Kandaurov2-9/+30
A packet size is kept in one of the frames belonging to the packet.
2020-08-14QUIC: fixed leak of bytes_in_flight on keys discard.Sergey Kandaurov1-2/+21
This applies to discarding Initial and Handshake keys.
2020-08-14QUIC: fixed leak of bytes_in_flight attributed to lost packets.Sergey Kandaurov1-0/+1
2020-08-10Core: reusing connections in advance.Maxim Dounin1-6/+5
Reworked connections reuse, so closing connections is attempted in advance, as long as number of free connections is less than 1/16 of worker connections configured. This ensures that new connections can be handled even if closing a reusable connection requires some time, for example, for a lingering close (ticket #2017). The 1/16 ratio is selected to be smaller than 1/8 used for disabling accept when working with accept mutex, so nginx will try to balance new connections to different workers first, and will start reusing connections only if this won't help.
2020-08-10Core: added a warning about reusing connections.Maxim Dounin2-0/+14
Previously, reusing connections happened silently and was only visible in monitoring systems. This was shown to be not very user-friendly, and administrators often didn't realize there were too few connections available to withstand the load, and configured timeouts (keepalive_timeout and http2_idle_timeout) were effectively reduced to keep things running. To provide at least some information about this, a warning is now logged (at most once per second, to avoid flooding the logs).
2020-08-10SSL: disabled sending shutdown after ngx_http_test_reading().Maxim Dounin1-0/+6
Sending shutdown when ngx_http_test_reading() detects the connection is closed can result in "SSL_shutdown() failed (SSL: ... bad write retry)" critical log messages if there are blocked writes. Fix is to avoid sending shutdown via the c->ssl->no_send_shutdown flag, similarly to how it is done in ngx_http_keepalive_handler() for kqueue when pending EOF is detected. Reported by Jan Prachaƙ (http://mailman.nginx.org/pipermail/nginx-devel/2018-December/011702.html).
2020-08-10HTTP/2: fixed c->timedout flag on timed out connections.Maxim Dounin1-0/+1
Without the flag, SSL shutdown is attempted on such connections, resulting in useless work and/or bogus "SSL_shutdown() failed (SSL: ... bad write retry)" critical log messages if there are blocked writes.
2020-08-10SSL: fixed shutdown handling.Maxim Dounin1-31/+48
Previously, bidirectional shutdown never worked, due to two issues in the code: 1. The code only tested SSL_ERROR_WANT_READ and SSL_ERROR_WANT_WRITE when there was an error in the error queue, which cannot happen. The bug was introduced in an attempt to fix unexpected error logging as reported with OpenSSL 0.9.8g (http://mailman.nginx.org/pipermail/nginx/2008-January/003084.html). 2. The code never called SSL_shutdown() for the second time to wait for the peer's close_notify alert. This change fixes both issues. Note that after this change bidirectional shutdown is expected to work for the first time, so c->ssl->no_wait_shutdown now makes a difference. This is not a problem for HTTP code which always uses c->ssl->no_wait_shutdown, but might be a problem for stream and mail code, as well as 3rd party modules. To minimize the effect of the change, the timeout, which was used to be 30 seconds and not configurable, though never actually used, is now set to 3 seconds. It is also expanded to apply to both SSL_ERROR_WANT_READ and SSL_ERROR_WANT_WRITE, so timeout is properly set if writing to the socket buffer is not possible.
2020-08-06Request body: optimized handling of small chunks.Maxim Dounin1-0/+25
If there is a previous buffer, copy small chunks into it instead of allocating additional buffer.
2020-08-06Request body: allowed large reads on chunk boundaries.Maxim Dounin1-8/+113
If some additional data from a pipelined request happens to be read into the body buffer, we copy it to r->header_in or allocate an additional large client header buffer for it.
2020-08-06Request body: all read data are now sent to filters.Maxim Dounin1-43/+10
This is a prerequisite for the next change to allow large reads on chunk boundaries.
2020-08-06Added size check to ngx_http_alloc_large_header_buffer().Maxim Dounin1-0/+6
This ensures that copying won't write more than the buffer size even if the buffer comes from hc->free and it is smaller than the large client header buffer size in the virtual host configuration. This might happen if size of large client header buffers is different in name-based virtual hosts, similarly to the problem with number of buffers fixed in 6926:e662cbf1b932.
2020-08-03QUIC: handle client RESET_STREAM and STOP_SENDING.Roman Arutyunyan1-10/+65
For RESET_STREAM the c->read->error flag is set. For STOP_SENDING the c->write->error flag is set.
2020-08-11QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA.Roman Arutyunyan1-91/+144
Creating client-initiated streams is moved from ngx_quic_handle_stream_frame() to a separate function ngx_quic_create_client_stream(). This function is responsible for creating streams with lower ids as well. Also, simplified and fixed initial data buffering in ngx_quic_handle_stream_frame(). It is now done before calling the initial handler as the handler can destroy the stream.
2020-08-11QUIC: fixed ngx_http_test_reading() for QUIC streams.Roman Arutyunyan2-3/+26
Previously this function generated an error trying to figure out if client shut down the write end of the connection. The reason for this error was that a QUIC stream has no socket descriptor. However checking for eof is not the right thing to do for an HTTP/3 QUIC stream since HTTP/3 clients are expected to shut down the write end of the stream after sending the request. Now the function handles QUIC streams separately. It checks if c->read->error is set. The error flags for c->read and c->write are now set for all streams when closing the QUIC connection instead of setting the pending_eof flag.
2020-08-07QUIC: fixed ACK Ranges processing.Sergey Kandaurov1-7/+10
According to quic-transport draft 29, section 19.3.1: The value of the Gap field establishes the largest packet number value for the subsequent ACK Range using the following formula: largest = previous_smallest - gap - 2 Thus, given a largest packet number for the range, the smallest value is determined by the formula: smallest = largest - ack_range While here, changed min/max to uint64_t for consistency.
2020-08-07QUIC: fixed possible use-after-free on stream cleanup.Sergey Kandaurov1-1/+3
A QUIC stream could be destroyed by handler while in ngx_quic_stream_input(). To detect this, ngx_quic_find_stream() is used to check that it still exists. Previously, a stream id was passed to this routine off the frame structure. In case of stream cleanup, it is freed along with other frames belonging to the stream on cleanup. Then, a cleanup handler reuses last frames to update MAX_STREAMS and serve other purpose. Thus, ngx_quic_find_stream() is passed a reused frame with zeroed out part pointed by stream_id. If a stream with id 0x0 still exists, this leads to use-after-free.
2020-07-28QUIC: fixed format specifiers and removed casts.Sergey Kandaurov1-8/+8
2020-07-28QUIC: consistent Stream ID logging format.Sergey Kandaurov2-9/+11
2020-07-27FastCGI: fixed zero size buf alerts on extra data (ticket #2018).Maxim Dounin1-6/+22
After 05e42236e95b (1.19.1) responses with extra data might result in zero size buffers being generated and "zero size buf" alerts in writer (if f->rest happened to be 0 when processing additional stdout data).
2020-07-27Core: enclosed parameters of the ngx_buf.h macros in parentheses.balus1-10/+10
2020-07-23OCSP: fixed certificate reference leak.Sergey Kandaurov1-0/+9
2020-07-23HTTP/3: server pushes.Roman Arutyunyan7-13/+1020
New directives are added: - http3_max_concurrent_pushes - http3_push - http3_push_preload
2020-07-27QUIC: limited the number of client-initiated streams.Roman Arutyunyan1-92/+85
The limits on active bidi and uni client streams are maintained at their initial values initial_max_streams_bidi and initial_max_streams_uni by sending a MAX_STREAMS frame upon each client stream closure. Also, the following is changed for data arriving to non-existing streams: - if a stream was already closed, such data is ignored - when creating a new stream, all streams of the same type with lower ids are created too
2020-07-27QUIC: limited the number of server-initiated streams.Roman Arutyunyan3-26/+111
Also, ngx_quic_create_uni_stream() is replaced with ngx_quic_open_stream() which is capable of creating a bidi stream.
2020-07-22Xslt: disabled ranges.Roman Arutyunyan1-0/+1
Previously, the document generated by the xslt filter was always fully sent to client even if a range was requested and response status was 206 with appropriate Content-Range. The xslt module is unable to serve a range because of suspending the header filter chain. By the moment full response xml is buffered by the xslt filter, range header filter is not called yet, but the range body filter has already been called and did nothing. The fix is to disable ranges by resetting the r->allow_ranges flag much like the image filter that employs a similar technique.
2020-07-21Core: close PID file when writing fails.Ruslan Ermilov1-2/+5
Reported by Jinhua Tan.
2020-07-14HTTP/3: support $server_protocol variable.Roman Arutyunyan3-4/+6
Now it holds "HTTP/3.0". Previously it was empty.
2020-07-23Style: moved function declarations to match usual code style.Roman Arutyunyan1-11/+9
Plus a few other minor style changes.
2020-07-23HTTP/3: renamed server configuration variables from v3cf to h3scf.Roman Arutyunyan4-26/+26
Now they are similar to HTTP/2 where they are called h2scf.