Opened 6 years ago

Closed 5 years ago

#1798 closed defect (invalid)

Gateway timeout error when JSON Payload size > 1400 bytes and MTU size 9000

Reported by: kvijaykumareee@… Owned by:
Priority: major Milestone:
Component: nginx-package Version: 1.16.x
Keywords: Cc:
uname -a: Linux XX.XX.XXX.XXX.XXX 2.6.32-754.3.5.el6.x86_64 #1 SMP Thu Aug 9 11:56:22 EDT 2018 x86_64 GNU/Linux
nginx -V: nginx version: nginx/1.16.0
built by gcc 4.4.7 20120313 (Red Hat 4.4.7-23) (GCC)
built with OpenSSL 1.0.1e-fips 11 Feb 2013
TLS SNI support enabled
configure arguments: --with-http_stub_status_module --with-http_ssl_module --with-debug --with-cc-opt='-O0 -g'

Description

ifconfig
eth0 Link encap:Ethernet HWaddr 00:50:56:01:0A:66

inet addr:10.75.17.164 Bcast:10.75.17.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
RX packets:13669557 errors:0 dropped:0 overruns:0 frame:0
TX packets:18729875 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:12164509675 (11.3 GiB) TX bytes:50998168762 (47.4 GiB)

When the MTU size of eth0 interface is 9000 and the incoming JSON Payload size > 1400 bytes, the request is not submitted to nginx and the Client reset the connection post timeout
Giving below the nginx error.log which is captured in debug mode when the issue occurs

2019/06/25 17:10:59 [debug] 6803#0: epoll: fd:6 ev:0001 d:00007F9FC27AD010
2019/06/25 17:10:59 [debug] 6802#0: epoll: fd:6 ev:0001 d:00007F9FC27AD010
2019/06/25 17:10:59 [debug] 6801#0: epoll: fd:6 ev:0001 d:00007F9FC27AD010
2019/06/25 17:10:59 [debug] 6797#0: epoll: fd:6 ev:0001 d:00007F9FC27AD010
2019/06/25 17:10:59 [debug] 6803#0: accept on 0.0.0.0:9443, ready: 0
2019/06/25 17:10:59 [debug] 6804#0: epoll: fd:6 ev:0001 d:00007F9FC27AD010
2019/06/25 17:10:59 [debug] 6802#0: accept on 0.0.0.0:9443, ready: 0
2019/06/25 17:10:59 [debug] 6801#0: accept on 0.0.0.0:9443, ready: 0
2019/06/25 17:10:59 [debug] 6797#0: accept on 0.0.0.0:9443, ready: 0
2019/06/25 17:10:59 [debug] 6803#0: posix_memalign: 0000000001F90C10:512 @16
2019/06/25 17:10:59 [debug] 6802#0: accept() not ready (11: Resource temporarily unavailable)
2019/06/25 17:10:59 [debug] 6803#0: *4 accept: 10.56.189.27:50622 fd:13
2019/06/25 17:10:59 [debug] 6802#0: timer delta: 41209
2019/06/25 17:10:59 [debug] 6801#0: accept() not ready (11: Resource temporarily unavailable)
2019/06/25 17:10:59 [debug] 6797#0: accept() not ready (11: Resource temporarily unavailable)
2019/06/25 17:10:59 [debug] 6803#0: *4 event timer add: 13: 60000:337636134
2019/06/25 17:10:59 [debug] 6802#0: worker cycle
2019/06/25 17:10:59 [debug] 6801#0: timer delta: 41209
2019/06/25 17:10:59 [debug] 6797#0: timer delta: 41209
2019/06/25 17:10:59 [debug] 6803#0: *4 reusable connection: 1
2019/06/25 17:10:59 [debug] 6802#0: epoll timer: -1
2019/06/25 17:10:59 [debug] 6801#0: worker cycle
2019/06/25 17:10:59 [debug] 6804#0: accept on 0.0.0.0:9443, ready: 0
2019/06/25 17:10:59 [debug] 6797#0: worker cycle
2019/06/25 17:10:59 [debug] 6803#0: *4 epoll add event: fd:13 op:1 ev:80002001
2019/06/25 17:10:59 [debug] 6801#0: epoll timer: -1
2019/06/25 17:10:59 [debug] 6797#0: epoll timer: -1
2019/06/25 17:10:59 [debug] 6803#0: timer delta: 41154
2019/06/25 17:10:59 [debug] 6804#0: accept() not ready (11: Resource temporarily unavailable)
2019/06/25 17:10:59 [debug] 6803#0: worker cycle
2019/06/25 17:10:59 [debug] 6803#0: epoll timer: 6783
2019/06/25 17:10:59 [debug] 6804#0: timer delta: 41209
2019/06/25 17:10:59 [debug] 6803#0: epoll: fd:13 ev:0001 d:00007F9FC27AD3D1
2019/06/25 17:10:59 [debug] 6804#0: worker cycle
2019/06/25 17:10:59 [debug] 6803#0: *4 http check ssl handshake
2019/06/25 17:10:59 [debug] 6804#0: epoll timer: -1
2019/06/25 17:10:59 [debug] 6803#0: *4 http recv(): 1
2019/06/25 17:10:59 [debug] 6803#0: *4 https ssl handshake: 0x16
2019/06/25 17:10:59 [debug] 6803#0: *4 tcp_nodelay
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL server name: "cmp-svt-epic-cluster.dc.corp.telstra.com"
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL_do_handshake: -1
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL_get_error: 2
2019/06/25 17:10:59 [debug] 6803#0: *4 reusable connection: 0
2019/06/25 17:10:59 [debug] 6803#0: timer delta: 0
2019/06/25 17:10:59 [debug] 6803#0: worker cycle
2019/06/25 17:10:59 [debug] 6803#0: epoll timer: 6783
2019/06/25 17:10:59 [debug] 6803#0: epoll: fd:13 ev:0001 d:00007F9FC27AD3D1
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL handshake handler: 0
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL_do_handshake: 1
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL: TLSv1.2, cipher: "ECDHE-RSA-AES256-GCM-SHA384 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(256) Mac=AEAD"
2019/06/25 17:10:59 [debug] 6803#0: *4 reusable connection: 1
2019/06/25 17:10:59 [debug] 6803#0: *4 http wait request handler
2019/06/25 17:10:59 [debug] 6803#0: *4 malloc: 0000000001F93610:1024
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL_read: -1
2019/06/25 17:10:59 [debug] 6803#0: *4 SSL_get_error: 2
2019/06/25 17:10:59 [debug] 6803#0: *4 free: 0000000001F93610
2019/06/25 17:10:59 [debug] 6803#0: timer delta: 18
2019/06/25 17:10:59 [debug] 6803#0: worker cycle
2019/06/25 17:10:59 [debug] 6803#0: epoll timer: 6765
2019/06/25 17:11:06 [debug] 6803#0: timer delta: 6773
2019/06/25 17:11:06 [debug] 6803#0: *1 event timer del: 9: 337582917
2019/06/25 17:11:06 [debug] 6803#0: *1 http wait request handler
2019/06/25 17:11:06 [info] 6803#0: *1 client timed out (110: Connection timed out) while waiting for request, client: 10.56.190.26, server: 0.0.0.0:9443
2019/06/25 17:11:06 [debug] 6803#0: *1 close http connection: 9
2019/06/25 17:11:06 [debug] 6803#0: *1 SSL_shutdown: 1
2019/06/25 17:11:06 [debug] 6803#0: *1 reusable connection: 0
2019/06/25 17:11:06 [debug] 6803#0: *1 free: 0000000000000000
2019/06/25 17:11:06 [debug] 6803#0: *1 free: 0000000001F4DA60, unused: 8
2019/06/25 17:11:06 [debug] 6803#0: worker cycle
2019/06/25 17:11:06 [debug] 6803#0: epoll timer: 17055
2019/06/25 17:11:23 [debug] 6803#0: timer delta: 17073
2019/06/25 17:11:23 [debug] 6803#0: worker cycle
2019/06/25 17:11:23 [debug] 6803#0: epoll timer: 36136
2019/06/25 17:11:59 [debug] 6803#0: timer delta: 36172
2019/06/25 17:11:59 [debug] 6803#0: *4 event timer del: 13: 337636134
2019/06/25 17:11:59 [debug] 6803#0: *4 http wait request handler
2019/06/25 17:11:59 [info] 6803#0: *4 client timed out (110: Connection timed out) while waiting for request, client: X.XX.XXX.XX, server: 0.0.0.0:9443
2019/06/25 17:11:59 [debug] 6803#0: *4 close http connection: 13
2019/06/25 17:11:59 [debug] 6803#0: *4 SSL_shutdown: 1
2019/06/25 17:11:59 [debug] 6803#0: *4 reusable connection: 0
2019/06/25 17:11:59 [debug] 6803#0: *4 free: 0000000000000000
2019/06/25 17:11:59 [debug] 6803#0: *4 free: 0000000001F90C10, unused: 8
2019/06/25 17:11:59 [debug] 6803#0: worker cycle
2019/06/25 17:11:59 [debug] 6803#0: epoll timer: -1

Change History (1)

comment:1 by Maxim Dounin, 5 years ago

Resolution: → invalid
Status: new → closed

This doesn't look like a bug in nginx, but rather like a network issue.

Note: See TracTickets for help on using tickets.