Bug#1064347: openssh-server: sshd crashes under heavy traffic
Package: openssh-server
Version: 1:8.4p1-5+deb11u3
Severity: normal
X-Debbugs-Cc: gkissand@gmail.com
Dear Maintainer,
* What led up to the situation?
We have a public facing sftp server for our customers
After upgrading Debian 10 to Debian 11, sshd is crashing under heavy traffic
* What exactly did you do (or not do) that was effective (or
ineffective)?
I tried reconfigure timeouts, keepalives etc but none worked
* What was the outcome of this action?
No change
* What outcome did you expect instead?
Not sure
Very similar (or the same) with
https://bugs.launchpad.net/ubuntu/+source/openssh/+bug/2043114
-- System Information:
Debian Release: 11.9
APT prefers oldstable-updates
APT policy: (500, 'oldstable-updates'), (500, 'oldstable-security'), (500, 'oldstable')
Architecture: amd64 (x86_64)
Kernel: Linux 5.10.0-28-amd64 (SMP w/8 CPU threads)
Locale: LANG=en_US, LC_CTYPE=en_US (charmap=UTF-8) (ignored: LC_ALL set to en_US.UTF-8), LANGUAGE=en_US:en
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages openssh-server depends on:
ii adduser 3.118+deb11u1
ii debconf [debconf-2.0] 1.5.77
ii dpkg 1.20.13
ii libaudit1 1:3.0-2
ii libc6 2.31-13+deb11u8
ii libcom-err2 1.46.2-2
ii libcrypt1 1:4.4.18-4
ii libgssapi-krb5-2 1.18.3-6+deb11u4
ii libkrb5-3 1.18.3-6+deb11u4
ii libpam-modules 1.4.0-9+deb11u1
ii libpam-runtime 1.4.0-9+deb11u1
ii libpam0g 1.4.0-9+deb11u1
ii libselinux1 3.1-3
ii libssl1.1 1.1.1w-0+deb11u1
ii libsystemd0 247.3-7+deb11u4
ii libwrap0 7.6.q-31
ii lsb-base 11.1.0
ii openssh-client 1:8.4p1-5+deb11u3
ii openssh-sftp-server 1:8.4p1-5+deb11u3
ii procps 2:3.3.17-5
ii runit-helper 2.10.3
ii ucf 3.0043
ii zlib1g 1:1.2.11.dfsg-2+deb11u2
Versions of packages openssh-server recommends:
ii libpam-systemd [logind] 247.3-7+deb11u4
ii ncurses-term 6.2+20201114-2+deb11u2
ii xauth 1:1.1-1
Versions of packages openssh-server suggests:
pn molly-guard <none>
pn monkeysphere <none>
pn ssh-askpass <none>
pn ufw <none>
-- Configuration Files:
/etc/pam.d/sshd changed [not included]
-- debconf information excluded
kern.log:Feb 19 22:29:40 ecmif01 kernel: [ 2288.914649] traps: sshd[72022] general protection fault ip:7f6b8116d3b7 sp:7fff87eb22f0 error:0 in libc-2.31.so[7f6b8110d000+159000]
kern.log:Feb 19 22:46:04 ecmif01 kernel: [ 3272.826055] traps: sshd[98328] general protection fault ip:7f5e5c0433b7 sp:7fff4d3109f0 error:0 in libc-2.31.so[7f5e5bfe3000+159000]
kern.log:Feb 19 23:14:08 ecmif01 kernel: [ 4956.789461] traps: sshd[152300] general protection fault ip:7f62249523b7 sp:7ffc761c4300 error:0 in libc-2.31.so[7f62248f2000+159000]
kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.048898] sshd[437092]: segfault at 5618ab5283c8 ip 00007f5f0a4a937f sp 00007ffd30ac6640 error 4 in libc-2.31.so[7f5f0a449000+159000]
kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.049177] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 02:03:10 ecmif01 kernel: [15098.671459] traps: sshd[488901] general protection fault ip:7ff8c0fb23b7 sp:7ffdc8d60140 error:0 in libc-2.31.so[7ff8c0f52000+159000]
kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.975972] sshd[496790]: segfault at 562609c87458 ip 00007f7645a4c37f sp 00007ffe0c52ee90 error 4 in libc-2.31.so[7f76459ec000+159000]
kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.976252] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 04:32:05 ecmif01 kernel: [24033.447133] traps: sshd[759145] general protection fault ip:7f6ebe48e3b7 sp:7ffe40a2cf30 error:0 in libc-2.31.so[7f6ebe42e000+159000]
kern.log:Feb 20 04:46:01 ecmif01 kernel: [24869.466121] traps: sshd[804956] general protection fault ip:7f926c9863b7 sp:7fffdc0400a0 error:0 in libc-2.31.so[7f926c926000+159000]
kern.log:Feb 20 05:16:14 ecmif01 kernel: [26682.432389] traps: sshd[871829] general protection fault ip:7f4ea598b3b7 sp:7ffd003bccf0 error:0 in libc-2.31.so[7f4ea592b000+159000]
kern.log:Feb 20 05:58:09 ecmif01 kernel: [29197.006583] traps: sshd[978131] general protection fault ip:7f11eb09c3b7 sp:7ffefa5baaa0 error:0 in libc-2.31.so[7f11eb03c000+159000]
kern.log:Feb 20 07:02:05 ecmif01 kernel: [33033.374881] traps: sshd[1111989] general protection fault ip:7fc463ef43b7 sp:7ffe79095300 error:0 in libc-2.31.so[7fc463e94000+159000]
kern.log:Feb 20 07:28:04 ecmif01 kernel: [34591.766611] traps: sshd[1159773] general protection fault ip:7ff705eaf3b7 sp:7ffeda7a4a70 error:0 in libc-2.31.so[7ff705e4f000+159000]
kern.log:Feb 20 07:43:06 ecmif01 kernel: [35494.141287] traps: sshd[1187041] general protection fault ip:7fb0d52733b7 sp:7ffe4f2feed0 error:0 in libc-2.31.so[7fb0d5213000+159000]
kern.log:Feb 20 08:03:05 ecmif01 kernel: [36693.125865] traps: sshd[1233277] general protection fault ip:7fb5d11203b7 sp:7ffcc0a30a00 error:0 in libc-2.31.so[7fb5d10c0000+159000]
kern.log:Feb 20 08:10:13 ecmif01 kernel: [37121.193921] traps: sshd[1235191] general protection fault ip:7ff6d12d23b7 sp:7ffd0ba8fba0 error:0 in libc-2.31.so[7ff6d1272000+159000]
kern.log:Feb 20 09:14:01 ecmif01 kernel: [40949.428987] traps: sshd[1396212] general protection fault ip:7fcd362c13b7 sp:7ffc1fcb1c50 error:0 in libc-2.31.so[7fcd36261000+159000]
kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.621958] sshd[1458137]: segfault at 564e518af968 ip 00007f36e653937f sp 00007ffed4b16e90 error 4 in libc-2.31.so[7f36e64d9000+159000]
kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.625258] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 11:20:15 ecmif01 kernel: [48523.413848] traps: sshd[1636274] general protection fault ip:7fdf166443b7 sp:7fffd2d00130 error:0 in libc-2.31.so[7fdf165e4000+159000]
kern.log:Feb 20 11:37:02 ecmif01 kernel: [49530.237781] traps: sshd[1651031] general protection fault ip:7eff523f83b7 sp:7ffc5d48dfa0 error:0 in libc-2.31.so[7eff52398000+159000]
kern.log:Feb 19 22:29:40 ecmif01 kernel: [ 2288.914649] traps: sshd[72022] general protection fault ip:7f6b8116d3b7 sp:7fff87eb22f0 error:0 in libc-2.31.so[7f6b8110d000+159000]
kern.log:Feb 19 22:46:04 ecmif01 kernel: [ 3272.826055] traps: sshd[98328] general protection fault ip:7f5e5c0433b7 sp:7fff4d3109f0 error:0 in libc-2.31.so[7f5e5bfe3000+159000]
kern.log:Feb 19 23:14:08 ecmif01 kernel: [ 4956.789461] traps: sshd[152300] general protection fault ip:7f62249523b7 sp:7ffc761c4300 error:0 in libc-2.31.so[7f62248f2000+159000]
kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.048898] sshd[437092]: segfault at 5618ab5283c8 ip 00007f5f0a4a937f sp 00007ffd30ac6640 error 4 in libc-2.31.so[7f5f0a449000+159000]
kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.049177] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 02:03:10 ecmif01 kernel: [15098.671459] traps: sshd[488901] general protection fault ip:7ff8c0fb23b7 sp:7ffdc8d60140 error:0 in libc-2.31.so[7ff8c0f52000+159000]
kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.975972] sshd[496790]: segfault at 562609c87458 ip 00007f7645a4c37f sp 00007ffe0c52ee90 error 4 in libc-2.31.so[7f76459ec000+159000]
kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.976252] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 04:32:05 ecmif01 kernel: [24033.447133] traps: sshd[759145] general protection fault ip:7f6ebe48e3b7 sp:7ffe40a2cf30 error:0 in libc-2.31.so[7f6ebe42e000+159000]
kern.log:Feb 20 04:46:01 ecmif01 kernel: [24869.466121] traps: sshd[804956] general protection fault ip:7f926c9863b7 sp:7fffdc0400a0 error:0 in libc-2.31.so[7f926c926000+159000]
kern.log:Feb 20 05:16:14 ecmif01 kernel: [26682.432389] traps: sshd[871829] general protection fault ip:7f4ea598b3b7 sp:7ffd003bccf0 error:0 in libc-2.31.so[7f4ea592b000+159000]
kern.log:Feb 20 05:58:09 ecmif01 kernel: [29197.006583] traps: sshd[978131] general protection fault ip:7f11eb09c3b7 sp:7ffefa5baaa0 error:0 in libc-2.31.so[7f11eb03c000+159000]
kern.log:Feb 20 07:02:05 ecmif01 kernel: [33033.374881] traps: sshd[1111989] general protection fault ip:7fc463ef43b7 sp:7ffe79095300 error:0 in libc-2.31.so[7fc463e94000+159000]
kern.log:Feb 20 07:28:04 ecmif01 kernel: [34591.766611] traps: sshd[1159773] general protection fault ip:7ff705eaf3b7 sp:7ffeda7a4a70 error:0 in libc-2.31.so[7ff705e4f000+159000]
kern.log:Feb 20 07:43:06 ecmif01 kernel: [35494.141287] traps: sshd[1187041] general protection fault ip:7fb0d52733b7 sp:7ffe4f2feed0 error:0 in libc-2.31.so[7fb0d5213000+159000]
kern.log:Feb 20 08:03:05 ecmif01 kernel: [36693.125865] traps: sshd[1233277] general protection fault ip:7fb5d11203b7 sp:7ffcc0a30a00 error:0 in libc-2.31.so[7fb5d10c0000+159000]
kern.log:Feb 20 08:10:13 ecmif01 kernel: [37121.193921] traps: sshd[1235191] general protection fault ip:7ff6d12d23b7 sp:7ffd0ba8fba0 error:0 in libc-2.31.so[7ff6d1272000+159000]
kern.log:Feb 20 09:14:01 ecmif01 kernel: [40949.428987] traps: sshd[1396212] general protection fault ip:7fcd362c13b7 sp:7ffc1fcb1c50 error:0 in libc-2.31.so[7fcd36261000+159000]
kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.621958] sshd[1458137]: segfault at 564e518af968 ip 00007f36e653937f sp 00007ffed4b16e90 error 4 in libc-2.31.so[7f36e64d9000+159000]
kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.625258] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18
kern.log:Feb 20 11:20:15 ecmif01 kernel: [48523.413848] traps: sshd[1636274] general protection fault ip:7fdf166443b7 sp:7fffd2d00130 error:0 in libc-2.31.so[7fdf165e4000+159000]
kern.log:Feb 20 11:37:02 ecmif01 kernel: [49530.237781] traps: sshd[1651031] general protection fault ip:7eff523f83b7 sp:7ffc5d48dfa0 error:0 in libc-2.31.so[7eff52398000+159000]
Reply to: