Hi, On 07-01-2024 18:21, Aurelien Jarno wrote:
Timeout while building: https://ci.debian.net/packages/g/glibc/unstable/arm64/41516611/There are indeed many failures with cc1 getting killed, it seems that it started around 2024-01-02. I haven't spotted any change to the toolchain nor kernel version. I am not able to reproduce the issue, so it is very likely linked to debci. Would it be possible to now why cc1 get killed? OOM? timeout?
I extracted the attached journal piece indicating OOM.
Failed test: https://ci.debian.net/packages/g/glibc/testing/arm64/40439311/
This one is too old, the date is not in the journal anymore. Paul
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dpkg-query invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0 Jan 03 22:53:54 ci-worker-arm64-03 kernel: CPU: 1 PID: 2152163 Comm: dpkg-query Tainted: G W 6.4.0-0.deb12.2-arm64 #1 Debian 6.4.4-3~bpo12+1 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Hardware name: OpenStack Foundation OpenStack Nova, BIOS 0.0.0 02/06/2015 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Call trace: Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_backtrace+0xa0/0x128 Jan 03 22:53:54 ci-worker-arm64-03 kernel: show_stack+0x20/0x38 Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_stack_lvl+0x48/0x60 Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_stack+0x18/0x28 Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_header+0x4c/0x218 Jan 03 22:53:54 ci-worker-arm64-03 kernel: oom_kill_process+0x148/0x308 Jan 03 22:53:54 ci-worker-arm64-03 kernel: out_of_memory+0xec/0x5a0 Jan 03 22:53:54 ci-worker-arm64-03 kernel: __alloc_pages+0xca0/0xde8 Jan 03 22:53:54 ci-worker-arm64-03 kernel: alloc_pages+0xb4/0x160 Jan 03 22:53:54 ci-worker-arm64-03 kernel: folio_alloc+0x24/0x68 Jan 03 22:53:54 ci-worker-arm64-03 kernel: filemap_alloc_folio+0x144/0x160 Jan 03 22:53:54 ci-worker-arm64-03 kernel: __filemap_get_folio+0xf0/0x2f8 Jan 03 22:53:54 ci-worker-arm64-03 kernel: filemap_fault+0x49c/0x998 Jan 03 22:53:54 ci-worker-arm64-03 kernel: __do_fault+0x44/0x230 Jan 03 22:53:54 ci-worker-arm64-03 kernel: __handle_mm_fault+0xb8c/0x1238 Jan 03 22:53:54 ci-worker-arm64-03 kernel: handle_mm_fault+0x160/0x290 Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_page_fault+0x270/0x490 Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_translation_fault+0x54/0x70 Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_mem_abort+0x4c/0xa8 Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0_ia+0x70/0x148 Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0t_64_sync_handler+0xc4/0x120 Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0t_64_sync+0x190/0x198 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Mem-Info: Jan 03 22:53:54 ci-worker-arm64-03 kernel: active_anon:644290 inactive_anon:541258 isolated_anon:0 active_file:488 inactive_file:211 isolated_file:0 unevictable:0 dirty:10 writeback:0 slab_reclaimable:84360 slab_unreclaimable:712733 mapped:536 shmem:947 pagetables:3927 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:31884 free_pcp:100 free_cma:0 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 active_anon:2577160kB inactive_anon:2165032kB active_file:1952kB inactive_file:844kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:2144kB dirty:40kB writeback:0kB shmem:3788kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 6144kB writeback_tmp:0kB kernel_stack:4512kB pagetables:15708kB sec_pagetables:0kB all_unreclaimable? no Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 DMA free:36984kB boost:0kB min:17152kB low:21440kB high:25728kB reserved_highatomic:0KB active_anon:1498272kB inactive_anon:1194072kB active_file:792kB inactive_file:436kB unevictable:0kB writepending:4kB present:3145728kB managed:3080192kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: lowmem_reserve[]: 0 0 4929 4929 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 Normal free:90552kB boost:0kB min:27900kB low:34872kB high:41844kB reserved_highatomic:0KB active_anon:1078488kB inactive_anon:971360kB active_file:28kB inactive_file:1176kB unevictable:0kB writepending:36kB present:5242880kB managed:5047724kB mlocked:0kB bounce:0kB free_pcp:364kB local_pcp:0kB free_cma:0kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: lowmem_reserve[]: 0 0 0 0 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 DMA: 1014*4kB (UME) 1017*8kB (UME) 304*16kB (UME) 327*32kB (UME) 95*64kB (UME) 28*128kB (UME) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 37184kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 Normal: 219*4kB (E) 994*8kB (UE) 1709*16kB (UE) 1672*32kB (UE) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 89676kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: 1686 total pagecache pages Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages in swap cache Jan 03 22:53:54 ci-worker-arm64-03 kernel: Free swap = 4084220kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: Total swap = 4084220kB Jan 03 22:53:54 ci-worker-arm64-03 kernel: 2097152 pages RAM Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages HighMem/MovableOnly Jan 03 22:53:54 ci-worker-arm64-03 kernel: 65173 pages reserved Jan 03 22:53:54 ci-worker-arm64-03 kernel: 16384 pages cma reserved Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages hwpoisoned Jan 03 22:53:54 ci-worker-arm64-03 kernel: Tasks state (memory values in pages): Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 324] 0 324 6624 571 73728 0 -1000 systemd-udevd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 431] 0 431 1672 64 53248 0 0 cron Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 434] 104 434 2422 256 65536 0 -900 dbus-daemon Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 451] 0 451 20664 96 65536 0 0 irqbalance Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 456] 0 456 187874 2744 143360 0 -1000 lxcfs Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 457] 998 457 58932 288 90112 0 0 polkitd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 464] 0 464 55530 902 81920 0 0 rsyslogd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 466] 0 466 4385 224 73728 0 0 systemd-logind Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 575] 0 575 65802 1475 155648 0 0 NetworkManager Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 581] 0 581 4077 192 69632 0 0 wpa_supplicant Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 582] 0 582 62414 480 126976 0 0 ModemManager Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 596] 0 596 100745 4631 151552 0 0 fail2ban-server Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 597] 0 597 1584 128 45056 0 0 lxc-monitord Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 600] 106 600 4832 133 61440 0 0 chronyd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 601] 106 601 2735 171 61440 0 0 chronyd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 683] 0 683 5116 2368 86016 0 0 munin-node Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 685] 0 685 1404 64 49152 0 0 agetty Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 686] 0 686 1310 64 49152 0 0 agetty Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 947] 0 947 4081 288 73728 0 -1000 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 962] 107 962 3706 163 73728 0 0 dnsmasq Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839017] 110 3839017 2177 384 61440 0 0 amqp-consume Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839166] 110 3839166 2177 352 61440 0 0 amqp-consume Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839228] 110 3839228 579 128 45056 0 0 debci-publisher Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 47994] 0 47994 8589 444 106496 0 -250 systemd-journal Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988636] 110 1988636 579 96 45056 0 0 debci-worker Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988670] 110 1988670 579 128 45056 0 0 debci-test Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988709] 110 1988709 579 64 45056 0 0 test-package Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988712] 110 1988712 579 96 40960 0 0 debci-autopkgte Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988713] 110 1988713 9724 4319 118784 0 0 autopkgtest Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988714] 110 1988714 1405 64 49152 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988715] 110 1988715 1405 96 45056 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988716] 110 1988716 1619 128 45056 0 0 mawk Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988717] 110 1988717 5967 2527 86016 0 0 autopkgtest-vir Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988766] 0 1988766 1584 139 53248 0 0 lxc-start Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988777] 0 1988777 5372 640 86016 0 0 systemd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988834] 0 1988834 10645 228 94208 0 -250 systemd-journal Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988874] 0 1988874 1395 192 53248 0 0 dhclient Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988886] 101 1988886 2126 128 61440 0 -900 dbus-daemon Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988887] 0 1988887 4431 256 77824 0 0 systemd-logind Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988962] 0 1988962 1312 96 49152 0 0 agetty Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988963] 0 1988963 4120 352 73728 0 -1000 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994141] 110 1994141 2913 224 65536 0 0 sudo Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994142] 0 1994142 1585 384 57344 0 0 3 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994144] 0 1994144 1705 128 53248 0 0 bash Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994146] 0 1994146 2352 160 61440 0 0 su Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994150] 1000 1994150 5067 480 86016 0 100 systemd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994151] 1000 1994151 5408 395 81920 0 100 (sd-pam) Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994158] 1000 1994158 579 96 40960 0 0 wrapper.sh Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994170] 1000 1994170 1408 96 49152 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994172] 1000 1994172 1408 96 53248 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994174] 1000 1994174 579 64 45056 0 0 rebuild Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994175] 1000 1994175 5961 3264 81920 0 0 dpkg-buildpacka Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994253] 1000 1994253 1630 192 45056 0 0 rules Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053249] 1000 2053249 580 64 40960 0 0 sh Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053263] 1000 2053263 675 128 45056 0 0 make Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053266] 1000 2053266 579 64 45056 0 0 sh Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053268] 1000 2053268 1273 480 49152 0 0 make Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2120563] 1000 2120563 8207 7480 102400 0 0 make Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144061] 1000 2144061 900 96 40960 0 0 aarch64-linux-g Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144062] 1000 2144062 652991 618566 5079040 0 0 cc1 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144063] 1000 2144063 39440 38003 360448 0 0 as Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144113] 110 2144113 579 96 40960 0 0 debci-worker Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144147] 110 2144147 579 64 45056 0 0 debci-test Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144192] 110 2144192 579 96 45056 0 0 test-package Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144195] 110 2144195 579 64 45056 0 0 debci-autopkgte Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144196] 110 2144196 9828 4390 118784 0 0 autopkgtest Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144197] 110 2144197 1405 32 53248 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144198] 110 2144198 1405 96 53248 0 0 tee Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144199] 110 2144199 1589 128 49152 0 0 mawk Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144200] 110 2144200 5711 2208 86016 0 0 autopkgtest-vir Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144211] 110 2144211 625 64 40960 0 0 inotifywait Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144237] 0 2144237 1584 107 53248 0 0 lxc-start Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144254] 0 2144254 5378 704 81920 0 0 systemd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144323] 0 2144323 10645 224 90112 0 -250 systemd-journal Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144365] 0 2144365 1395 256 53248 0 0 dhclient Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144380] 101 2144380 2126 128 57344 0 -900 dbus-daemon Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144381] 0 2144381 4426 256 81920 0 0 systemd-logind Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144459] 0 2144459 4120 384 69632 0 -1000 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144461] 0 2144461 1312 128 49152 0 0 agetty Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145739] 110 2145739 2913 224 69632 0 0 sudo Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145740] 0 2145740 1584 448 53248 0 0 3 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145742] 0 2145742 1705 128 49152 0 0 bash Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145744] 0 2145744 579 64 45056 0 0 sh Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145745] 0 2145745 23310 17689 229376 0 0 apt-get Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146023] 1000 2146023 900 128 40960 0 0 aarch64-linux-g Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146024] 1000 2146024 137226 125465 1150976 0 0 cc1 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146025] 1000 2146025 36855 35414 339968 0 0 as Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146686] 1000 2146686 900 96 40960 0 0 aarch64-linux-g Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146687] 1000 2146687 137370 124069 1126400 0 0 cc1 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146688] 1000 2146688 31697 30300 294912 0 0 as Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2147199] 0 2147199 2513 416 65536 0 0 dpkg Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148298] 1000 2148298 900 96 40960 0 0 aarch64-linux-g Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148299] 1000 2148299 143041 127990 1159168 0 0 cc1 Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148300] 1000 2148300 14066 12663 155648 0 0 as Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2151499] 0 2151499 614 32 45056 0 0 php8.2-xml.post Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152034] 0 2152034 4667 1952 81920 0 0 frontend Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152109] 0 2152109 4017 160 77824 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152110] 0 2152110 614 32 40960 0 0 ucf Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152117] 0 2152117 5183 2428 86016 0 0 munin-node Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152129] 0 2152129 4017 192 73728 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152130] 0 2152130 4017 192 73728 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152134] 0 2152134 3990 192 65536 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152135] 0 2152135 3990 128 61440 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152141] 0 2152141 3990 96 61440 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152142] 0 2152142 3990 128 65536 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152147] 0 2152147 3990 160 65536 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152163] 0 2152163 2281 340 57344 0 0 dpkg-query Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152164] 0 2152164 3990 32 57344 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152165] 0 2152165 3990 0 65536 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152166] 0 2152166 2452 64 57344 0 0 cron Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152167] 0 2152167 2452 64 57344 0 0 cron Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152169] 0 2152169 3990 0 61440 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152170] 0 2152170 5116 2428 81920 0 0 munin-node Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152171] 0 2152171 3788 0 61440 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152173] 0 2152173 2549 64 61440 0 0 cron Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152174] 0 2152174 2549 97 61440 0 0 cron Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152175] 0 2152175 832 32 45056 0 0 sshd Jan 03 22:53:54 ci-worker-arm64-03 kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=lxc.payload.ci-003-312f847d,mems_allowed=0,global_oom,task_memcg=/lxc.payload.ci-003-abc483fb/user.slice/user-1000.slice/session-c2.scope,task=cc1,pid=2144062,uid=1000 Jan 03 22:53:54 ci-worker-arm64-03 kernel: Out of memory: Killed process 2144062 (cc1) total-vm:2611964kB, anon-rss:2474264kB, file-rss:0kB, shmem-rss:0kB, UID:1000 pgtables:4960kB oom_score_adj:0 Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Main process exited, code=killed, status=6/ABRT Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Failed with result 'watchdog'. Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Consumed 2min 50.965s CPU time. Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 3. Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Stopped systemd-journald.service - Journal Service. Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Consumed 2min 50.965s CPU time. Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Starting systemd-journald.service - Journal Service... Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: File /var/log/journal/e367862c17f240d0adfb67d7cd3569cb/system.journal corrupted or uncleanly shut down, renaming and replacing. Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: Journal started Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: System Journal (/var/log/journal/e367862c17f240d0adfb67d7cd3569cb) is 3.9G, max 4.0G, 41.1M free. Jan 03 22:51:17 ci-worker-arm64-03 CRON[2152167]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Jan 03 22:53:53 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Watchdog timeout (limit 3min)! Jan 03 22:51:27 ci-worker-arm64-03 CRON[2152174]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Jan 03 22:53:53 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Killing process 47994 (systemd-journal) with signal SIGABRT. Jan 03 22:51:27 ci-worker-arm64-03 CRON[2152173]: (root) CMD (/usr/local/bin/prevent-disk-filling) Jan 03 22:53:53 ci-worker-arm64-03 sshd[947]: error: beginning MaxStartups throttling Jan 03 22:53:53 ci-worker-arm64-03 sshd[947]: drop connection #14 from [122.35.192.61]:39948 on [192.168.1.128]:22 past MaxStartups Jan 03 22:53:53 ci-worker-arm64-03 CRON[2152166]: pam_unix(cron:session): session closed for user root Jan 03 22:53:53 ci-worker-arm64-03 CRON[2152167]: pam_unix(cron:session): session closed for user root Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152182]: Connection closed by 43.130.17.47 port 32970 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152130]: Connection closed by 43.130.17.47 port 39810 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152169]: Connection closed by 122.35.192.61 port 39620 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152178]: Connection closed by 43.130.17.47 port 48808 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152175]: Connection closed by 211.75.19.210 port 50340 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152147]: Connection closed by 43.130.17.47 port 52222 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152129]: Connection closed by 211.75.19.210 port 46028 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152171]: Connection closed by 43.130.17.47 port 36400 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152134]: Connection closed by 122.35.192.61 port 52136 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152181]: Connection closed by 43.130.17.47 port 40888 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152165]: Connection closed by 211.75.19.210 port 58326 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152180]: Connection closed by 122.35.192.61 port 41168 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152141]: Connection closed by 43.130.17.47 port 60138 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152164]: Connection closed by 43.130.17.47 port 44308 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152142]: Connection closed by 122.35.192.61 port 51086 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152176]: Connection closed by 43.130.17.47 port 56714 [preauth] Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: Invalid user regix from 89.190.156.39 port 53278 Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: Invalid user regix from 89.190.156.39 port 38818 Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: pam_unix(sshd:auth): check pass; user unknown Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=89.190.156.39 Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: pam_unix(sshd:auth): check pass; user unknown Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=89.190.156.39 Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Started systemd-journald.service - Journal Service.
Attachment:
OpenPGP_signature.asc
Description: OpenPGP digital signature