Hi, On 07-01-2024 18:21, Aurelien Jarno wrote:
Timeout while building: https://ci.debian.net/packages/g/glibc/unstable/arm64/41516611/There are indeed many failures with cc1 getting killed, it seems that it started around 2024-01-02. I haven't spotted any change to the toolchain nor kernel version. I am not able to reproduce the issue, so it is very likely linked to debci. Would it be possible to now why cc1 get killed? OOM? timeout?
I extracted the attached journal piece indicating OOM.
Failed test: https://ci.debian.net/packages/g/glibc/testing/arm64/40439311/
This one is too old, the date is not in the journal anymore. Paul
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dpkg-query invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
Jan 03 22:53:54 ci-worker-arm64-03 kernel: CPU: 1 PID: 2152163 Comm: dpkg-query Tainted: G W 6.4.0-0.deb12.2-arm64 #1 Debian 6.4.4-3~bpo12+1
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Hardware name: OpenStack Foundation OpenStack Nova, BIOS 0.0.0 02/06/2015
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Call trace:
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_backtrace+0xa0/0x128
Jan 03 22:53:54 ci-worker-arm64-03 kernel: show_stack+0x20/0x38
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_stack_lvl+0x48/0x60
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_stack+0x18/0x28
Jan 03 22:53:54 ci-worker-arm64-03 kernel: dump_header+0x4c/0x218
Jan 03 22:53:54 ci-worker-arm64-03 kernel: oom_kill_process+0x148/0x308
Jan 03 22:53:54 ci-worker-arm64-03 kernel: out_of_memory+0xec/0x5a0
Jan 03 22:53:54 ci-worker-arm64-03 kernel: __alloc_pages+0xca0/0xde8
Jan 03 22:53:54 ci-worker-arm64-03 kernel: alloc_pages+0xb4/0x160
Jan 03 22:53:54 ci-worker-arm64-03 kernel: folio_alloc+0x24/0x68
Jan 03 22:53:54 ci-worker-arm64-03 kernel: filemap_alloc_folio+0x144/0x160
Jan 03 22:53:54 ci-worker-arm64-03 kernel: __filemap_get_folio+0xf0/0x2f8
Jan 03 22:53:54 ci-worker-arm64-03 kernel: filemap_fault+0x49c/0x998
Jan 03 22:53:54 ci-worker-arm64-03 kernel: __do_fault+0x44/0x230
Jan 03 22:53:54 ci-worker-arm64-03 kernel: __handle_mm_fault+0xb8c/0x1238
Jan 03 22:53:54 ci-worker-arm64-03 kernel: handle_mm_fault+0x160/0x290
Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_page_fault+0x270/0x490
Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_translation_fault+0x54/0x70
Jan 03 22:53:54 ci-worker-arm64-03 kernel: do_mem_abort+0x4c/0xa8
Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0_ia+0x70/0x148
Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0t_64_sync_handler+0xc4/0x120
Jan 03 22:53:54 ci-worker-arm64-03 kernel: el0t_64_sync+0x190/0x198
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Mem-Info:
Jan 03 22:53:54 ci-worker-arm64-03 kernel: active_anon:644290 inactive_anon:541258 isolated_anon:0
active_file:488 inactive_file:211 isolated_file:0
unevictable:0 dirty:10 writeback:0
slab_reclaimable:84360 slab_unreclaimable:712733
mapped:536 shmem:947 pagetables:3927
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:31884 free_pcp:100 free_cma:0
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 active_anon:2577160kB inactive_anon:2165032kB active_file:1952kB inactive_file:844kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:2144kB dirty:40kB writeback:0kB shmem:3788kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 6144kB writeback_tmp:0kB kernel_stack:4512kB pagetables:15708kB sec_pagetables:0kB all_unreclaimable? no
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 DMA free:36984kB boost:0kB min:17152kB low:21440kB high:25728kB reserved_highatomic:0KB active_anon:1498272kB inactive_anon:1194072kB active_file:792kB inactive_file:436kB unevictable:0kB writepending:4kB present:3145728kB managed:3080192kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: lowmem_reserve[]: 0 0 4929 4929
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 Normal free:90552kB boost:0kB min:27900kB low:34872kB high:41844kB reserved_highatomic:0KB active_anon:1078488kB inactive_anon:971360kB active_file:28kB inactive_file:1176kB unevictable:0kB writepending:36kB present:5242880kB managed:5047724kB mlocked:0kB bounce:0kB free_pcp:364kB local_pcp:0kB free_cma:0kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: lowmem_reserve[]: 0 0 0 0
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 DMA: 1014*4kB (UME) 1017*8kB (UME) 304*16kB (UME) 327*32kB (UME) 95*64kB (UME) 28*128kB (UME) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 37184kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 Normal: 219*4kB (E) 994*8kB (UE) 1709*16kB (UE) 1672*32kB (UE) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 89676kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 1686 total pagecache pages
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages in swap cache
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Free swap = 4084220kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Total swap = 4084220kB
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 2097152 pages RAM
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages HighMem/MovableOnly
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 65173 pages reserved
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 16384 pages cma reserved
Jan 03 22:53:54 ci-worker-arm64-03 kernel: 0 pages hwpoisoned
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Tasks state (memory values in pages):
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 324] 0 324 6624 571 73728 0 -1000 systemd-udevd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 431] 0 431 1672 64 53248 0 0 cron
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 434] 104 434 2422 256 65536 0 -900 dbus-daemon
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 451] 0 451 20664 96 65536 0 0 irqbalance
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 456] 0 456 187874 2744 143360 0 -1000 lxcfs
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 457] 998 457 58932 288 90112 0 0 polkitd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 464] 0 464 55530 902 81920 0 0 rsyslogd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 466] 0 466 4385 224 73728 0 0 systemd-logind
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 575] 0 575 65802 1475 155648 0 0 NetworkManager
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 581] 0 581 4077 192 69632 0 0 wpa_supplicant
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 582] 0 582 62414 480 126976 0 0 ModemManager
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 596] 0 596 100745 4631 151552 0 0 fail2ban-server
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 597] 0 597 1584 128 45056 0 0 lxc-monitord
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 600] 106 600 4832 133 61440 0 0 chronyd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 601] 106 601 2735 171 61440 0 0 chronyd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 683] 0 683 5116 2368 86016 0 0 munin-node
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 685] 0 685 1404 64 49152 0 0 agetty
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 686] 0 686 1310 64 49152 0 0 agetty
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 947] 0 947 4081 288 73728 0 -1000 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 962] 107 962 3706 163 73728 0 0 dnsmasq
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839017] 110 3839017 2177 384 61440 0 0 amqp-consume
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839166] 110 3839166 2177 352 61440 0 0 amqp-consume
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [3839228] 110 3839228 579 128 45056 0 0 debci-publisher
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [ 47994] 0 47994 8589 444 106496 0 -250 systemd-journal
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988636] 110 1988636 579 96 45056 0 0 debci-worker
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988670] 110 1988670 579 128 45056 0 0 debci-test
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988709] 110 1988709 579 64 45056 0 0 test-package
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988712] 110 1988712 579 96 40960 0 0 debci-autopkgte
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988713] 110 1988713 9724 4319 118784 0 0 autopkgtest
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988714] 110 1988714 1405 64 49152 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988715] 110 1988715 1405 96 45056 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988716] 110 1988716 1619 128 45056 0 0 mawk
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988717] 110 1988717 5967 2527 86016 0 0 autopkgtest-vir
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988766] 0 1988766 1584 139 53248 0 0 lxc-start
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988777] 0 1988777 5372 640 86016 0 0 systemd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988834] 0 1988834 10645 228 94208 0 -250 systemd-journal
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988874] 0 1988874 1395 192 53248 0 0 dhclient
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988886] 101 1988886 2126 128 61440 0 -900 dbus-daemon
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988887] 0 1988887 4431 256 77824 0 0 systemd-logind
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988962] 0 1988962 1312 96 49152 0 0 agetty
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1988963] 0 1988963 4120 352 73728 0 -1000 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994141] 110 1994141 2913 224 65536 0 0 sudo
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994142] 0 1994142 1585 384 57344 0 0 3
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994144] 0 1994144 1705 128 53248 0 0 bash
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994146] 0 1994146 2352 160 61440 0 0 su
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994150] 1000 1994150 5067 480 86016 0 100 systemd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994151] 1000 1994151 5408 395 81920 0 100 (sd-pam)
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994158] 1000 1994158 579 96 40960 0 0 wrapper.sh
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994170] 1000 1994170 1408 96 49152 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994172] 1000 1994172 1408 96 53248 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994174] 1000 1994174 579 64 45056 0 0 rebuild
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994175] 1000 1994175 5961 3264 81920 0 0 dpkg-buildpacka
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [1994253] 1000 1994253 1630 192 45056 0 0 rules
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053249] 1000 2053249 580 64 40960 0 0 sh
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053263] 1000 2053263 675 128 45056 0 0 make
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053266] 1000 2053266 579 64 45056 0 0 sh
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2053268] 1000 2053268 1273 480 49152 0 0 make
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2120563] 1000 2120563 8207 7480 102400 0 0 make
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144061] 1000 2144061 900 96 40960 0 0 aarch64-linux-g
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144062] 1000 2144062 652991 618566 5079040 0 0 cc1
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144063] 1000 2144063 39440 38003 360448 0 0 as
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144113] 110 2144113 579 96 40960 0 0 debci-worker
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144147] 110 2144147 579 64 45056 0 0 debci-test
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144192] 110 2144192 579 96 45056 0 0 test-package
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144195] 110 2144195 579 64 45056 0 0 debci-autopkgte
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144196] 110 2144196 9828 4390 118784 0 0 autopkgtest
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144197] 110 2144197 1405 32 53248 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144198] 110 2144198 1405 96 53248 0 0 tee
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144199] 110 2144199 1589 128 49152 0 0 mawk
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144200] 110 2144200 5711 2208 86016 0 0 autopkgtest-vir
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144211] 110 2144211 625 64 40960 0 0 inotifywait
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144237] 0 2144237 1584 107 53248 0 0 lxc-start
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144254] 0 2144254 5378 704 81920 0 0 systemd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144323] 0 2144323 10645 224 90112 0 -250 systemd-journal
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144365] 0 2144365 1395 256 53248 0 0 dhclient
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144380] 101 2144380 2126 128 57344 0 -900 dbus-daemon
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144381] 0 2144381 4426 256 81920 0 0 systemd-logind
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144459] 0 2144459 4120 384 69632 0 -1000 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2144461] 0 2144461 1312 128 49152 0 0 agetty
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145739] 110 2145739 2913 224 69632 0 0 sudo
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145740] 0 2145740 1584 448 53248 0 0 3
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145742] 0 2145742 1705 128 49152 0 0 bash
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145744] 0 2145744 579 64 45056 0 0 sh
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2145745] 0 2145745 23310 17689 229376 0 0 apt-get
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146023] 1000 2146023 900 128 40960 0 0 aarch64-linux-g
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146024] 1000 2146024 137226 125465 1150976 0 0 cc1
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146025] 1000 2146025 36855 35414 339968 0 0 as
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146686] 1000 2146686 900 96 40960 0 0 aarch64-linux-g
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146687] 1000 2146687 137370 124069 1126400 0 0 cc1
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2146688] 1000 2146688 31697 30300 294912 0 0 as
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2147199] 0 2147199 2513 416 65536 0 0 dpkg
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148298] 1000 2148298 900 96 40960 0 0 aarch64-linux-g
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148299] 1000 2148299 143041 127990 1159168 0 0 cc1
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2148300] 1000 2148300 14066 12663 155648 0 0 as
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2151499] 0 2151499 614 32 45056 0 0 php8.2-xml.post
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152034] 0 2152034 4667 1952 81920 0 0 frontend
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152109] 0 2152109 4017 160 77824 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152110] 0 2152110 614 32 40960 0 0 ucf
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152117] 0 2152117 5183 2428 86016 0 0 munin-node
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152129] 0 2152129 4017 192 73728 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152130] 0 2152130 4017 192 73728 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152134] 0 2152134 3990 192 65536 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152135] 0 2152135 3990 128 61440 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152141] 0 2152141 3990 96 61440 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152142] 0 2152142 3990 128 65536 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152147] 0 2152147 3990 160 65536 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152163] 0 2152163 2281 340 57344 0 0 dpkg-query
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152164] 0 2152164 3990 32 57344 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152165] 0 2152165 3990 0 65536 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152166] 0 2152166 2452 64 57344 0 0 cron
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152167] 0 2152167 2452 64 57344 0 0 cron
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152169] 0 2152169 3990 0 61440 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152170] 0 2152170 5116 2428 81920 0 0 munin-node
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152171] 0 2152171 3788 0 61440 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152173] 0 2152173 2549 64 61440 0 0 cron
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152174] 0 2152174 2549 97 61440 0 0 cron
Jan 03 22:53:54 ci-worker-arm64-03 kernel: [2152175] 0 2152175 832 32 45056 0 0 sshd
Jan 03 22:53:54 ci-worker-arm64-03 kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=lxc.payload.ci-003-312f847d,mems_allowed=0,global_oom,task_memcg=/lxc.payload.ci-003-abc483fb/user.slice/user-1000.slice/session-c2.scope,task=cc1,pid=2144062,uid=1000
Jan 03 22:53:54 ci-worker-arm64-03 kernel: Out of memory: Killed process 2144062 (cc1) total-vm:2611964kB, anon-rss:2474264kB, file-rss:0kB, shmem-rss:0kB, UID:1000 pgtables:4960kB oom_score_adj:0
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Main process exited, code=killed, status=6/ABRT
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Failed with result 'watchdog'.
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Consumed 2min 50.965s CPU time.
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 3.
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Stopped systemd-journald.service - Journal Service.
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Consumed 2min 50.965s CPU time.
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Starting systemd-journald.service - Journal Service...
Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: File /var/log/journal/e367862c17f240d0adfb67d7cd3569cb/system.journal corrupted or uncleanly shut down, renaming and replacing.
Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: Journal started
Jan 03 22:53:54 ci-worker-arm64-03 systemd-journald[2152201]: System Journal (/var/log/journal/e367862c17f240d0adfb67d7cd3569cb) is 3.9G, max 4.0G, 41.1M free.
Jan 03 22:51:17 ci-worker-arm64-03 CRON[2152167]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Jan 03 22:53:53 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Watchdog timeout (limit 3min)!
Jan 03 22:51:27 ci-worker-arm64-03 CRON[2152174]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi)
Jan 03 22:53:53 ci-worker-arm64-03 systemd[1]: systemd-journald.service: Killing process 47994 (systemd-journal) with signal SIGABRT.
Jan 03 22:51:27 ci-worker-arm64-03 CRON[2152173]: (root) CMD (/usr/local/bin/prevent-disk-filling)
Jan 03 22:53:53 ci-worker-arm64-03 sshd[947]: error: beginning MaxStartups throttling
Jan 03 22:53:53 ci-worker-arm64-03 sshd[947]: drop connection #14 from [122.35.192.61]:39948 on [192.168.1.128]:22 past MaxStartups
Jan 03 22:53:53 ci-worker-arm64-03 CRON[2152166]: pam_unix(cron:session): session closed for user root
Jan 03 22:53:53 ci-worker-arm64-03 CRON[2152167]: pam_unix(cron:session): session closed for user root
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152182]: Connection closed by 43.130.17.47 port 32970 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152130]: Connection closed by 43.130.17.47 port 39810 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152169]: Connection closed by 122.35.192.61 port 39620 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152178]: Connection closed by 43.130.17.47 port 48808 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152175]: Connection closed by 211.75.19.210 port 50340 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152147]: Connection closed by 43.130.17.47 port 52222 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152129]: Connection closed by 211.75.19.210 port 46028 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152171]: Connection closed by 43.130.17.47 port 36400 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152134]: Connection closed by 122.35.192.61 port 52136 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152181]: Connection closed by 43.130.17.47 port 40888 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152165]: Connection closed by 211.75.19.210 port 58326 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152180]: Connection closed by 122.35.192.61 port 41168 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152141]: Connection closed by 43.130.17.47 port 60138 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152164]: Connection closed by 43.130.17.47 port 44308 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152142]: Connection closed by 122.35.192.61 port 51086 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152176]: Connection closed by 43.130.17.47 port 56714 [preauth]
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: Invalid user regix from 89.190.156.39 port 53278
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: Invalid user regix from 89.190.156.39 port 38818
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: pam_unix(sshd:auth): check pass; user unknown
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152135]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=89.190.156.39
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: pam_unix(sshd:auth): check pass; user unknown
Jan 03 22:53:54 ci-worker-arm64-03 sshd[2152179]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=89.190.156.39
Jan 03 22:53:54 ci-worker-arm64-03 systemd[1]: Started systemd-journald.service - Journal Service.
Attachment:
OpenPGP_signature.asc
Description: OpenPGP digital signature