Bug#1053120: linux-image-6.1.0-12-amd64: Kernel NULL pointer deref with XFS on kernel 6.1
Hi,
On Wed, Sep 27, 2023 at 01:08:21PM -0500, S. wrote:
> Package: src:linux
> Version: 6.1.52-1
> Severity: important
> X-Debbugs-Cc: wfhnbsq1@duck.com
>
> Dear Maintainer,
>
> I have been running Debian 12 on a Hetzner cloud VM since a few weeks before the official Debian 12 Stable release. I did a manual netinstall with an XFS root filesystem. Unfortunately
> I have consistently been having issues approximately every month with kernel crashes that start like this:
>
> ================================
> Sep 27 00:49:20 myserver kernel: BUG: kernel NULL pointer dereference, address: 00000000000000a2
> Sep 27 00:49:20 myserver kernel: #PF: supervisor read access in kernel mode
> Sep 27 00:49:20 myserver kernel: #PF: error_code(0x0000) - not-present page
> Sep 27 00:49:20 myserver kernel: Oops: 0000 [#1] PREEMPT SMP NOPTI
> Sep 27 00:49:20 myserver kernel: CPU: 3 PID: 2155714 Comm: postmaster Not tainted 6.1.0-12-amd64 #1 Debian 6.1.52-1
> Sep 27 00:49:20 myserver kernel: Hardware name: Hetzner vServer/Standard PC (Q35 + ICH9, 2009), BIOS 20171111 11/11/2017
> Sep 27 00:49:20 myserver kernel: RIP: 0010:next_uptodate_page+0x45/0x1f0
> Sep 27 00:49:20 myserver kernel: Code: 0f 84 2f 01 00 00 48 81 ff 06 04 00 00 0f 84 a3 00 00 00 48 81 ff 02 04 00 00 0f 84 26 01 00 00 40 f6 c7 01 0f 85 8c 00 00 00 <48> 8b 07 a8 01 0f 85 81 00 00 00 8b 47 34 85 c0 74 7a 8d 50 01 4c
> Sep 27 00:49:20 myserver kernel: RSP: 0000:ffffb4de8169bcc0 EFLAGS: 00010246
> Sep 27 00:49:20 myserver kernel: RAX: 00000000000000a2 RBX: ffffb4de8169bd18 RCX: 00000000000003bd
> Sep 27 00:49:20 myserver kernel: RDX: ffffb4de8169bd18 RSI: ffff960758b9c2b0 RDI: 00000000000000a2
> Sep 27 00:49:20 myserver kernel: RBP: ffff960758b9c2b0 R08: 00000000000003bd R09: 00007f6da3ef5fff
> Sep 27 00:49:20 myserver kernel: R10: 00000000000003ae R11: 0000000000000000 R12: 00000000000003bd
> Sep 27 00:49:20 myserver kernel: R13: ffff960600431260 R14: ffff960758b9c2b0 R15: ffff9605dc7bedb0
> Sep 27 00:49:20 myserver kernel: FS: 00007f6e29110a40(0000) GS:ffff96082bf80000(0000) knlGS:0000000000000000
> Sep 27 00:49:20 myserver kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> Sep 27 00:49:20 myserver kernel: CR2: 00000000000000a2 CR3: 000000014a17a000 CR4: 0000000000350ee0
> Sep 27 00:49:20 myserver kernel: Call Trace:
> Sep 27 00:49:20 myserver kernel: <TASK>
> Sep 27 00:49:20 myserver kernel: ? __die_body.cold+0x1a/0x1f
> Sep 27 00:49:20 myserver kernel: ? page_fault_oops+0xd2/0x2b0
> Sep 27 00:49:20 myserver kernel: ? finish_task_switch.isra.0+0x9b/0x300
> Sep 27 00:49:20 myserver kernel: ? exc_page_fault+0x70/0x170
> Sep 27 00:49:20 myserver kernel: ? asm_exc_page_fault+0x22/0x30
> Sep 27 00:49:20 myserver kernel: ? next_uptodate_page+0x45/0x1f0
> Sep 27 00:49:20 myserver kernel: filemap_map_pages+0xb0/0x6e0
> Sep 27 00:49:20 myserver kernel: xfs_filemap_map_pages+0x41/0x60 [xfs]
> Sep 27 00:49:20 myserver kernel: do_fault+0x1a7/0x410
> Sep 27 00:49:20 myserver kernel: __handle_mm_fault+0x660/0xfa0
> Sep 27 00:49:20 myserver kernel: handle_mm_fault+0xdb/0x2d0
> Sep 27 00:49:20 myserver kernel: do_user_addr_fault+0x19c/0x570
> Sep 27 00:49:20 myserver kernel: exc_page_fault+0x70/0x170
> Sep 27 00:49:20 myserver kernel: asm_exc_page_fault+0x22/0x30
> Sep 27 00:49:20 myserver kernel: RIP: 0033:0x7f6e2c752345
> Sep 27 00:49:20 myserver kernel: Code: b4 24 d0 00 00 00 49 89 df 48 89 44 24 38 48 89 fb 4c 89 5c 24 60 eb 12 0f 1f 44 00 00 49 83 c4 04 83 e2 01 0f 85 f2 05 00 00 <41> 8b 04 24 48 89 c2 48 31 d8 48 d1 e8 75 e4 48 83 ec 08 4c 89 e0
> Sep 27 00:49:20 myserver kernel: RSP: 002b:00007ffe0d2f29a0 EFLAGS: 00010206
> Sep 27 00:49:20 myserver kernel: RAX: 00007ffe0d2f2a14 RBX: 0000000033b7606e RCX: 0000000000008003
> Sep 27 00:49:20 myserver kernel: RDX: 00007f6d9f67aff4 RSI: 0000000000000007 RDI: 0000000033b7606e
> Sep 27 00:49:20 myserver kernel: RBP: 0000000000000001 R08: 00007ffe0d2f2ae0 R09: 0000558ffcfe7aa0
> Sep 27 00:49:20 myserver kernel: R10: 00007f6e2b967510 R11: 0000000000000011 R12: 00007f6d9f687fc8
> Sep 27 00:49:20 myserver kernel: R13: 00007f6d9dc6b888 R14: 0000000000000009 R15: 0000558ffcfe7cb0
> Sep 27 00:49:20 myserver kernel: </TASK>
> Sep 27 00:49:20 myserver kernel: Modules linked in: tcp_bbr ipt_REJECT nf_reject_ipv4 xt_multiport xt_nat xt_tcpudp veth xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo xt_addrtype nft_compat nf_tables nfnetlink br_netfilter bridge stp llc overlay binfmt_misc intel_rapl_msr intel_rapl_common ghash_clmulni_intel sha512_ssse3 sha512_generic aesni_intel virtio_gpu crypto_simd cryptd virtio_dma_buf pcspkr iTCO_wdt intel_pmc_bxt virtio_console drm_shmem_helper iTCO_vendor_support watchdog virtio_rng virtio_balloon rng_core drm_kms_helper button joydev evdev sg serio_raw drm loop fuse dm_mod efi_pstore configfs qemu_fw_cfg ip_tables x_tables autofs4 xfs libcrc32c crc32c_generic hid_generic usbhid hid sr_mod cdrom sd_mod t10_pi crc64_rocksoft crc64 crc_t10dif crct10dif_generic ahci libahci virtio_net net_failover virtio_scsi xhci_pci failover libata xhci_hcd i2c_i801 i2c_smbus crct10dif_pclmul crct10dif_common scsi_mod psmouse
> Sep 27 00:49:20 myserver kernel: crc32_pclmul crc32c_intel scsi_common usbcore lpc_ich virtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev virtio virtio_ring usb_common
> Sep 27 00:49:20 myserver kernel: CR2: 00000000000000a2
> Sep 27 00:49:20 myserver kernel: ---[ end trace 0000000000000000 ]---
> Sep 27 00:49:20 myserver kernel: RIP: 0010:next_uptodate_page+0x45/0x1f0
> Sep 27 00:49:20 myserver kernel: Code: 0f 84 2f 01 00 00 48 81 ff 06 04 00 00 0f 84 a3 00 00 00 48 81 ff 02 04 00 00 0f 84 26 01 00 00 40 f6 c7 01 0f 85 8c 00 00 00 <48> 8b 07 a8 01 0f 85 81 00 00 00 8b 47 34 85 c0 74 7a 8d 50 01 4c
> Sep 27 00:49:20 myserver kernel: RSP: 0000:ffffb4de8169bcc0 EFLAGS: 00010246
> Sep 27 00:49:20 myserver kernel: RAX: 00000000000000a2 RBX: ffffb4de8169bd18 RCX: 00000000000003bd
> Sep 27 00:49:20 myserver kernel: RDX: ffffb4de8169bd18 RSI: ffff960758b9c2b0 RDI: 00000000000000a2
> Sep 27 00:49:20 myserver kernel: RBP: ffff960758b9c2b0 R08: 00000000000003bd R09: 00007f6da3ef5fff
> Sep 27 00:49:20 myserver kernel: R10: 00000000000003ae R11: 0000000000000000 R12: 00000000000003bd
> Sep 27 00:49:20 myserver kernel: R13: ffff960600431260 R14: ffff960758b9c2b0 R15: ffff9605dc7bedb0
> Sep 27 00:49:20 myserver kernel: FS: 00007f6e29110a40(0000) GS:ffff96082bf80000(0000) knlGS:0000000000000000
> Sep 27 00:49:20 myserver kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> Sep 27 00:49:20 myserver kernel: CR2: 00000000000000a2 CR3: 000000014a17a000 CR4: 0000000000350ee0
> Sep 27 00:49:20 myserver kernel: ------------[ cut here ]------------
> Sep 27 00:49:20 myserver kernel: Voluntary context switch within RCU read-side critical section!
> Sep 27 00:49:20 myserver kernel: WARNING: CPU: 3 PID: 2155714 at kernel/rcu/tree_plugin.h:320 rcu_note_context_switch+0x4ee/0x690
> Sep 27 00:49:20 myserver kernel: Modules linked in: tcp_bbr ipt_REJECT nf_reject_ipv4 xt_multiport xt_nat xt_tcpudp veth xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo xt_addrtype nft_compat nf_tables nfnetlink br_netfilter bridge stp llc overlay binfmt_misc intel_rapl_msr intel_rapl_common ghash_clmulni_intel sha512_ssse3 sha512_generic aesni_intel virtio_gpu crypto_simd cryptd virtio_dma_buf pcspkr iTCO_wdt intel_pmc_bxt virtio_console drm_shmem_helper iTCO_vendor_support watchdog virtio_rng virtio_balloon rng_core drm_kms_helper button joydev evdev sg serio_raw drm loop fuse dm_mod efi_pstore configfs qemu_fw_cfg ip_tables x_tables autofs4 xfs libcrc32c crc32c_generic hid_generic usbhid hid sr_mod cdrom sd_mod t10_pi crc64_rocksoft crc64 crc_t10dif crct10dif_generic ahci libahci virtio_net net_failover virtio_scsi xhci_pci failover libata xhci_hcd i2c_i801 i2c_smbus crct10dif_pclmul crct10dif_common scsi_mod psmouse
> Sep 27 00:49:20 myserver kernel: crc32_pclmul crc32c_intel scsi_common usbcore lpc_ich virtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev virtio virtio_ring usb_common
> Sep 27 00:49:20 myserver kernel: CPU: 3 PID: 2155714 Comm: postmaster Tainted: G D 6.1.0-12-amd64 #1 Debian 6.1.52-1
> Sep 27 00:49:20 myserver kernel: Hardware name: Hetzner vServer/Standard PC (Q35 + ICH9, 2009), BIOS 20171111 11/11/2017
> Sep 27 00:49:20 myserver kernel: RIP: 0010:rcu_note_context_switch+0x4ee/0x690
> Sep 27 00:49:20 myserver kernel: Code: 49 89 3f 49 83 bc 24 98 00 00 00 00 0f 85 66 fe ff ff e9 58 fe ff ff 48 c7 c7 30 23 76 a6 c6 05 59 0f ad 01 01 e8 52 89 f6 ff <0f> 0b e9 70 fb ff ff a9 ff ff ff 7f 0f 84 2c fc ff ff 65 48 8b 3c
> Sep 27 00:49:20 myserver kernel: RSP: 0018:ffffb4de8169bc60 EFLAGS: 00010086
> Sep 27 00:49:20 myserver kernel: RAX: 0000000000000000 RBX: ffff96082bfb1c00 RCX: 0000000000000000
> Sep 27 00:49:20 myserver kernel: RDX: 0000000000000003 RSI: ffffffffa679e27e RDI: 00000000ffffffff
> Sep 27 00:49:20 myserver kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: ffffb4de8169bad0
> Sep 27 00:49:20 myserver kernel: R10: 0000000000000003 R11: ffffffffa6ed43c8 R12: 0000000000030e40
> Sep 27 00:49:20 myserver kernel: R13: ffff9606ce16e600 R14: ffffb4de8169bd50 R15: 0000000000000000
> Sep 27 00:49:20 myserver kernel: FS: 0000000000000000(0000) GS:ffff96082bf80000(0000) knlGS:0000000000000000
> Sep 27 00:49:20 myserver kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> Sep 27 00:49:20 myserver kernel: CR2: 00000000000000a2 CR3: 00000001fc610000 CR4: 0000000000350ee0
> Sep 27 00:49:20 myserver kernel: Call Trace:
> Sep 27 00:49:20 myserver kernel: <TASK>
> Sep 27 00:49:20 myserver kernel: ? __warn+0x7d/0xc0
> Sep 27 00:49:20 myserver kernel: ? rcu_note_context_switch+0x4ee/0x690
> Sep 27 00:49:20 myserver kernel: ? report_bug+0xe6/0x170
> Sep 27 00:49:20 myserver kernel: ? irq_work_queue+0xa/0x50
> Sep 27 00:49:20 myserver kernel: ? handle_bug+0x41/0x70
> Sep 27 00:49:20 myserver kernel: ? exc_invalid_op+0x13/0x60
> Sep 27 00:49:20 myserver kernel: ? asm_exc_invalid_op+0x16/0x20
> Sep 27 00:49:20 myserver kernel: ? rcu_note_context_switch+0x4ee/0x690
> Sep 27 00:49:20 myserver kernel: __schedule+0xac/0xa20
> Sep 27 00:49:20 myserver kernel: schedule+0x5d/0xe0
> Sep 27 00:49:20 myserver kernel: rwsem_down_write_slowpath+0x34e/0x730
> Sep 27 00:49:20 myserver kernel: exit_mmap+0xf6/0x2f0
> Sep 27 00:49:20 myserver kernel: __mmput+0x3e/0x130
> Sep 27 00:49:20 myserver kernel: do_exit+0x2fc/0xb10
> Sep 27 00:49:20 myserver kernel: make_task_dead+0x8d/0x90
> Sep 27 00:49:20 myserver kernel: rewind_stack_and_make_dead+0x17/0x20
> Sep 27 00:49:20 myserver kernel: RIP: 0033:0x7f6e2c752345
> Sep 27 00:49:20 myserver kernel: Code: Unable to access opcode bytes at 0x7f6e2c75231b.
> Sep 27 00:49:20 myserver kernel: RSP: 002b:00007ffe0d2f29a0 EFLAGS: 00010206
> Sep 27 00:49:20 myserver kernel: RAX: 00007ffe0d2f2a14 RBX: 0000000033b7606e RCX: 0000000000008003
> Sep 27 00:49:20 myserver kernel: RDX: 00007f6d9f67aff4 RSI: 0000000000000007 RDI: 0000000033b7606e
> Sep 27 00:49:20 myserver kernel: RBP: 0000000000000001 R08: 00007ffe0d2f2ae0 R09: 0000558ffcfe7aa0
> Sep 27 00:49:20 myserver kernel: R10: 00007f6e2b967510 R11: 0000000000000011 R12: 00007f6d9f687fc8
> Sep 27 00:49:20 myserver kernel: R13: 00007f6d9dc6b888 R14: 0000000000000009 R15: 0000558ffcfe7cb0
> Sep 27 00:49:20 myserver kernel: </TASK>
> Sep 27 00:49:20 myserver kernel: ---[ end trace 0000000000000000 ]---
> Sep 27 00:49:41 myserver kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
> Sep 27 00:49:41 myserver kernel: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-3): P2155714/1:b..l
> Sep 27 00:49:41 myserver kernel: (detected by 3, t=5252 jiffies, g=242861801, q=8379 ncpus=4)
> Sep 27 00:49:42 myserver kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P2155714 } 5276 jiffies s: 1125909 root: 0x0/T
> Sep 27 00:49:42 myserver kernel: rcu: blocking rcu_node structures (internal RCU debug):
> ================================
>
>
> However the system still stays up for a few hours after that, after which it throws another call trace and hard crashes soon after that:
>
>
> ================================
> Sep 27 03:19:24 myserver sshd[2176647]: fatal: fork of unprivileged child failed
> Sep 27 03:19:53 myserver kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
> Sep 27 03:19:59 myserver kernel: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-3): P2155714/1:b..l
> Sep 27 03:20:02 myserver kernel: (detected by 1, t=2258248 jiffies, g=242861801, q=5722891 ncpus=4)
> Sep 27 03:20:28 myserver kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P2155714 } 2259100 jiffies s: 1125909 root: 0x0/T
> Sep 27 03:20:31 myserver kernel: rcu: blocking rcu_node structures (internal RCU debug):
> Sep 27 03:20:50 myserver kernel: redis-server invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
> Sep 27 03:20:51 myserver kernel: CPU: 2 PID: 1442 Comm: redis-server Tainted: G D W 6.1.0-12-amd64 #1 Debian 6.1.52-1
> Sep 27 03:20:51 myserver kernel: Hardware name: Hetzner vServer/Standard PC (Q35 + ICH9, 2009), BIOS 20171111 11/11/2017
> Sep 27 03:20:51 myserver kernel: Call Trace:
> Sep 27 03:20:51 myserver kernel: <TASK>
> Sep 27 03:20:51 myserver kernel: dump_stack_lvl+0x44/0x5c
> Sep 27 03:20:51 myserver kernel: dump_header+0x4a/0x211
> Sep 27 03:20:51 myserver kernel: oom_kill_process.cold+0xb/0x10
> Sep 27 03:20:51 myserver kernel: out_of_memory+0x1fd/0x4c0
> Sep 27 03:20:51 myserver kernel: __alloc_pages_slowpath.constprop.0+0xc73/0xdc0
> Sep 27 03:20:51 myserver kernel: __alloc_pages+0x305/0x330
> Sep 27 03:20:51 myserver kernel: folio_alloc+0x17/0x50
> Sep 27 03:20:51 myserver kernel: __filemap_get_folio+0x155/0x340
> Sep 27 03:20:51 myserver kernel: filemap_fault+0x139/0x910
> Sep 27 03:20:51 myserver kernel: __do_fault+0x33/0x110
> Sep 27 03:20:51 myserver kernel: do_fault+0x1b9/0x410
> Sep 27 03:20:51 myserver kernel: __handle_mm_fault+0x660/0xfa0
> Sep 27 03:20:51 myserver kernel: handle_mm_fault+0xdb/0x2d0
> Sep 27 03:20:51 myserver kernel: do_user_addr_fault+0x19c/0x570
> Sep 27 03:20:51 myserver kernel: exc_page_fault+0x70/0x170
> Sep 27 03:20:51 myserver kernel: asm_exc_page_fault+0x22/0x30
> Sep 27 03:20:51 myserver kernel: RIP: 0033:0x5557864c7fb4
> Sep 27 03:20:51 myserver kernel: Code: Unable to access opcode bytes at 0x5557864c7f8a.
> Sep 27 03:20:51 myserver kernel: RSP: 002b:00007ffda9044ad0 EFLAGS: 00010202
> Sep 27 03:20:51 myserver kernel: RAX: 0000000000000000 RBX: 00005557867ca580 RCX: 00005557866a7fad
> Sep 27 03:20:51 myserver kernel: RDX: 0000000000813000 RSI: 0000000000000000 RDI: 00005557869defa0
> Sep 27 03:20:51 myserver kernel: RBP: 0000011bfff0f7c0 R08: 00007ffda9044aa0 R09: 0000000000000000
> Sep 27 03:20:51 myserver kernel: R10: 00005557866fac00 R11: 0000555786714e83 R12: 00005557867cbbe0
> Sep 27 03:20:51 myserver kernel: R13: 0000000000000000 R14: 00000000207e7e5d R15: 00000000042e44c6
> Sep 27 03:20:51 myserver kernel: </TASK>
> Sep 27 03:20:51 myserver kernel: Mem-Info:
> Sep 27 03:20:51 myserver kernel: active_anon:1098265 inactive_anon:221542 isolated_anon:0
> active_file:29 inactive_file:1039 isolated_file:155
> unevictable:768 dirty:0 writeback:0
> slab_reclaimable:148451 slab_unreclaimable:358991
> mapped:241741 shmem:540182 pagetables:50339
> sec_pagetables:0 bounce:0
> kernel_misc_reclaimable:0
> free:26631 free_pcp:1 free_cma:0
> Sep 27 03:20:51 myserver kernel: Node 0 active_anon:4393060kB inactive_anon:886168kB active_file:116kB inactive_file:4152kB unevictable:3072kB isolated(anon):0kB isolated(file):820kB mapped:966964kB dirty:0kB writeback:0kB shmem:2160728kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 18432kB writeback_tmp:0kB kernel_stack:27184kB pagetables:201356kB sec_pagetables:0kB all_unreclaimable? no
> Sep 27 03:20:51 myserver kernel: Node 0 DMA free:14336kB boost:0kB min:128kB low:160kB high:192kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
> Sep 27 03:20:51 myserver kernel: lowmem_reserve[]: 0 1938 7698 7698 7698
> Sep 27 03:20:51 myserver kernel: Node 0 DMA32 free:39988kB boost:0kB min:16980kB low:21224kB high:25468kB reserved_highatomic:0KB active_anon:999504kB inactive_anon:233396kB active_file:204kB inactive_file:1652kB unevictable:0kB writepending:0kB present:2080624kB managed:2015088kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
> Sep 27 03:20:51 myserver kernel: lowmem_reserve[]: 0 0 5760 5760 5760
> Sep 27 03:20:51 myserver kernel: Node 0 Normal free:52200kB boost:0kB min:50468kB low:63084kB high:75700kB reserved_highatomic:2048KB active_anon:3393556kB inactive_anon:652772kB active_file:56kB inactive_file:3424kB unevictable:3072kB writepending:0kB present:6094848kB managed:5906232kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
> Sep 27 03:20:51 myserver kernel: lowmem_reserve[]: 0 0 0 0 0
> Sep 27 03:20:51 myserver kernel: Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB (M) 3*4096kB (M) = 14336kB
> Sep 27 03:20:51 myserver kernel: Node 0 DMA32: 1041*4kB (UM) 535*8kB (UME) 382*16kB (UM) 241*32kB (UME) 151*64kB (UME) 46*128kB (UM) 1*256kB (M) 2*512kB (M) 0*1024kB 1*2048kB (E) 0*4096kB = 41148kB
> Sep 27 03:20:51 myserver kernel: Node 0 Normal: 1398*4kB (UM) 1158*8kB (UME) 1020*16kB (UM) 379*32kB (UM) 139*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 52200kB
> Sep 27 03:20:51 myserver kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
> Sep 27 03:20:51 myserver kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
> Sep 27 03:20:51 myserver kernel: 543215 total pagecache pages
> Sep 27 03:20:51 myserver kernel: 1732 pages in swap cache
> Sep 27 03:20:51 myserver kernel: Free swap = 0kB
> Sep 27 03:20:51 myserver kernel: Total swap = 2097148kB
> Sep 27 03:20:51 myserver kernel: 2047866 pages RAM
> Sep 27 03:20:51 myserver kernel: 0 pages HighMem/MovableOnly
> Sep 27 03:20:51 myserver kernel: 63696 pages reserved
> Sep 27 03:20:51 myserver kernel: 0 pages hwpoisoned
> Sep 27 03:20:51 myserver kernel: Out of memory: Killed process 2176501 (postmaster) total-vm:2402612kB, anon-rss:61216kB, file-rss:0kB, shmem-rss:931292kB, UID:101 pgtables:4600kB oom_score_adj:0
> Sep 27 03:20:51 myserver systemd[1]: docker-f56204f19a266d718f04900bd81d5add3bcefac782624f38d61d0e4d8a6ce32e.scope: A process of this unit has been killed by the OOM killer.
> Sep 27 03:20:52 myserver sshd[2176678]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=46.105.142.10 user=root
> Sep 27 03:20:56 myserver kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
> Sep 27 03:20:56 myserver kernel: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-3): P2155714/1:b..l
> Sep 27 03:20:56 myserver kernel: (detected by 1, t=2274003 jiffies, g=242861801, q=5742055 ncpus=4)
> Sep 27 03:21:01 myserver kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P2155714 } 2274971 jiffies s: 1125909 root: 0x0/T
> Sep 27 03:21:01 myserver kernel: rcu: blocking rcu_node structures (internal RCU debug):
> ================================
>
>
> It appears that this same bug has been identified related to XFS, and a patch appears to be in the works:
> - https://lore.kernel.org/lkml/ZMHkLA+r2K6hKsr5@casper.infradead.org/t/#rdb5b8586f93807a02857ac75dfb041c386f4c170
> - https://bugzilla.kernel.org/show_bug.cgi?id=216646
Thanks for the report. This should be fixed upstream 6.1.53 and
pending now for the next upload for bookworm.
Regards,
Salvatore
Reply to: