Bug#980352: linux-image-5.10.0-1-amd64: fscache/CacheFiles crashing with assertion failure
Package: src:linux
Version: 5.10.4-1
Severity: important
X-Debbugs-Cc: lists@d.sb
Dear Maintainer,
I'm seeing an assertion failure when attempting to use fscache with NFS. This is causing programs that read from the NFS share to crash.
Trace:
=====================================================================
Jan 10 10:36:05 chi03 kernel: [819715.729949] CacheFiles:
Jan 10 10:36:05 chi03 kernel: [819715.732895] CacheFiles: Assertion failed
Jan 10 10:36:05 chi03 kernel: [819715.733268] ------------[ cut here ]------------
Jan 10 10:36:05 chi03 kernel: [819715.733671] kernel BUG at fs/cachefiles/rdwr.c:716!
Jan 10 10:36:05 chi03 kernel: [819715.734055] invalid opcode: 0000 [#20] SMP PTI
Jan 10 10:36:05 chi03 kernel: [819715.734418] CPU: 1 PID: 342823 Comm: node Tainted: G D 5.9.0-5-cloud-amd64 #1 Debian 5.9.15-1
Jan 10 10:36:05 chi03 kernel: [819715.735104] Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
Jan 10 10:36:05 chi03 kernel: [819715.735555] RIP: 0010:cachefiles_read_or_alloc_pages.cold+0x20/0x56 [cachefiles]
Jan 10 10:36:05 chi03 kernel: [819715.736151] Code: be 97 ff ff ff e9 08 db ff ff 4d 87 e5 e9 83 ea ff ff 48 c7 c7 70 1b a3 c0 e8 15 68 bb fb 48 c7 c7 48 28 a3 c0 e8 09 68 bb fb <0f> 0b 48 c7 c7 70 1b a3 c0 e8 fb 67 bb fb 48 c7 c7 48 28 a3 c0 e8
Jan 10 10:36:05 chi03 kernel: [819715.737228] RSP: 0018:ffffa8de01deba38 EFLAGS: 00010246
Jan 10 10:36:05 chi03 kernel: [819715.737629] RAX: 000000000000001c RBX: ffffa8de01debd30 RCX: ffff98be2fc98488
Jan 10 10:36:05 chi03 kernel: [819715.738189] RDX: 0000000000000000 RSI: 0000000000000027 RDI: ffff98be2fc98480
Jan 10 10:36:05 chi03 kernel: [819715.738739] RBP: ffff98bd1a594900 R08: 0000000000000a5c R09: 0000000000000019
Jan 10 10:36:05 chi03 kernel: [819715.739291] R10: 0000000000000764 R11: ffffa8de01deb8ce R12: ffff98bc86364120
Jan 10 10:36:05 chi03 kernel: [819715.739842] R13: ffffa8de01debd30 R14: ffffa8de01debbc4 R15: ffff98bc7ccbf9e8
Jan 10 10:36:05 chi03 kernel: [819715.740400] FS: 00007f4ee30a8b20(0000) GS:ffff98be2fc80000(0000) knlGS:0000000000000000
Jan 10 10:36:05 chi03 kernel: [819715.740980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 10 10:36:05 chi03 kernel: [819715.741396] CR2: 0000559668694000 CR3: 00000002ecdf0004 CR4: 00000000001706a0
Jan 10 10:36:05 chi03 kernel: [819715.741947] Call Trace:
Jan 10 10:36:05 chi03 kernel: [819715.742312] ? load_balance+0x174/0xd50
Jan 10 10:36:05 chi03 kernel: [819715.742674] ? _cond_resched+0x16/0x40
Jan 10 10:36:05 chi03 kernel: [819715.743048] ? fscache_alloc_retrieval+0x2f/0xe0 [fscache]
Jan 10 10:36:05 chi03 kernel: [819715.743450] ? kmem_cache_alloc_trace+0xf5/0x210
Jan 10 10:36:05 chi03 kernel: [819715.743825] ? fscache_run_op+0x56/0xb0 [fscache]
Jan 10 10:36:05 chi03 kernel: [819715.759972] __fscache_read_or_alloc_pages+0x235/0x2e0 [fscache]
Jan 10 10:36:05 chi03 kernel: [819715.760412] __nfs_readpages_from_fscache+0x60/0x160 [nfs]
Jan 10 10:36:05 chi03 kernel: [819715.760828] nfs_readpages+0xb5/0x1e0 [nfs]
Jan 10 10:36:05 chi03 kernel: [819715.761192] ? bpf_prog_664d279cfb0774e6_netdata_sys_rea+0x51d/0x674
Jan 10 10:36:05 chi03 kernel: [819715.761641] read_pages+0x185/0x270
Jan 10 10:36:05 chi03 kernel: [819715.762046] page_cache_readahead_unbounded+0x1b2/0x230
Jan 10 10:36:05 chi03 kernel: [819715.762468] generic_file_buffered_read+0x59b/0xa50
Jan 10 10:36:05 chi03 kernel: [819715.762866] ? nfs4_get_valid_delegation+0x30/0x30 [nfsv4]
Jan 10 10:36:05 chi03 kernel: [819715.763284] nfs_file_read+0x6d/0xa0 [nfs]
Jan 10 10:36:05 chi03 kernel: [819715.763691] new_sync_read+0x112/0x1a0
Jan 10 10:36:05 chi03 kernel: [819715.764028] vfs_read+0xf8/0x180
Jan 10 10:36:05 chi03 kernel: [819715.764344] ksys_read+0x5f/0xe0
Jan 10 10:36:05 chi03 kernel: [819715.764673] do_syscall_64+0x33/0x40
Jan 10 10:36:05 chi03 kernel: [819715.765004] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jan 10 10:36:05 chi03 kernel: [819715.765395] RIP: 0033:0x7f4ee8761879
Jan 10 10:36:05 chi03 kernel: [819715.765730] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 4d d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08 00 55
Jan 10 10:36:05 chi03 kernel: [819715.766806] RSP: 002b:00007f4ee30a8538 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
Jan 10 10:36:05 chi03 kernel: [819715.767428] RAX: ffffffffffffffda RBX: 00007f4ee30a8b20 RCX: 00007f4ee8761879
Jan 10 10:36:05 chi03 kernel: [819715.767996] RDX: 0000000000009117 RSI: 00005596684e5f20 RDI: 0000000000000012
Jan 10 10:36:05 chi03 kernel: [819715.768539] RBP: 00007f4ee30a86b0 R08: 0000000000000000 R09: 0000000000000000
Jan 10 10:36:05 chi03 kernel: [819715.769083] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
Jan 10 10:36:05 chi03 kernel: [819715.769630] R13: 0000000000000012 R14: 00005596684e5f20 R15: 00005596658be240
Jan 10 10:36:05 chi03 kernel: [819715.770171] Modules linked in: xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat br_netfilter overlay dm_snapshot unix_diag cachefiles binfmt_misc veth dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio nft_masq nft_chain_nat bridge stp llc ebtable_filter ebtables ip6table_raw ip6table_mangle ip6table_nat ip6table_filter ip6_tables iptable_raw iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c iptable_filter nf_tables nfnetlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver wireguard libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s nfs blake2s_x86_64 libblake2s_generic curve25519_x86_64 libcurve25519_generic libchacha lockd grace nfs_ssc fscache squashfs intel_rapl_msr intel_rapl_common iosf_mbi crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel crypto_simd cryptd glue_helper loop evdev serio_raw virtio_balloon sg qemu_fw_cfg button
Jan 10 10:36:05 chi03 kernel: [819715.770199] tcp_bbr sch_fq sunrpc fuse configfs ip_tables x_tables autofs4 sr_mod cdrom ata_generic dm_mod virtio_net virtio_blk net_failover failover ata_piix libata scsi_mod crc32c_intel virtio_pci virtio_ring virtio
Jan 10 10:36:05 chi03 kernel: [819715.775958] ---[ end trace c25d8a996c426576 ]---
=====================================================================
I saw an upstream bug report (https://bugzilla.kernel.org/show_bug.cgi?id=208883), however the backtrace is different so I'm not 100% sure if it's the same issue or not.
Regards,
Daniel
-- Package-specific info:
** Kernel log: boot messages should be attached
** Model information
sys_vendor: Red Hat
product_name: KVM
product_version: RHEL 7.6.0 PC (i440FX + PIIX, 1996)
chassis_vendor: Red Hat
chassis_version: RHEL 7.6.0 PC (i440FX + PIIX, 1996)
bios_vendor: SeaBIOS
bios_version: 1.11.0-2.el7
** PCI devices:
00:00.0 Host bridge [0600]: Intel Corporation 440FX - 82441FX PMC [Natoma] [8086:1237] (rev 02)
Subsystem: Red Hat, Inc. Qemu virtual machine [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
00:01.0 ISA bridge [0601]: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] [8086:7000]
Subsystem: Red Hat, Inc. Qemu virtual machine [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
00:01.1 IDE interface [0101]: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] [8086:7010] (prog-if 80 [ISA Compatibility mode-only controller, supports bus mastering])
Subsystem: Red Hat, Inc. Qemu virtual machine [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Region 0: Memory at 000001f0 (32-bit, non-prefetchable) [virtual] [size=8]
Region 1: Memory at 000003f0 (type 3, non-prefetchable) [virtual]
Region 2: Memory at 00000170 (32-bit, non-prefetchable) [virtual] [size=8]
Region 3: Memory at 00000370 (type 3, non-prefetchable) [virtual]
Region 4: I/O ports at c0c0 [virtual] [size=16]
Kernel driver in use: ata_piix
Kernel modules: ata_piix, ata_generic
00:01.2 USB controller [0c03]: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] [8086:7020] (rev 01) (prog-if 00 [UHCI])
Subsystem: Red Hat, Inc. QEMU Virtual Machine [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin D routed to IRQ 11
Region 4: I/O ports at c040 [size=32]
00:01.3 Bridge [0680]: Intel Corporation 82371AB/EB/MB PIIX4 ACPI [8086:7113] (rev 03)
Subsystem: Red Hat, Inc. Qemu virtual machine [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 9
00:02.0 VGA compatible controller [0300]: Cirrus Logic GD 5446 [1013:00b8] (prog-if 00 [VGA controller])
Subsystem: Red Hat, Inc. QEMU Virtual Machine [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Region 0: Memory at fc000000 (32-bit, prefetchable) [size=32M]
Region 1: Memory at febd0000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at 000c0000 [disabled] [size=128K]
00:03.0 Ethernet controller [0200]: Red Hat, Inc. Virtio network device [1af4:1000]
Subsystem: Red Hat, Inc. Virtio network device [1af4:0001]
Physical Slot: 3
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 11
Region 0: I/O ports at c060 [size=32]
Region 1: Memory at febd1000 (32-bit, non-prefetchable) [size=4K]
Region 4: Memory at fe000000 (64-bit, prefetchable) [size=16K]
Expansion ROM at feb40000 [disabled] [size=256K]
Capabilities: <access denied>
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci
00:04.0 Ethernet controller [0200]: Red Hat, Inc. Virtio network device [1af4:1000]
Subsystem: Red Hat, Inc. Virtio network device [1af4:0001]
Physical Slot: 4
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 10
Region 0: I/O ports at c080 [size=32]
Region 1: Memory at febd2000 (32-bit, non-prefetchable) [size=4K]
Region 4: Memory at fe004000 (64-bit, prefetchable) [size=16K]
Expansion ROM at feb80000 [disabled] [size=256K]
Capabilities: <access denied>
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci
00:05.0 SCSI storage controller [0100]: Red Hat, Inc. Virtio block device [1af4:1001]
Subsystem: Red Hat, Inc. Virtio block device [1af4:0002]
Physical Slot: 5
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 10
Region 0: I/O ports at c000 [size=64]
Region 1: Memory at febd3000 (32-bit, non-prefetchable) [size=4K]
Region 4: Memory at fe008000 (64-bit, prefetchable) [size=16K]
Capabilities: <access denied>
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci
00:06.0 Unclassified device [00ff]: Red Hat, Inc. Virtio memory balloon [1af4:1002]
Subsystem: Red Hat, Inc. Virtio memory balloon [1af4:0005]
Physical Slot: 6
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 11
Region 0: I/O ports at c0a0 [size=32]
Region 4: Memory at fe00c000 (64-bit, prefetchable) [size=16K]
Capabilities: <access denied>
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci
** USB devices:
not available
-- System Information:
Debian Release: bullseye/sid
APT prefers testing
APT policy: (500, 'testing')
Architecture: amd64 (x86_64)
Kernel: Linux 5.9.0-5-cloud-amd64 (SMP w/3 CPU threads)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages linux-image-5.10.0-1-amd64 depends on:
ii initramfs-tools [linux-initramfs-tool] 0.139
ii kmod 28-1
ii linux-base 4.6
Versions of packages linux-image-5.10.0-1-amd64 recommends:
ii apparmor 2.13.6-3
ii firmware-linux-free 20200122-1
Versions of packages linux-image-5.10.0-1-amd64 suggests:
pn debian-kernel-handbook <none>
ii grub-pc 2.04-12
pn linux-doc-5.10 <none>
Versions of packages linux-image-5.10.0-1-amd64 is related to:
pn firmware-amd-graphics <none>
pn firmware-atheros <none>
pn firmware-bnx2 <none>
pn firmware-bnx2x <none>
pn firmware-brcm80211 <none>
pn firmware-cavium <none>
pn firmware-intel-sound <none>
pn firmware-intelwimax <none>
pn firmware-ipw2x00 <none>
pn firmware-ivtv <none>
pn firmware-iwlwifi <none>
pn firmware-libertas <none>
pn firmware-linux-nonfree <none>
pn firmware-misc-nonfree <none>
pn firmware-myricom <none>
pn firmware-netxen <none>
pn firmware-qlogic <none>
pn firmware-realtek <none>
pn firmware-samsung <none>
pn firmware-siano <none>
pn firmware-ti-connectivity <none>
pn xen-hypervisor <none>
-- no debconf information
Reply to: