Bug#947413: linux-image-4.19.0-7-amd64: kernel lockup
Package: src:linux
Version: 4.19.87-1
Dear Maintainer,
* What led up to the situation?
Not sure exactly. Normal operations.
I'll include some facts that I suspect might be relevant:
Most volumes are mounted with the "discard" option. The I/O operations in question seem to have involved /var, which is ext4, mounted with discard.
This looks to me like it *could* be related:
https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/block?h=v4.19.91&id=42d72c9d28964fbbaeaa15baf2e7ce418d1c1a0a
When this issue happened I was using mq-deadline, I tried switching to bfq in the process of investigating the possible causes.
I do not yet have a way to reproduce this behavior.
* What was the outcome of this action?
Dec 25 07:15:57 be1va kernel: [698773.335359] BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
Dec 25 07:15:57 be1va kernel: [698773.338614] PGD 0 P4D 0
Dec 25 07:15:57 be1va kernel: [698773.339537] Oops: 0000 [#1] SMP NOPTI
Dec 25 07:15:57 be1va kernel: [698773.340914] CPU: 29 PID: 784 Comm: kworker/29:1H Not tainted 4.19.0-7-amd64 #1 Debian 4.19.87-1
Dec 25 07:15:57 be1va kernel: [698773.344187] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
Dec 25 07:15:57 be1va kernel: [698773.347903] Workqueue: kblockd blk_mq_run_work_fn
Dec 25 07:15:57 be1va kernel: [698773.349978] RIP: 0010:rb_next+0x11/0x50
Dec 25 07:15:57 be1va kernel: [698773.351545] Code: 89 ec 48 89 c5 e9 80 fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 8b 0f 48 39 cf 74 39 48 8b 47 08 48 85 c0 74 22 <48> 8b 50 10 48 85 d2 74 0c 48 89 d0 48 8b 50 10 48 85 d2 75 f4 c3
Dec 25 07:15:57 be1va kernel: [698773.357983] RSP: 0018:ffffa075c73bfdb0 EFLAGS: 00010206
Dec 25 07:15:57 be1va kernel: [698773.359782] RAX: 0000000000000018 RBX: ffff901819663e00 RCX: ffffdb8d639239c0
Dec 25 07:15:57 be1va kernel: [698773.362331] RDX: ffff901819663e68 RSI: 0000000000000001 RDI: ffff90181519ea60
Dec 25 07:15:57 be1va kernel: [698773.364686] RBP: ffff90181519ea00 R08: 0000000000000000 R09: 0000000000480020
Dec 25 07:15:57 be1va kernel: [698773.367346] R10: 00000015d519e000 R11: 0000000000000000 R12: ffff901819663e5c
Dec 25 07:15:57 be1va kernel: [698773.369754] R13: 0000000000000001 R14: ffff901819663e10 R15: ffff90181519d6c0
Dec 25 07:15:57 be1va kernel: [698773.372166] FS: 0000000000000000(0000) GS:ffff901827b40000(0000) knlGS:0000000000000000
Dec 25 07:15:57 be1va kernel: [698773.375158] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 25 07:15:57 be1va kernel: [698773.377238] CR2: 0000000000000028 CR3: 00000002df80a002 CR4: 0000000000360ee0
Dec 25 07:15:57 be1va kernel: [698773.379495] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 25 07:15:57 be1va kernel: [698773.382132] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Dec 25 07:15:57 be1va kernel: [698773.384604] Call Trace:
Dec 25 07:15:57 be1va kernel: [698773.385590] dd_dispatch_request+0x15f/0x210
Dec 25 07:15:57 be1va kernel: [698773.387083] blk_mq_do_dispatch_sched+0xc7/0x120
Dec 25 07:15:57 be1va kernel: [698773.388752] blk_mq_sched_dispatch_requests+0x11e/0x170
Dec 25 07:15:57 be1va kernel: [698773.390857] __blk_mq_run_hw_queue+0x4e/0xe0
Dec 25 07:15:57 be1va kernel: [698773.392508] process_one_work+0x1a7/0x3a0
Dec 25 07:15:57 be1va kernel: [698773.393888] worker_thread+0x30/0x390
Dec 25 07:15:57 be1va kernel: [698773.395354] ? create_worker+0x1a0/0x1a0
Dec 25 07:15:57 be1va kernel: [698773.396927] kthread+0x112/0x130
Dec 25 07:15:57 be1va kernel: [698773.398221] ? kthread_bind+0x30/0x30
Dec 25 07:15:57 be1va kernel: [698773.399943] ret_from_fork+0x1f/0x40
Dec 25 07:15:57 be1va kernel: [698773.401562] Modules linked in: rpcsec_gss_krb5 nfsv4 dns_resolver nfsd auth_rpcgss nfs_acl nfs lockd grace fscache sunrpc sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcc_cpufreq virtio_console virtio_balloon sg joydev serio_raw evdev pcspkr button qemu_fw_cfg ext4 crc16 mbcache jbd2 crc32c_generic fscrypto ecb sd_mod ata_generic virtio_net net_failover virtio_scsi failover crc32c_intel ata_piix uhci_hcd libata ehci_hcd aesni_intel aes_x86_64 virtio_pci crypto_simd scsi_mod usbcore virtio_ring cryptd psmouse glue_helper virtio i2c_piix4 usb_common floppy
Dec 25 07:15:57 be1va kernel: [698773.420978] CR2: 0000000000000028
Dec 25 07:15:57 be1va kernel: [698773.422326] ---[ end trace a1e4f02f504cc7b4 ]---
Dec 25 07:15:57 be1va kernel: [698773.424075] RIP: 0010:rb_next+0x11/0x50
Dec 25 07:15:57 be1va kernel: [698773.425534] Code: 89 ec 48 89 c5 e9 80 fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 8b 0f 48 39 cf 74 39 48 8b 47 08 48 85 c0 74 22 <48> 8b 50 10 48 85 d2 74 0c 48 89 d0 48 8b 50 10 48 85 d2 75 f4 c3
Dec 25 07:15:57 be1va kernel: [698773.433054] RSP: 0018:ffffa075c73bfdb0 EFLAGS: 00010206
Dec 25 07:15:57 be1va kernel: [698773.434964] RAX: 0000000000000018 RBX: ffff901819663e00 RCX: ffffdb8d639239c0
Dec 25 07:15:57 be1va kernel: [698773.437696] RDX: ffff901819663e68 RSI: 0000000000000001 RDI: ffff90181519ea60
Dec 25 07:15:57 be1va kernel: [698773.440522] RBP: ffff90181519ea00 R08: 0000000000000000 R09: 0000000000480020
Dec 25 07:15:57 be1va kernel: [698773.443030] R10: 00000015d519e000 R11: 0000000000000000 R12: ffff901819663e5c
Dec 25 07:15:57 be1va kernel: [698773.445869] R13: 0000000000000001 R14: ffff901819663e10 R15: ffff90181519d6c0
Dec 25 07:15:57 be1va kernel: [698773.448579] FS: 0000000000000000(0000) GS:ffff901827b40000(0000) knlGS:0000000000000000
Dec 25 07:15:57 be1va kernel: [698773.451640] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 25 07:15:57 be1va kernel: [698773.453748] CR2: 0000000000000028 CR3: 00000002df80a002 CR4: 0000000000360ee0
Dec 25 07:15:57 be1va kernel: [698773.456494] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 25 07:15:57 be1va kernel: [698773.459233] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
<....>
Dec 25 07:16:27 be1va kernel: [698802.699943] rcu: INFO: rcu_sched self-detected stall on CPU
Dec 25 07:16:27 be1va kernel: [698802.704683] rcu: 20-....: (5249 ticks this GP) idle=e76/1/0x4000000000000002 softirq=8337517/8337517 fqs=2398
Dec 25 07:16:27 be1va kernel: [698802.707857] rcu: (t=5250 jiffies g=209100837 q=9450)
Dec 25 07:16:27 be1va kernel: [698802.709506] NMI backtrace for cpu 20
Dec 25 07:16:27 be1va kernel: [698802.710613] CPU: 20 PID: 2333 Comm: newrelic-infra Tainted: G D 4.19.0-7-amd64 #1 Debian 4.19.87-1
Dec 25 07:16:27 be1va kernel: [698802.713877] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
Dec 25 07:16:27 be1va kernel: [698802.716668] Call Trace:
Dec 25 07:16:27 be1va kernel: [698802.717437] <IRQ>
Dec 25 07:16:27 be1va kernel: [698802.718090] dump_stack+0x66/0x90
Dec 25 07:16:27 be1va kernel: [698802.719117] nmi_cpu_backtrace.cold.4+0x13/0x50
Dec 25 07:16:27 be1va kernel: [698802.720687] ? lapic_can_unplug_cpu.cold.31+0x37/0x37
Dec 25 07:16:27 be1va kernel: [698802.722200] nmi_trigger_cpumask_backtrace+0xf9/0xfb
Dec 25 07:16:27 be1va kernel: [698802.723778] rcu_dump_cpu_stacks+0x9b/0xcb
Dec 25 07:16:27 be1va kernel: [698802.725124] rcu_check_callbacks.cold.81+0x1db/0x335
Dec 25 07:16:27 be1va kernel: [698802.726679] ? tick_sched_do_timer+0x60/0x60
Dec 25 07:16:27 be1va kernel: [698802.728168] update_process_times+0x28/0x60
Dec 25 07:16:27 be1va kernel: [698802.729534] tick_sched_handle+0x22/0x60
Dec 25 07:16:27 be1va kernel: [698802.730789] tick_sched_timer+0x37/0x70
Dec 25 07:16:27 be1va kernel: [698802.732131] __hrtimer_run_queues+0x100/0x280
Dec 25 07:16:27 be1va kernel: [698802.733542] hrtimer_interrupt+0x100/0x220
Dec 25 07:16:27 be1va kernel: [698802.734783] smp_apic_timer_interrupt+0x6a/0x140
Dec 25 07:16:27 be1va kernel: [698802.736382] apic_timer_interrupt+0xf/0x20
Dec 25 07:16:27 be1va kernel: [698802.737597] </IRQ>
Dec 25 07:16:27 be1va kernel: [698802.738258] RIP: 0010:native_safe_halt+0xe/0x10
Dec 25 07:16:27 be1va kernel: [698802.739790] Code: ff ff 7f c3 65 48 8b 04 25 40 5c 01 00 f0 80 48 02 20 48 8b 00 a8 08 75 c4 eb 80 90 e9 07 00 00 00 0f 00 2d d6 dd 4d 00 fb f4 <c3> 90 e9 07 00 00 00 0f 00 2d c6 dd 4d 00 f4 c3 90 90 0f 1f 44 00
Dec 25 07:16:27 be1va kernel: [698802.745672] RSP: 0018:ffffa075c88d3a78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
Dec 25 07:16:27 be1va kernel: [698802.748163] RAX: 0000000000000003 RBX: 0000000000000246 RCX: 0000000000000008
Dec 25 07:16:27 be1va kernel: [698802.750299] RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff901819663e5c
Dec 25 07:16:27 be1va kernel: [698802.752628] RBP: ffff901827922d00 R08: 0000000000000008 R09: 00000000000000bc
Dec 25 07:16:27 be1va kernel: [698802.754809] R10: 0000000000001000 R11: ffff90181ed39001 R12: 0000000000000000
Dec 25 07:16:27 be1va kernel: [698802.757168] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000540000
Dec 25 07:16:27 be1va kernel: [698802.759407] kvm_wait+0x4c/0x50
Dec 25 07:16:27 be1va kernel: [698802.760524] __pv_queued_spin_lock_slowpath+0x247/0x280
Dec 25 07:16:27 be1va kernel: [698802.762158] _raw_spin_lock+0x1c/0x20
Dec 25 07:16:27 be1va kernel: [698802.763339] dd_bio_merge+0x43/0x90
Dec 25 07:16:27 be1va kernel: [698802.764584] blk_mq_make_request+0xd7/0x530
Dec 25 07:16:27 be1va kernel: [698802.765907] generic_make_request+0x1a4/0x400
Dec 25 07:16:27 be1va kernel: [698802.767392] submit_bio+0x45/0x140
Dec 25 07:16:27 be1va kernel: [698802.768619] ext4_io_submit+0x49/0x60 [ext4]
Dec 25 07:16:27 be1va kernel: [698802.769966] ext4_writepages+0x7d7/0xf00 [ext4]
Dec 25 07:16:27 be1va kernel: [698802.771396] ? do_writepages+0x41/0xd0
Dec 25 07:16:27 be1va kernel: [698802.772651] do_writepages+0x41/0xd0
Dec 25 07:16:27 be1va kernel: [698802.773799] ? __generic_file_write_iter+0xfe/0x1c0
Dec 25 07:16:27 be1va kernel: [698802.775328] __filemap_fdatawrite_range+0xcf/0x110
Dec 25 07:16:27 be1va kernel: [698802.776972] ext4_release_file+0x6c/0xa0 [ext4]
Dec 25 07:16:27 be1va kernel: [698802.778354] __fput+0xac/0x1e0
Dec 25 07:16:27 be1va kernel: [698802.779306] task_work_run+0x8a/0xb0
Dec 25 07:16:27 be1va kernel: [698802.780515] exit_to_usermode_loop+0xeb/0xf0
Dec 25 07:16:27 be1va kernel: [698802.781870] do_syscall_64+0x10d/0x110
Dec 25 07:16:27 be1va kernel: [698802.783020] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Dec 25 07:16:27 be1va kernel: [698802.784754] RIP: 0033:0x484834
Dec 25 07:16:27 be1va kernel: [698802.785756] Code: ff ff cc cc cc cc e8 cb 15 fb ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 45 31 d2 45 31 c0 45 31 c9 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
Dec 25 07:16:27 be1va kernel: [698802.791560] RSP: 002b:000000c4204dceb8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Dec 25 07:16:27 be1va kernel: [698802.794062] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000484834
Dec 25 07:16:27 be1va kernel: [698802.796365] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000005
Dec 25 07:16:27 be1va kernel: [698802.798545] RBP: 000000c4204dcf00 R08: 0000000000000000 R09: 0000000000000000
Dec 25 07:16:27 be1va kernel: [698802.800840] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
Dec 25 07:16:27 be1va kernel: [698802.802977] R13: 00000000000000f5 R14: 0000000000000075 R15: 0000000000000004
Dec 25 07:16:52 be1va kernel: [698827.527653] watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kworker/u64:2:23035]
Dec 25 07:16:52 be1va kernel: [698827.533131] Modules linked in: rpcsec_gss_krb5 nfsv4 dns_resolver nfsd auth_rpcgss nfs_acl nfs lockd grace fscache sunrpc sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcc_cpufreq virtio_console virtio_balloon sg joydev serio_raw evdev pcspkr button qemu_fw_cfg ext4 crc16 mbcache jbd2 crc32c_generic fscrypto ecb sd_mod ata_generic virtio_net net_failover virtio_scsi failover crc32c_intel ata_piix uhci_hcd libata ehci_hcd aesni_intel aes_x86_64 virtio_pci crypto_simd scsi_mod usbcore virtio_ring cryptd psmouse glue_helper virtio i2c_piix4 usb_common floppy
Dec 25 07:16:52 be1va kernel: [698827.552209] CPU: 4 PID: 23035 Comm: kworker/u64:2 Tainted: G D 4.19.0-7-amd64 #1 Debian 4.19.87-1
Dec 25 07:16:52 be1va kernel: [698827.556061] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
Dec 25 07:16:52 be1va kernel: [698827.559206] Workqueue: writeback wb_workfn (flush-8:80)
Dec 25 07:16:52 be1va kernel: [698827.561287] RIP: 0010:native_safe_halt+0xe/0x10
Dec 25 07:16:52 be1va kernel: [698827.562973] Code: ff ff 7f c3 65 48 8b 04 25 40 5c 01 00 f0 80 48 02 20 48 8b 00 a8 08 75 c4 eb 80 90 e9 07 00 00 00 0f 00 2d d6 dd 4d 00 fb f4 <c3> 90 e9 07 00 00 00 0f 00 2d c6 dd 4d 00 f4 c3 90 90 0f 1f 44 00
Dec 25 07:16:52 be1va kernel: [698827.569955] RSP: 0018:ffffa075da6e77d8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
Dec 25 07:16:52 be1va kernel: [698827.572802] RAX: 0000000000000001 RBX: 0000000000000246 RCX: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.575444] RDX: 0000000000000002 RSI: 0000000000000001 RDI: ffff901827522d44
Dec 25 07:16:52 be1va kernel: [698827.578105] RBP: ffff901827522d00 R08: ffff901815660800 R09: 0000000000000001
Dec 25 07:16:52 be1va kernel: [698827.580762] R10: 0000000000001000 R11: 0000000000026501 R12: ffff901827922d00
Dec 25 07:16:52 be1va kernel: [698827.583508] R13: ffff901827522d44 R14: 0000000000000001 R15: 0000000000140000
Dec 25 07:16:52 be1va kernel: [698827.586173] FS: 0000000000000000(0000) GS:ffff901827500000(0000) knlGS:0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.589201] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 25 07:16:52 be1va kernel: [698827.591350] CR2: 00007fcc4bfdf9a0 CR3: 00000002df80a003 CR4: 0000000000360ee0
Dec 25 07:16:52 be1va kernel: [698827.593985] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.596641] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Dec 25 07:16:52 be1va kernel: [698827.599267] Call Trace:
Dec 25 07:16:52 be1va kernel: [698827.600291] kvm_wait+0x4c/0x50
Dec 25 07:16:52 be1va kernel: [698827.601437] __pv_queued_spin_lock_slowpath+0x216/0x280
Dec 25 07:16:52 be1va kernel: [698827.603451] _raw_spin_lock+0x1c/0x20
Dec 25 07:16:52 be1va kernel: [698827.604943] dd_bio_merge+0x43/0x90
Dec 25 07:16:52 be1va kernel: [698827.606197] blk_mq_make_request+0xd7/0x530
Dec 25 07:16:52 be1va kernel: [698827.608005] generic_make_request+0x1a4/0x400
Dec 25 07:16:52 be1va kernel: [698827.609672] submit_bio+0x45/0x140
Dec 25 07:16:52 be1va kernel: [698827.610928] ? guard_bio_eod+0x32/0x100
Dec 25 07:16:52 be1va kernel: [698827.612441] submit_bh_wbc+0x163/0x190
Dec 25 07:16:52 be1va kernel: [698827.613821] __block_write_full_page+0x234/0x420
Dec 25 07:16:52 be1va kernel: [698827.615606] ? check_disk_change+0x60/0x60
Dec 25 07:16:52 be1va kernel: [698827.617238] ? touch_buffer+0x60/0x60
Dec 25 07:16:52 be1va kernel: [698827.618569] __writepage+0x19/0x50
Dec 25 07:16:52 be1va kernel: [698827.620037] write_cache_pages+0x1aa/0x440
Dec 25 07:16:52 be1va kernel: [698827.621513] ? __wb_calc_thresh+0x130/0x130
Dec 25 07:16:52 be1va kernel: [698827.623065] generic_writepages+0x56/0x90
Dec 25 07:16:52 be1va kernel: [698827.624737] do_writepages+0x41/0xd0
Dec 25 07:16:52 be1va kernel: [698827.626099] __writeback_single_inode+0x3d/0x350
Dec 25 07:16:52 be1va kernel: [698827.627993] writeback_sb_inodes+0x1e3/0x450
Dec 25 07:16:52 be1va kernel: [698827.629527] __writeback_inodes_wb+0x5d/0xb0
Dec 25 07:16:52 be1va kernel: [698827.631243] wb_writeback+0x25f/0x2f0
Dec 25 07:16:52 be1va kernel: [698827.632733] ? get_nr_inodes+0x35/0x50
Dec 25 07:16:52 be1va kernel: [698827.634208] ? cpumask_next+0x16/0x20
Dec 25 07:16:52 be1va kernel: [698827.635720] wb_workfn+0x343/0x400
Dec 25 07:16:52 be1va kernel: [698827.637128] ? __switch_to+0x8c/0x440
Dec 25 07:16:52 be1va kernel: [698827.638525] process_one_work+0x1a7/0x3a0
Dec 25 07:16:52 be1va kernel: [698827.640202] worker_thread+0x30/0x390
Dec 25 07:16:52 be1va kernel: [698827.641576] ? create_worker+0x1a0/0x1a0
Dec 25 07:16:52 be1va kernel: [698827.643122] kthread+0x112/0x130
Dec 25 07:16:52 be1va kernel: [698827.644355] ? kthread_bind+0x30/0x30
Dec 25 07:16:52 be1va kernel: [698827.645771] ret_from_fork+0x1f/0x40
Dec 25 07:16:52 be1va kernel: [698827.703650] watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [newrelic-infra:2333]
Dec 25 07:16:52 be1va kernel: [698827.706456] Modules linked in: rpcsec_gss_krb5 nfsv4 dns_resolver nfsd auth_rpcgss nfs_acl nfs lockd grace fscache sunrpc sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcc_cpufreq virtio_console virtio_balloon sg joydev serio_raw evdev pcspkr button qemu_fw_cfg ext4 crc16 mbcache jbd2 crc32c_generic fscrypto ecb sd_mod ata_generic virtio_net net_failover virtio_scsi failover crc32c_intel ata_piix uhci_hcd libata ehci_hcd aesni_intel aes_x86_64 virtio_pci crypto_simd scsi_mod usbcore virtio_ring cryptd psmouse glue_helper virtio i2c_piix4 usb_common floppy
Dec 25 07:16:52 be1va kernel: [698827.725725] CPU: 20 PID: 2333 Comm: newrelic-infra Tainted: G D L 4.19.0-7-amd64 #1 Debian 4.19.87-1
Dec 25 07:16:52 be1va kernel: [698827.729471] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
Dec 25 07:16:52 be1va kernel: [698827.732694] RIP: 0010:native_safe_halt+0xe/0x10
Dec 25 07:16:52 be1va kernel: [698827.734274] Code: ff ff 7f c3 65 48 8b 04 25 40 5c 01 00 f0 80 48 02 20 48 8b 00 a8 08 75 c4 eb 80 90 e9 07 00 00 00 0f 00 2d d6 dd 4d 00 fb f4 <c3> 90 e9 07 00 00 00 0f 00 2d c6 dd 4d 00 f4 c3 90 90 0f 1f 44 00
Dec 25 07:16:52 be1va kernel: [698827.741050] RSP: 0018:ffffa075c88d3a78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
Dec 25 07:16:52 be1va kernel: [698827.743664] RAX: 0000000000000003 RBX: 0000000000000246 RCX: 0000000000000008
Dec 25 07:16:52 be1va kernel: [698827.746213] RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff901819663e5c
Dec 25 07:16:52 be1va kernel: [698827.748800] RBP: ffff901827922d00 R08: 0000000000000008 R09: 00000000000000bc
Dec 25 07:16:52 be1va kernel: [698827.751225] R10: 0000000000001000 R11: ffff90181ed39001 R12: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.753611] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000540000
Dec 25 07:16:52 be1va kernel: [698827.756093] FS: 00007fc2e67fc700(0000) GS:ffff901827900000(0000) knlGS:0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.758771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 25 07:16:52 be1va kernel: [698827.760871] CR2: 00007ff243400000 CR3: 00000015dae4a004 CR4: 0000000000360ee0
Dec 25 07:16:52 be1va kernel: [698827.763394] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.765846] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Dec 25 07:16:52 be1va kernel: [698827.768471] Call Trace:
Dec 25 07:16:52 be1va kernel: [698827.769343] kvm_wait+0x4c/0x50
Dec 25 07:16:52 be1va kernel: [698827.770392] __pv_queued_spin_lock_slowpath+0x247/0x280
Dec 25 07:16:52 be1va kernel: [698827.772321] _raw_spin_lock+0x1c/0x20
Dec 25 07:16:52 be1va kernel: [698827.773542] dd_bio_merge+0x43/0x90
Dec 25 07:16:52 be1va kernel: [698827.774748] blk_mq_make_request+0xd7/0x530
Dec 25 07:16:52 be1va kernel: [698827.776414] generic_make_request+0x1a4/0x400
Dec 25 07:16:52 be1va kernel: [698827.777848] submit_bio+0x45/0x140
Dec 25 07:16:52 be1va kernel: [698827.779052] ext4_io_submit+0x49/0x60 [ext4]
Dec 25 07:16:52 be1va kernel: [698827.780645] ext4_writepages+0x7d7/0xf00 [ext4]
Dec 25 07:16:52 be1va kernel: [698827.782172] ? do_writepages+0x41/0xd0
Dec 25 07:16:52 be1va kernel: [698827.783510] do_writepages+0x41/0xd0
Dec 25 07:16:52 be1va kernel: [698827.784794] ? __generic_file_write_iter+0xfe/0x1c0
Dec 25 07:16:52 be1va kernel: [698827.786507] __filemap_fdatawrite_range+0xcf/0x110
Dec 25 07:16:52 be1va kernel: [698827.788247] ext4_release_file+0x6c/0xa0 [ext4]
Dec 25 07:16:52 be1va kernel: [698827.789778] __fput+0xac/0x1e0
Dec 25 07:16:52 be1va kernel: [698827.790921] task_work_run+0x8a/0xb0
Dec 25 07:16:52 be1va kernel: [698827.792294] exit_to_usermode_loop+0xeb/0xf0
Dec 25 07:16:52 be1va kernel: [698827.793706] do_syscall_64+0x10d/0x110
Dec 25 07:16:52 be1va kernel: [698827.795004] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Dec 25 07:16:52 be1va kernel: [698827.796768] RIP: 0033:0x484834
Dec 25 07:16:52 be1va kernel: [698827.797788] Code: ff ff cc cc cc cc e8 cb 15 fb ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 45 31 d2 45 31 c0 45 31 c9 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
Dec 25 07:16:52 be1va kernel: [698827.804309] RSP: 002b:000000c4204dceb8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Dec 25 07:16:52 be1va kernel: [698827.806735] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000484834
Dec 25 07:16:52 be1va kernel: [698827.809277] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000005
Dec 25 07:16:52 be1va kernel: [698827.811729] RBP: 000000c4204dcf00 R08: 0000000000000000 R09: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.814152] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
Dec 25 07:16:52 be1va kernel: [698827.816732] R13: 00000000000000f5 R14: 0000000000000075 R15: 0000000000000004
These watchdogs repeated for several hours until the machine started responding quite poorly and got some attention.
-- Package-specific info:
** Version:
Linux version 4.19.0-7-amd64 (debian-kernel@lists.debian.org) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP Debian 4.19.87-1 (2019-12-03)
** Command line:
BOOT_IMAGE=/boot/vmlinuz-4.19.0-7-amd64 root=UUID=748dc755-be1a-48f0-8c03-edf7e026dc96 ro mitigations=off console=ttyS0,115200 earlyprintk=ttyS0,115200
** Not tainted
** Kernel log:
Unable to read kernel log; any relevant messages should be attached
** Model information
sys_vendor: QEMU
product_name: Standard PC (i440FX + PIIX, 1996)
product_version: pc-i440fx-3.1
chassis_vendor: QEMU
chassis_version: pc-i440fx-3.1
bios_vendor: SeaBIOS
bios_version: 1.12.0-1
** Loaded modules:
bfq
rpcsec_gss_krb5
nfsv4
dns_resolver
nfsd
auth_rpcgss
nfs_acl
nfs
lockd
grace
fscache
sunrpc
sb_edac
crct10dif_pclmul
crc32_pclmul
ghash_clmulni_intel
joydev
evdev
sg
virtio_console
virtio_balloon
serio_raw
pcspkr
qemu_fw_cfg
button
ext4
crc16
mbcache
jbd2
crc32c_generic
fscrypto
ecb
sd_mod
ata_generic
virtio_net
net_failover
virtio_scsi
failover
crc32c_intel
ata_piix
libata
aesni_intel
uhci_hcd
ehci_hcd
aes_x86_64
crypto_simd
psmouse
cryptd
virtio_pci
floppy
usbcore
scsi_mod
glue_helper
virtio_ring
i2c_piix4
virtio
usb_common
** PCI devices:
not available
** USB devices:
not available
-- System Information:
Debian Release: 10.2
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'proposed-updates'), (500, 'stable'), (150, 'unstable')
Architecture: amd64 (x86_64)
Kernel: Linux 4.19.0-7-amd64 (SMP w/32 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: sysvinit (via /sbin/init)
Versions of packages linux-image-4.19.0-7-amd64 depends on:
ii initramfs-tools [linux-initramfs-tool] 0.133+deb10u1
ii kmod 26-1
ii linux-base 4.6
Versions of packages linux-image-4.19.0-7-amd64 recommends:
pn apparmor <none>
pn firmware-linux-free <none>
Versions of packages linux-image-4.19.0-7-amd64 suggests:
pn debian-kernel-handbook <none>
pn grub-pc | grub-efi-amd64 | extlinux <none>
pn linux-doc-4.19 <none>
Versions of packages linux-image-4.19.0-7-amd64 is related to:
pn firmware-amd-graphics <none>
pn firmware-atheros <none>
pn firmware-bnx2 <none>
pn firmware-bnx2x <none>
pn firmware-brcm80211 <none>
pn firmware-cavium <none>
pn firmware-intel-sound <none>
pn firmware-intelwimax <none>
pn firmware-ipw2x00 <none>
pn firmware-ivtv <none>
pn firmware-iwlwifi <none>
pn firmware-libertas <none>
pn firmware-linux-nonfree <none>
pn firmware-misc-nonfree <none>
pn firmware-myricom <none>
pn firmware-netxen <none>
pn firmware-qlogic <none>
pn firmware-realtek <none>
pn firmware-samsung <none>
pn firmware-siano <none>
pn firmware-ti-connectivity <none>
pn xen-hypervisor <none>
-- no debconf information
Reply to: