Bug#1004070: linux-image-4.19.0-18-amd64: kernel crashes when accessing files via nfs
Hi Salvatore,
thanks for asking! If I remember correctly later kernels did not work at the time when I tested this. But have not tried more recent 4.19.x kernel. At the moment I do not have that much time but I will share the results here once I test that.
Regards
Friedrich
> Am 21.01.2023 um 20:47 schrieb Salvatore Bonaccorso <carnil@debian.org>:
>
> Control: tags -1 + moreinfo
>
> Hi Friedrich,
>
> On Thu, Jan 20, 2022 at 11:08:35AM +0100, Friedrich Beckmann wrote:
>> Package: src:linux
>> Version: 4.19.208-1
>> Severity: important
>>
>> Dear Maintainer,
>>
>> after dist-upgrading to debian 10 the kernel crashes when accessing
>> files on nfs mounted filesystems. The bug can be reproduced by writing
>> between 100 and 1000 files á 50MByte to the mounted filesystem. The system
>> crashes completely, i.e. you cannot ping and ssh is dead. I have
>> to powercycle via ipmi to come back.
>>
>> The bug is not there when I boot the previous 4.9.0-16-amd64 kernel.
>>
>> This is a headless system with 4 nvidia gpus running with the proprietary
>> nvidia driver version 470.82.01. I do not think that this is related as
>> the bug happens even when nothing is happening on the gpus. The bios is from 2015 but I
>> load the intel-microcode.
>>
>> Looking upstream, maybe this bug is related to
>>
>> Bug 203827 - NFS v4.1 and v4.2 still unstable - https://bugzilla.kernel.org/show_bug.cgi?id=203827
>> Bug 200145 - kernel: FS-Cache: Duplicate cookie detected - https://bugzilla.kernel.org/show_bug.cgi?id=200145
>>
>> Regards
>>
>> Friedrich
>>
>> I can reproduce the bug with the following script:
>>
>> === killer script
>> #! /bin/bash -xe
>> cnt=1
>> for (( ; ; ))
>> do
>> echo "Run: $cnt"
>> ((cnt++))
>> dd if=/dev/urandom of=~/sf bs=1M count=50
>> rm ~/sf
>> done
>> ===
>>
>>
>> == kern.log
>> Jan 20 09:51:50 breakout kernel: [ 133.957968] FS-Cache: Duplicate cookie detected
>> Jan 20 09:51:50 breakout kernel: [ 133.959815] FS-Cache: O-cookie c=000000000d1e4bca [p=000000006521ae05 fl=212 nc=0 na=0]
>> Jan 20 09:51:50 breakout kernel: [ 133.961667] FS-Cache: O-cookie d= (null) n= (null)
>> Jan 20 09:51:50 breakout kernel: [ 133.963553] FS-Cache: O-key=[16] '040000000100000002000801c0a8505a'
>> Jan 20 09:51:50 breakout kernel: [ 133.965407] FS-Cache: N-cookie c=00000000883b7c78 [p=000000006521ae05 fl=2 nc=0 na=1]
>> Jan 20 09:51:50 breakout kernel: [ 133.967273] FS-Cache: N-cookie d=00000000dc94612b n=000000002d9b546b
>> Jan 20 09:51:50 breakout kernel: [ 133.968059] FS-Cache: N-key=[16] '040000000100000002000801c0a8505a'
>> Jan 20 09:51:58 breakout kernel: [ 141.528246] FS-Cache: Duplicate cookie detected
>> Jan 20 09:51:58 breakout kernel: [ 141.529925] FS-Cache: O-cookie c=00000000ab5caa2d [p=000000006521ae05 fl=212 nc=0 na=0]
>> Jan 20 09:51:58 breakout kernel: [ 141.531542] FS-Cache: O-cookie d= (null) n= (null)
>> Jan 20 09:51:58 breakout kernel: [ 141.533136] FS-Cache: O-key=[16] '040000000100000002000801c0a8505a'
>> Jan 20 09:51:58 breakout kernel: [ 141.534743] FS-Cache: N-cookie c=0000000065656ae5 [p=000000006521ae05 fl=2 nc=0 na=1]
>> Jan 20 09:51:58 breakout kernel: [ 141.536340] FS-Cache: N-cookie d=00000000dc94612b n=0000000049e94c35
>> Jan 20 09:51:58 breakout kernel: [ 141.537919] FS-Cache: N-key=[16] '040000000100000002000801c0a8505a'
>> Jan 20 09:52:27 breakout kernel: [ 170.456631] general protection fault: 0000 [#1] SMP PTI
>> Jan 20 09:52:27 breakout kernel: [ 170.458602] CPU: 5 PID: 13651 Comm: dd Tainted: P OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 09:52:27 breakout kernel: [ 170.460511] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 09:52:27 breakout kernel: [ 170.462416] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 09:52:27 breakout kernel: [ 170.464307] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 09:52:27 breakout kernel: [ 170.466332] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 09:52:27 breakout kernel: [ 170.468343] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 09:52:27 breakout kernel: [ 170.470390] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:52:27 breakout kernel: [ 170.472401] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 09:52:27 breakout kernel: [ 170.474421] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 09:52:27 breakout kernel: [ 170.476444] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 09:52:27 breakout kernel: [ 170.478471] FS: 00007f0afeeeb580(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:52:27 breakout kernel: [ 170.480520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:52:27 breakout kernel: [ 170.482546] CR2: 00007f0afe9ee000 CR3: 0000001025e86003 CR4: 00000000003606e0
>> Jan 20 09:52:27 breakout kernel: [ 170.484586] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:52:27 breakout kernel: [ 170.486614] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:52:27 breakout kernel: [ 170.488640] Call Trace:
>> Jan 20 09:52:27 breakout kernel: [ 170.490698] ? nfs4_init_uniform_client_string+0x50/0x140 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.492744] nfs4_init_uniform_client_string+0x50/0x140 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.494784] nfs4_run_exchange_id+0xee/0x250 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.496812] _nfs4_proc_exchange_id+0x2d/0x420 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.498842] nfs4_proc_exchange_id+0x3e/0x50 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.500882] nfs41_discover_server_trunking+0x1c/0xa0 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.502915] nfs4_discover_server_trunking+0x7e/0x260 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.504947] nfs4_init_client+0xb1/0x120 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.506971] nfs4_set_ds_client+0xe3/0x120 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.508964] ? free_unref_page_commit+0x91/0x100
>> Jan 20 09:52:27 breakout kernel: [ 170.510984] _nfs4_pnfs_v4_ds_connect+0x191/0x230 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.512978] ? bit_wait_io+0x50/0x50
>> Jan 20 09:52:27 breakout kernel: [ 170.514967] nfs4_pnfs_ds_connect+0x187/0x300 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.516944] ? _cond_resched+0x15/0x30
>> Jan 20 09:52:27 breakout kernel: [ 170.518912] ? __kmalloc+0x180/0x220
>> Jan 20 09:52:27 breakout kernel: [ 170.520887] ? nfs_generic_pgio+0x267/0x330 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.522843] ? refcount_inc_checked+0x5/0x30
>> Jan 20 09:52:27 breakout kernel: [ 170.524782] nfs4_fl_prepare_ds+0x75/0x95 [nfs_layout_nfsv41_files]
>> Jan 20 09:52:27 breakout kernel: [ 170.526735] filelayout_write_pagelist+0x4a/0x130 [nfs_layout_nfsv41_files]
>> Jan 20 09:52:27 breakout kernel: [ 170.528715] pnfs_generic_pg_writepages+0xb0/0x1e0 [nfsv4]
>> Jan 20 09:52:27 breakout kernel: [ 170.530691] nfs_pageio_doio+0x2a/0x70 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.532661] __nfs_pageio_add_request+0xc3/0x410 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.534622] ? refcount_inc_checked+0x5/0x30
>> Jan 20 09:52:27 breakout kernel: [ 170.536577] nfs_pageio_add_request+0x187/0x3c0 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.538540] nfs_do_writepage+0x188/0x2d0 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.540497] nfs_writepages_callback+0xf/0x20 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.542439] write_cache_pages+0x1aa/0x440
>> Jan 20 09:52:27 breakout kernel: [ 170.544388] ? nfs_do_writepage+0x2d0/0x2d0 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.546341] nfs_writepages+0xb4/0x170 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.548274] do_writepages+0x41/0xd0
>> Jan 20 09:52:27 breakout kernel: [ 170.550189] ? generic_perform_write+0x16a/0x1b0
>> Jan 20 09:52:27 breakout kernel: [ 170.552097] __filemap_fdatawrite_range+0xcf/0x110
>> Jan 20 09:52:27 breakout kernel: [ 170.554004] filemap_write_and_wait_range+0x30/0x80
>> Jan 20 09:52:27 breakout kernel: [ 170.555911] nfs_file_fsync+0x44/0x1e0 [nfs]
>> Jan 20 09:52:27 breakout kernel: [ 170.557808] filp_close+0x31/0x60
>> Jan 20 09:52:27 breakout kernel: [ 170.559692] __x64_sys_close+0x1e/0x50
>> Jan 20 09:52:27 breakout kernel: [ 170.561569] do_syscall_64+0x53/0x110
>> Jan 20 09:52:27 breakout kernel: [ 170.563430] entry_SYSCALL_64_after_hwframe+0x44/0xa9
>> Jan 20 09:52:27 breakout kernel: [ 170.565286] RIP: 0033:0x7f0afee13b54
>> Jan 20 09:52:27 breakout kernel: [ 170.567130] Code: eb 8d e8 7f fc 01 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 8d 05 a9 5b 0d 00 8b 00 85 c0 75 13 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3c c3 0f 1f 00 53 89 fb 48 83 ec 10 e8 e4 bb
>> Jan 20 09:52:27 breakout kernel: [ 170.569116] RSP: 002b:00007ffc9280d1e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
>> Jan 20 09:52:27 breakout kernel: [ 170.571109] RAX: ffffffffffffffda RBX: 00005629741de3e0 RCX: 00007f0afee13b54
>> Jan 20 09:52:27 breakout kernel: [ 170.573112] RDX: 0000000000100000 RSI: 0000000000000000 RDI: 0000000000000001
>> Jan 20 09:52:27 breakout kernel: [ 170.575116] RBP: 0000000000000032 R08: 00000000ffffffff R09: 0000000000000000
>> Jan 20 09:52:27 breakout kernel: [ 170.577099] R10: ffffffffffffff3b R11: 0000000000000246 R12: 0000000000000032
>> Jan 20 09:52:27 breakout kernel: [ 170.579072] R13: 0000000000000000 R14: 0000000000000000 R15: 00007f0afe8ef000
>> Jan 20 09:52:27 breakout kernel: [ 170.581045] Modules linked in: nfs_layout_nfsv41_files cbc cts rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink br_netfilter bridge stp llc intel_rapl aufs(OE) snd_hda_codec_hdmi overlay sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp nvidia_drm(POE) kvm_intel kvm nvidia_modeset(POE) irqbypass crct10dif_pclmul crc32_pclmul snd_hda_codec_realtek ghash_clmulni_intel snd_hda_codec_generic intel_cstate ipmi_ssif intel_uncore pcc_cpufreq mxm_wmi snd_hda_intel intel_rapl_perf joydev snd_hda_codec pcspkr ast ttm snd_hda_core snd_hwdep drm_kms_helper snd_pcm mei_me snd_timer iTCO_wdt iTCO_vendor_support
>> Jan 20 09:52:27 breakout kernel: [ 170.590043] sg mei snd soundcore ioatdma evdev ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter nvidia(POE) button drm auth_rpcgss sunrpc ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid0 multipath linear hid_generic usbhid hid raid1 md_mod sd_mod crc32c_intel xhci_pci ahci xhci_hcd aesni_intel libahci ehci_pci ixgbe ehci_hcd aes_x86_64 libata crypto_simd igb cryptd glue_helper usbcore scsi_mod nvme i2c_algo_bit dca mdio lpc_ich i2c_i801 nvme_core mfd_core usb_common
>> Jan 20 09:52:27 breakout kernel: [ 170.597645] ---[ end trace 5e0c6a67f011a878 ]---
>> Jan 20 09:52:27 breakout kernel: [ 170.602725] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 09:52:27 breakout kernel: [ 170.603863] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 09:52:27 breakout kernel: [ 170.605073] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 09:52:27 breakout kernel: [ 170.606271] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 09:52:27 breakout kernel: [ 170.607470] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:52:27 breakout kernel: [ 170.608666] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 09:52:27 breakout kernel: [ 170.609877] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 09:52:27 breakout kernel: [ 170.611084] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 09:52:27 breakout kernel: [ 170.612269] FS: 00007f0afeeeb580(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:52:27 breakout kernel: [ 170.613469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:52:27 breakout kernel: [ 170.614658] CR2: 00007f0afe9ee000 CR3: 0000001025e86003 CR4: 00000000003606e0
>> Jan 20 09:52:27 breakout kernel: [ 170.615861] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:52:27 breakout kernel: [ 170.617070] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:52:50 breakout kernel: [ 193.537469] general protection fault: 0000 [#2] SMP PTI
>> Jan 20 09:52:50 breakout kernel: [ 193.540022] CPU: 5 PID: 1423 Comm: node Tainted: P D OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 09:52:50 breakout kernel: [ 193.542610] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 09:52:50 breakout kernel: [ 193.545211] RIP: 0010:kmem_cache_alloc_trace+0x89/0x1e0
>> Jan 20 09:52:50 breakout kernel: [ 193.547811] Code: 08 65 4c 03 05 50 35 fe 78 49 83 78 10 00 4d 8b 38 0f 84 0c 01 00 00 4d 85 ff 0f 84 03 01 00 00 41 8b 41 20 49 8b 39 4c 01 f8 <48> 8b 18 48 89 c1 49 33 99 38 01 00 00 4c 89 f8 48 0f c9 48 31 cb
>> Jan 20 09:52:50 breakout kernel: [ 193.550547] RSP: 0018:ffff9dfd8868bdb0 EFLAGS: 00010282
>> Jan 20 09:52:50 breakout kernel: [ 193.553281] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 0000000000000000
>> Jan 20 09:52:50 breakout kernel: [ 193.556031] RDX: 000000000000b080 RSI: 00000000006080c0 RDI: 0000000000025540
>> Jan 20 09:52:50 breakout kernel: [ 193.558781] RBP: ffff8cbaff407780 R08: ffff8cbaff965540 R09: ffff8cbaff407780
>> Jan 20 09:52:50 breakout kernel: [ 193.561540] R10: ffff9dfd8868be90 R11: 0000000000000000 R12: 00000000006080c0
>> Jan 20 09:52:50 breakout kernel: [ 193.564305] R13: 0000000000000030 R14: ffffffffc0454d06 R15: bf0892e61936d294
>> Jan 20 09:52:50 breakout kernel: [ 193.567074] FS: 00007f68ebfff700(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:52:50 breakout kernel: [ 193.569861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:52:50 breakout kernel: [ 193.572647] CR2: 00007f0afe9ee000 CR3: 000000101fcec004 CR4: 00000000003606e0
>> Jan 20 09:52:50 breakout kernel: [ 193.575462] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:52:50 breakout kernel: [ 193.578274] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:52:50 breakout kernel: [ 193.581077] Call Trace:
>> Jan 20 09:52:50 breakout kernel: [ 193.583898] ext4_readdir+0x8c6/0xa80 [ext4]
>> Jan 20 09:52:50 breakout kernel: [ 193.586690] iterate_dir+0x138/0x180
>> Jan 20 09:52:50 breakout kernel: [ 193.589461] ksys_getdents64+0x9c/0x130
>> Jan 20 09:52:50 breakout kernel: [ 193.592221] ? verify_dirent_name+0x30/0x30
>> Jan 20 09:52:50 breakout kernel: [ 193.594977] __x64_sys_getdents64+0x16/0x20
>> Jan 20 09:52:50 breakout kernel: [ 193.597727] do_syscall_64+0x53/0x110
>> Jan 20 09:52:50 breakout kernel: [ 193.600468] entry_SYSCALL_64_after_hwframe+0x44/0xa9
>> Jan 20 09:52:50 breakout kernel: [ 193.603219] RIP: 0033:0x7f690382add7
>> Jan 20 09:52:50 breakout kernel: [ 193.605962] Code: 00 00 48 83 c4 08 5b 5d c3 66 2e 0f 1f 84 00 00 00 00 00 48 8b 47 20 c3 66 2e 0f 1f 84 00 00 00 00 00 90 b8 d9 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 01 c3 48 8b 15 89 90 0f 00 f7 d8 64 89 02 48
>> Jan 20 09:52:50 breakout kernel: [ 193.608855] RSP: 002b:00007f68ebffecd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000d9
>> Jan 20 09:52:50 breakout kernel: [ 193.611757] RAX: ffffffffffffffda RBX: 00007f68e0000b20 RCX: 00007f690382add7
>> Jan 20 09:52:50 breakout kernel: [ 193.614672] RDX: 0000000000008000 RSI: 00007f68e0000b50 RDI: 0000000000000014
>> Jan 20 09:52:50 breakout kernel: [ 193.617589] RBP: 00007f68e0000b50 R08: 0000000000000000 R09: 00007f68e0008b50
>> Jan 20 09:52:50 breakout kernel: [ 193.620507] R10: 00007f68e00008d0 R11: 0000000000000246 R12: ffffffffffffff48
>> Jan 20 09:52:50 breakout kernel: [ 193.623422] R13: 0000000000000000 R14: ffffffffffffff48 R15: 0000000003057548
>> Jan 20 09:52:50 breakout kernel: [ 193.626343] Modules linked in: nfs_layout_nfsv41_files cbc cts rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink br_netfilter bridge stp llc intel_rapl aufs(OE) snd_hda_codec_hdmi overlay sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp nvidia_drm(POE) kvm_intel kvm nvidia_modeset(POE) irqbypass crct10dif_pclmul crc32_pclmul snd_hda_codec_realtek ghash_clmulni_intel snd_hda_codec_generic intel_cstate ipmi_ssif intel_uncore pcc_cpufreq mxm_wmi snd_hda_intel intel_rapl_perf joydev snd_hda_codec pcspkr ast ttm snd_hda_core snd_hwdep drm_kms_helper snd_pcm mei_me snd_timer iTCO_wdt iTCO_vendor_support
>> Jan 20 09:52:50 breakout kernel: [ 193.639188] sg mei snd soundcore ioatdma evdev ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter nvidia(POE) button drm auth_rpcgss sunrpc ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid0 multipath linear hid_generic usbhid hid raid1 md_mod sd_mod crc32c_intel xhci_pci ahci xhci_hcd aesni_intel libahci ehci_pci ixgbe ehci_hcd aes_x86_64 libata crypto_simd igb cryptd glue_helper usbcore scsi_mod nvme i2c_algo_bit dca mdio lpc_ich i2c_i801 nvme_core mfd_core usb_common
>> Jan 20 09:52:50 breakout kernel: [ 193.649779] ---[ end trace 5e0c6a67f011a879 ]---
>> Jan 20 09:52:50 breakout kernel: [ 193.655419] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 09:52:50 breakout kernel: [ 193.657037] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 09:52:50 breakout kernel: [ 193.658704] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 09:52:50 breakout kernel: [ 193.660370] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 09:52:50 breakout kernel: [ 193.662058] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:52:50 breakout kernel: [ 193.663747] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 09:52:50 breakout kernel: [ 193.665398] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 09:52:50 breakout kernel: [ 193.666994] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 09:52:50 breakout kernel: [ 193.668561] FS: 00007f68ebfff700(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:52:50 breakout kernel: [ 193.670085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:52:50 breakout kernel: [ 193.671567] CR2: 00007f0afe9ee000 CR3: 000000101fcec004 CR4: 00000000003606e0
>> Jan 20 09:52:50 breakout kernel: [ 193.673045] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:52:50 breakout kernel: [ 193.674452] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:54:49 breakout kernel: [ 313.241474] general protection fault: 0000 [#3] SMP PTI
>> Jan 20 09:54:49 breakout kernel: [ 313.244604] CPU: 5 PID: 1065 Comm: php-fpm7.3 Tainted: P D OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 09:54:49 breakout kernel: [ 313.247573] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 09:54:49 breakout kernel: [ 313.250494] RIP: 0010:kmem_cache_alloc_trace+0x89/0x1e0
>> Jan 20 09:54:49 breakout kernel: [ 313.253400] Code: 08 65 4c 03 05 50 35 fe 78 49 83 78 10 00 4d 8b 38 0f 84 0c 01 00 00 4d 85 ff 0f 84 03 01 00 00 41 8b 41 20 49 8b 39 4c 01 f8 <48> 8b 18 48 89 c1 49 33 99 38 01 00 00 4c 89 f8 48 0f c9 48 31 cb
>> Jan 20 09:54:49 breakout kernel: [ 313.256445] RSP: 0018:ffff9dfd8874fe18 EFLAGS: 00010282
>> Jan 20 09:54:49 breakout kernel: [ 313.259478] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.262527] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:54:49 breakout kernel: [ 313.265571] RBP: ffff8cbaff407780 R08: ffff8cbaff965540 R09: ffff8cbaff407780
>> Jan 20 09:54:49 breakout kernel: [ 313.268607] R10: 0000000000000002 R11: ffff8cbae9b75ac0 R12: 00000000006000c0
>> Jan 20 09:54:49 breakout kernel: [ 313.271635] R13: 0000000000000040 R14: ffffffff8739eaf6 R15: bf0892e61936d294
>> Jan 20 09:54:49 breakout kernel: [ 313.274654] FS: 00007f0a16a50c00(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.277687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:54:49 breakout kernel: [ 313.280733] CR2: 00007f0afe9ee000 CR3: 000000202b9aa003 CR4: 00000000003606e0
>> Jan 20 09:54:49 breakout kernel: [ 313.283783] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.286807] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:54:49 breakout kernel: [ 313.289796] Call Trace:
>> Jan 20 09:54:49 breakout kernel: [ 313.292765] ? kmem_cache_alloc+0x167/0x1d0
>> Jan 20 09:54:49 breakout kernel: [ 313.295673] sock_alloc_inode+0x36/0xb0
>> Jan 20 09:54:49 breakout kernel: [ 313.298504] alloc_inode+0x1b/0x80
>> Jan 20 09:54:49 breakout kernel: [ 313.301313] new_inode_pseudo+0xc/0x60
>> Jan 20 09:54:49 breakout kernel: [ 313.304124] sock_alloc+0x17/0x70
>> Jan 20 09:54:49 breakout kernel: [ 313.306916] __sock_create+0x7b/0x1a0
>> Jan 20 09:54:49 breakout kernel: [ 313.309696] __sys_socket+0x57/0xe0
>> Jan 20 09:54:49 breakout kernel: [ 313.312458] __x64_sys_socket+0x16/0x20
>> Jan 20 09:54:49 breakout kernel: [ 313.315204] do_syscall_64+0x53/0x110
>> Jan 20 09:54:49 breakout kernel: [ 313.317934] entry_SYSCALL_64_after_hwframe+0x44/0xa9
>> Jan 20 09:54:49 breakout kernel: [ 313.320655] RIP: 0033:0x7f0a18d34ac7
>> Jan 20 09:54:49 breakout kernel: [ 313.323367] Code: 73 01 c3 48 8b 0d c9 03 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 29 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 03 0c 00 f7 d8 64 89 01 48
>> Jan 20 09:54:49 breakout kernel: [ 313.326240] RSP: 002b:00007ffc74cb7b48 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
>> Jan 20 09:54:49 breakout kernel: [ 313.329110] RAX: ffffffffffffffda RBX: 000056002d1290d0 RCX: 00007f0a18d34ac7
>> Jan 20 09:54:49 breakout kernel: [ 313.331991] RDX: 0000000000000000 RSI: 0000000000080002 RDI: 0000000000000001
>> Jan 20 09:54:49 breakout kernel: [ 313.334882] RBP: 00007ffc74cb7c70 R08: 0000000000000000 R09: 0000000000000013
>> Jan 20 09:54:49 breakout kernel: [ 313.337771] R10: 0000000000000002 R11: 0000000000000246 R12: 0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.340661] R13: 0000000000000000 R14: 0000000000000000 R15: 00007ffc74cb7bb0
>> Jan 20 09:54:49 breakout kernel: [ 313.343554] Modules linked in: nfs_layout_nfsv41_files cbc cts rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink br_netfilter bridge stp llc intel_rapl aufs(OE) snd_hda_codec_hdmi overlay sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp nvidia_drm(POE) kvm_intel kvm nvidia_modeset(POE) irqbypass crct10dif_pclmul crc32_pclmul snd_hda_codec_realtek ghash_clmulni_intel snd_hda_codec_generic intel_cstate ipmi_ssif intel_uncore pcc_cpufreq mxm_wmi snd_hda_intel intel_rapl_perf joydev snd_hda_codec pcspkr ast ttm snd_hda_core snd_hwdep drm_kms_helper snd_pcm mei_me snd_timer iTCO_wdt iTCO_vendor_support
>> Jan 20 09:54:49 breakout kernel: [ 313.356218] sg mei snd soundcore ioatdma evdev ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter nvidia(POE) button drm auth_rpcgss sunrpc ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid0 multipath linear hid_generic usbhid hid raid1 md_mod sd_mod crc32c_intel xhci_pci ahci xhci_hcd aesni_intel libahci ehci_pci ixgbe ehci_hcd aes_x86_64 libata crypto_simd igb cryptd glue_helper usbcore scsi_mod nvme i2c_algo_bit dca mdio lpc_ich i2c_i801 nvme_core mfd_core usb_common
>> Jan 20 09:54:49 breakout kernel: [ 313.366331] ---[ end trace 5e0c6a67f011a87a ]---
>> Jan 20 09:54:49 breakout kernel: [ 313.372193] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 09:54:49 breakout kernel: [ 313.373783] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 09:54:49 breakout kernel: [ 313.375433] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 09:54:49 breakout kernel: [ 313.377058] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 09:54:49 breakout kernel: [ 313.378633] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:54:49 breakout kernel: [ 313.380201] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 09:54:49 breakout kernel: [ 313.381695] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 09:54:49 breakout kernel: [ 313.383149] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 09:54:49 breakout kernel: [ 313.384574] FS: 00007f0a16a50c00(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.385956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:54:49 breakout kernel: [ 313.387315] CR2: 00007f0afe9ee000 CR3: 000000202b9aa003 CR4: 00000000003606e0
>> Jan 20 09:54:49 breakout kernel: [ 313.388698] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:54:49 breakout kernel: [ 313.390051] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:57:34 breakout kernel: [ 478.017895] general protection fault: 0000 [#4] SMP PTI
>> Jan 20 09:57:34 breakout kernel: [ 478.020812] CPU: 5 PID: 13916 Comm: cat Tainted: P D OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 09:57:34 breakout kernel: [ 478.023656] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 09:57:34 breakout kernel: [ 478.026510] RIP: 0010:kmem_cache_alloc_trace+0x89/0x1e0
>> Jan 20 09:57:34 breakout kernel: [ 478.029356] Code: 08 65 4c 03 05 50 35 fe 78 49 83 78 10 00 4d 8b 38 0f 84 0c 01 00 00 4d 85 ff 0f 84 03 01 00 00 41 8b 41 20 49 8b 39 4c 01 f8 <48> 8b 18 48 89 c1 49 33 99 38 01 00 00 4c 89 f8 48 0f c9 48 31 cb
>> Jan 20 09:57:34 breakout kernel: [ 478.032336] RSP: 0018:ffff9dfd879cbc38 EFLAGS: 00010282
>> Jan 20 09:57:34 breakout kernel: [ 478.035295] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.038264] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:57:34 breakout kernel: [ 478.041222] RBP: ffff8cbaff407780 R08: ffff8cbaff965540 R09: ffff8cbaff407780
>> Jan 20 09:57:34 breakout kernel: [ 478.044185] R10: ffff9dfd879cbcd8 R11: d7241cff9bfe82da R12: 00000000006000c0
>> Jan 20 09:57:34 breakout kernel: [ 478.047167] R13: 0000000000000030 R14: ffffffff870e2b19 R15: bf0892e61936d294
>> Jan 20 09:57:34 breakout kernel: [ 478.050144] FS: 00007f539f30d540(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.053115] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:57:34 breakout kernel: [ 478.056061] CR2: 00007f539f22b7d0 CR3: 0000001023f4c004 CR4: 00000000003606e0
>> Jan 20 09:57:34 breakout kernel: [ 478.059014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.061893] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:57:34 breakout kernel: [ 478.064692] Call Trace:
>> Jan 20 09:57:34 breakout kernel: [ 478.067484] kernfs_fop_open+0x239/0x400
>> Jan 20 09:57:34 breakout kernel: [ 478.070271] ? kernfs_fop_release+0xa0/0xa0
>> Jan 20 09:57:34 breakout kernel: [ 478.073049] do_dentry_open+0x13d/0x370
>> Jan 20 09:57:34 breakout kernel: [ 478.075815] path_openat+0x2d9/0x1480
>> Jan 20 09:57:34 breakout kernel: [ 478.078574] ? alloc_set_pte+0xf7/0x550
>> Jan 20 09:57:34 breakout kernel: [ 478.081313] do_filp_open+0x93/0x100
>> Jan 20 09:57:34 breakout kernel: [ 478.084036] ? simple_attr_release+0x20/0x20
>> Jan 20 09:57:34 breakout kernel: [ 478.086742] do_sys_open+0x186/0x210
>> Jan 20 09:57:34 breakout kernel: [ 478.089448] do_syscall_64+0x53/0x110
>> Jan 20 09:57:34 breakout kernel: [ 478.092156] entry_SYSCALL_64_after_hwframe+0x44/0xa9
>> Jan 20 09:57:34 breakout kernel: [ 478.094856] RIP: 0033:0x7f539f2351ae
>> Jan 20 09:57:34 breakout kernel: [ 478.097546] Code: 25 00 00 41 00 3d 00 00 41 00 74 48 48 8d 05 59 65 0d 00 8b 00 85 c0 75 69 89 f2 b8 01 01 00 00 48 89 fe bf 9c ff ff
>> ff 0f 05 <48> 3d 00 f0 ff ff 0f 87 a6 00 00 00 48 8b 4c 24 28 64 48 33 0c 25
>> Jan 20 09:57:34 breakout kernel: [ 478.100393] RSP: 002b:00007ffc428ec470 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
>> Jan 20 09:57:34 breakout kernel: [ 478.103253] RAX: ffffffffffffffda RBX: 00000000ffffffff RCX: 00007f539f2351ae
>> Jan 20 09:57:34 breakout kernel: [ 478.106132] RDX: 0000000000000000 RSI: 00007ffc428ee5c3 RDI: 00000000ffffff9c
>> Jan 20 09:57:34 breakout kernel: [ 478.109023] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.111916] R10: 0000000000000000 R11: 0000000000000246 R12: 00005616a7dd2f80
>> Jan 20 09:57:34 breakout kernel: [ 478.114809] R13: 00007ffc428ec730 R14: 0000000000000000 R15: 0000000000020000
>> Jan 20 09:57:34 breakout kernel: [ 478.117710] Modules linked in: nfs_layout_nfsv41_files cbc cts rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink br_netfilter bridge stp llc intel_rapl aufs(OE) snd_hda_codec_hdmi overlay sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp nvidia_drm(POE) kvm_intel kvm nvidia_modeset(POE) irqbypass crct10dif_pclmul crc32_pclmul snd_hda_codec_realtek ghash_clmulni_intel snd_hda_codec_generic intel_cstate ipmi_ssif intel_uncore pcc_cpufreq mxm_wmi snd_hda_intel intel_rapl_perf joydev snd_hda_codec pcspkr ast ttm snd_hda_core snd_hwdep drm_kms_helper snd_pcm mei_me snd_timer iTCO_wdt iTCO_vendor_support
>> Jan 20 09:57:34 breakout kernel: [ 478.130418] sg mei snd soundcore ioatdma evdev ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter nvidia(POE) button drm auth_rpcgss sunrpc ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid0 multipath linear hid_generic usbhid hid raid1 md_mod sd_mod crc32c_intel xhci_pci ahci xhci_hcd aesni_intel libahci ehci_pci ixgbe ehci_hcd aes_x86_64 libata crypto_simd igb cryptd glue_helper usbcore scsi_mod nvme i2c_algo_bit dca mdio lpc_ich i2c_i801 nvme_core mfd_core usb_common
>> Jan 20 09:57:34 breakout kernel: [ 478.140557] ---[ end trace 5e0c6a67f011a87b ]---
>> Jan 20 09:57:34 breakout kernel: [ 478.145078] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 09:57:34 breakout kernel: [ 478.146671] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 09:57:34 breakout kernel: [ 478.148346] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 09:57:34 breakout kernel: [ 478.149964] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 09:57:34 breakout kernel: [ 478.151565] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 09:57:34 breakout kernel: [ 478.153111] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 09:57:34 breakout kernel: [ 478.154631] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 09:57:34 breakout kernel: [ 478.156105] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 09:57:34 breakout kernel: [ 478.157527] FS: 00007f539f30d540(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.158918] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:57:34 breakout kernel: [ 478.160296] CR2: 00007f539f22b7d0 CR3: 0000001023f4c004 CR4: 00000000003606e0
>> Jan 20 09:57:34 breakout kernel: [ 478.161676] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 09:57:34 breakout kernel: [ 478.163024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 09:57:40 breakout kernel: [ 483.888394] general protection fault: 0000 [#5] SMP PTI
>> Jan 20 09:57:40 breakout kernel: [ 483.891222] CPU: 5 PID: 1425 Comm: node Tainted: P D OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 09:57:40 breakout kernel: [ 483.894085] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 09:57:40 breakout kernel: [ 483.896954] RIP: 0010:kmem_cache_alloc_trace+0x89/0x1e0
>> Jan 20 09:57:40 breakout kernel: [ 483.899816] Code: 08 65 4c 03 05 50 35 fe 78 49 83 78 10 00 4d 8b 38 0f 84 0c 01 00 00 4d 85 ff 0f 84 03 01 00 00 41 8b 41 20 49 8b 39 4c 01 f8 <48> 8b 18 48 89 c1 49 33 99 38 01 00 00 4c 89 f8 48 0f c9 48 31 cb
>> Jan 20 09:57:40 breakout kernel: [ 483.902813] RSP: 0018:ffff9dfd887f7db0 EFLAGS: 00010282
>> Jan 20 09:57:40 breakout kernel: [ 483.905791] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 0000000000000000
>> Jan 20 09:57:40 breakout kernel: [ 483.908777] RDX: 000000000000b080 RSI: 00000000006080c0 RDI: 0000000000025540
>> Jan 20 09:57:40 breakout kernel: [ 483.911750] RBP: ffff8cbaff407780 R08: ffff8cbaff965540 R09: ffff8cbaff407780
>> Jan 20 09:57:40 breakout kernel: [ 483.914732] R10: ffff9dfd887f7e90 R11: 0000000000000000 R12: 00000000006080c0
>> Jan 20 09:57:40 breakout kernel: [ 483.917730] R13: 0000000000000030 R14: ffffffffc0454d06 R15: bf0892e61936d294
>> Jan 20 09:57:40 breakout kernel: [ 483.920723] FS: 00007f68eaffd700(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 09:57:40 breakout kernel: [ 483.923710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 09:57:40 breakout kernel: [ 483.926674] CR2: 00007f539f22b7d0 CR3: 000000101fcec005 CR4: 00000000003606e0
>>
>> more of this and then...
>>
>> Jan 20 10:17:26 breakout kernel: [ 1669.485138] general protection fault: 0000 [#13] SMP PTI
>> Jan 20 10:17:26 breakout kernel: [ 1669.488153] CPU: 5 PID: 14063 Comm: cron Tainted: P D OE 4.19.0-18-amd64 #1 Debian 4.19.208-1
>> Jan 20 10:17:26 breakout kernel: [ 1669.490997] Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0 12/31/2015
>> Jan 20 10:17:26 breakout kernel: [ 1669.493852] RIP: 0010:kmem_cache_alloc_trace+0x89/0x1e0
>> Jan 20 10:17:26 breakout kernel: [ 1669.496698] Code: 08 65 4c 03 05 50 35 fe 78 49 83 78 10 00 4d 8b 38 0f 84 0c 01 00 00 4d 85 ff 0f 84 03 01 00 00 41 8b 41 20 49 8b 39
>> 4c 01 f8 <48> 8b 18 48 89 c1 49 33 99 38 01 00 00 4c 89 f8 48 0f c9 48 31 cb
>> Jan 20 10:17:26 breakout kernel: [ 1669.499681] RSP: 0018:ffff9dfd87653e18 EFLAGS: 00010282
>> Jan 20 10:17:26 breakout kernel: [ 1669.502649] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 0000000000000007
>> Jan 20 10:17:26 breakout kernel: [ 1669.505623] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 10:17:26 breakout kernel: [ 1669.508590] RBP: ffff8cbaff407780 R08: ffff8cbaff965540 R09: ffff8cbaff407780
>> Jan 20 10:17:26 breakout kernel: [ 1669.511568] R10: 0000000000000001 R11: 0000000000000000 R12: 00000000006000c0
>> Jan 20 10:17:26 breakout kernel: [ 1669.514565] R13: 0000000000000040 R14: ffffffff8739eaf6 R15: bf0892e61936d294
>> Jan 20 10:17:26 breakout kernel: [ 1669.517548] FS: 00007f02cefa3840(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 10:17:26 breakout kernel: [ 1669.520527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 10:17:26 breakout kernel: [ 1669.523480] CR2: 00007f02ce94a924 CR3: 00000020134e0006 CR4: 00000000003606e0
>> Jan 20 10:17:26 breakout kernel: [ 1669.526440] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 10:17:26 breakout kernel: [ 1669.529324] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> Jan 20 10:17:26 breakout kernel: [ 1669.532131] Call Trace:
>> Jan 20 10:17:26 breakout kernel: [ 1669.534926] ? kmem_cache_alloc+0x167/0x1d0
>> Jan 20 10:17:26 breakout kernel: [ 1669.537729] sock_alloc_inode+0x36/0xb0
>> Jan 20 10:17:26 breakout kernel: [ 1669.540516] alloc_inode+0x1b/0x80
>> Jan 20 10:17:26 breakout kernel: [ 1669.543288] new_inode_pseudo+0xc/0x60
>> Jan 20 10:17:26 breakout kernel: [ 1669.546056] sock_alloc+0x17/0x70
>> Jan 20 10:17:26 breakout kernel: [ 1669.548799] __sock_create+0x7b/0x1a0
>> Jan 20 10:17:26 breakout kernel: [ 1669.551522] __sys_socket+0x57/0xe0
>> Jan 20 10:17:26 breakout kernel: [ 1669.554229] __x64_sys_socket+0x16/0x20
>> Jan 20 10:17:26 breakout kernel: [ 1669.556935] do_syscall_64+0x53/0x110
>> Jan 20 10:17:26 breakout kernel: [ 1669.559645] entry_SYSCALL_64_after_hwframe+0x44/0xa9
>> Jan 20 10:17:26 breakout kernel: [ 1669.562344] RIP: 0033:0x7f02cf16fac7
>> Jan 20 10:17:26 breakout kernel: [ 1669.565041] Code: 73 01 c3 48 8b 0d c9 03 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 29 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 03 0c 00 f7 d8 64 89 01 48
>> Jan 20 10:17:26 breakout kernel: [ 1669.567889] RSP: 002b:00007ffe02942238 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
>> Jan 20 10:17:26 breakout kernel: [ 1669.570751] RAX: ffffffffffffffda RBX: 00007f02cefa36d8 RCX: 00007f02cf16fac7
>> Jan 20 10:17:26 breakout kernel: [ 1669.573632] RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000001
>> Jan 20 10:17:26 breakout kernel: [ 1669.576525] RBP: 00000000000493e0 R08: 000000000000000e R09: 00007f02cefa36d8
>> Jan 20 10:17:26 breakout kernel: [ 1669.579421] R10: 000000000000001a R11: 0000000000000246 R12: 00000000000493e0
>> Jan 20 10:17:26 breakout kernel: [ 1669.582319] R13: 00007ffe02942460 R14: 00007ffe029422a0 R15: 00007f02ce97b168
>> Jan 20 10:17:26 breakout kernel: [ 1669.585226] Modules linked in: nfs_layout_nfsv41_files cbc cts rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink br_netfilter bridge stp llc intel_rapl aufs(OE) snd_hda_codec_hdmi overlay sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp nvidia_drm(POE) kvm_intel kvm nvidia_modeset(POE) irqbypass crct10dif_pclmul crc32_pclmul snd_hda_codec_realtek ghash_clmulni_intel snd_hda_codec_generic intel_cstate ipmi_ssif intel_uncore pcc_cpufreq mxm_wmi snd_hda_intel intel_rapl_perf joydev snd_hda_codec pcspkr ast ttm snd_hda_core snd_hwdep drm_kms_helper snd_pcm mei_me snd_timer iTCO_wdt iTCO_vendor_support
>> Jan 20 10:17:26 breakout kernel: [ 1669.597966] sg mei snd soundcore ioatdma evdev ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter nvidia(POE) button drm auth_rpcgss sunrpc ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid0 multipath linear hid_generic usbhid hid raid1 md_mod sd_mod crc32c_intel xhci_pci ahci xhci_hcd aesni_intel libahci ehci_pci ixgbe ehci_hcd aes_x86_64 libata crypto_simd igb cryptd glue_helper usbcore scsi_mod nvme i2c_algo_bit dca mdio lpc_ich i2c_i801 nvme_core mfd_core usb_common
>> Jan 20 10:17:26 breakout kernel: [ 1669.608119] ---[ end trace 5e0c6a67f011a884 ]---
>> Jan 20 10:17:26 breakout kernel: [ 1669.613112] RIP: 0010:__kmalloc+0xaa/0x220
>> Jan 20 10:17:26 breakout kernel: [ 1669.614715] Code: 08 65 4c 03 05 cf 2e fe 78 49 83 78 10 00 49 8b 28 0f 84 0c 01 00 00 48 85 ed 0f 84 03 01 00 00 41 8b 47 20 49 8b 3f 48 01 e8 <48> 8b 18 48 89 c1 49 33 9f 38 01 00 00 48 89 e8 48 0f c9 48 31 cb
>> Jan 20 10:17:26 breakout kernel: [ 1669.616376] RSP: 0018:ffff9dfda84cf5b8 EFLAGS: 00010282
>> Jan 20 10:17:26 breakout kernel: [ 1669.617994] RAX: bf0892e61936d294 RBX: 0000000000000000 RCX: 2a67439700000000
>> Jan 20 10:17:26 breakout kernel: [ 1669.619587] RDX: 000000000000b080 RSI: 00000000006000c0 RDI: 0000000000025540
>> Jan 20 10:17:26 breakout kernel: [ 1669.621130] RBP: bf0892e61936d294 R08: ffff8cbaff965540 R09: ffff8cbaff407300
>> Jan 20 10:17:26 breakout kernel: [ 1669.622663] R10: ffff8cbaf2bed684 R11: ffff8cbae401a940 R12: 00000000006000c0
>> Jan 20 10:17:26 breakout kernel: [ 1669.624125] R13: 0000000000000029 R14: ffff8cbaff407780 R15: ffff8cbaff407780
>> Jan 20 10:17:26 breakout kernel: [ 1669.625547] FS: 00007f02cefa3840(0000) GS:ffff8cbaff940000(0000) knlGS:0000000000000000
>> Jan 20 10:17:26 breakout kernel: [ 1669.626944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> Jan 20 10:17:26 breakout kernel: [ 1669.628313] CR2: 00007f02ce94a924 CR3: 00000020134e0006 CR4: 00000000003606e0
>> Jan 20 10:17:26 breakout kernel: [ 1669.629691] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> Jan 20 10:17:26 breakout kernel: [ 1669.631048] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
>> ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
>
> Are you still able to reproduce this issue with a current 4.19.y
> kernel? How about kernel from bullseye and later?
>
> Regards,
> Salvatore
Reply to: