Bug#1070685: linux-image-6.1.0-21-amd64: Found Trace in the logs about br_netfilter and nf_conntrack
On Tue, 7 May 2024 21:01:06 +0200
Salvatore Bonaccorso <carnil@debian.org> wrote:
> Control: tags -1 + moreinfo
>
> Hi Tito,
>
> On Tue, May 07, 2024 at 10:19:44AM +0200, Tito Ragusa wrote:
> > Package: src:linux
> > Version: 6.1.90-1
> > Severity: normal
> >
> > Dear Maintainer,
> >
> > * What led up to the situation?
> >
> > Rebooting the box after kernel package upgrade
> >
> > * What exactly did you do (or not do) that was effective (or
> > ineffective)?
> >
> > Nothing
> >
> > * What was the outcome of this action?
> >
> > Nothing
> >
> > * What outcome did you expect instead?
> >
> > Rebooting without traces in the logs
> >
> > -- Package-specific info:
> > ** Version:
> > Linux version 6.1.0-21-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.90-1 (2024-05-03)
> >
> > ** Command line:
> > BOOT_IMAGE=/vmlinuz-6.1.0-21-amd64 root=UUID=a75e6ad5-37fc-4f69-9361-f94d6c0e5d2f ro net.ifnames=0 apparmor=0 selinux=0 noresume consoleblank=0 console=tty1
> >
> > ** Tainted: WOE (12800)
> > * kernel issued warning
> > * externally-built ("out-of-tree") module was loaded
> > * unsigned module was loaded
> >
> > ** Kernel log:
> > May 7 08:10:12 cerberus kernel: [ 76.203881] ------------[ cut here ]------------
> > May 7 08:10:12 cerberus kernel: [ 76.203895] WARNING: CPU: 3 PID: 0 at net/bridge/br_netfilter_hooks.c:622 br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.203911] Modules linked in: ctr ccm nf_tables xt_nat xt_recent xt_geoip(OE) xt_NFQUEUE xt_mark xt_CT xt_tcpudp xt_helper nf_nat_ftp nf_conntrack_ftp ip6table_raw ip6table_mangle ip6table_nat xt_MASQUERADE iptable_nat nf_nat xt_TCPMSS xt_LOG nf_log_syslog ipt_REJECT nf_reject_ipv4 iptable_raw iptable_mangle xt_multiport xt_state xt_limit xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip6table_filter ip6_tables iptable_filter ip_tables x_tables ovpn_dco_v2(OE) ip6_udp_tunnel udp_tunnel tcp_bbr nct6775 nct6775_core hwmon_vid br_netfilter bridge stp llc nfnetlink_queue nfnetlink i915 ppdev intel_rapl_msr evdev intel_rapl_common x86_pkg_temp_thermal intel_powerclamp drm_buddy coretemp video rt2800usb wmi ghash_clmulni_intel drm_display_helper rt2x00usb sha512_ssse3 sha512_generic rt2800lib rt2x00lib cec sha256_ssse3 sha1_ssse3 rc_core mac80211 aesni_intel ttm crypto_simd drm_kms_helper libarc4 cryptd cfg80211 rapl intel_cstate
drm intel_uncore rfkill parport_pc pcspkr
> > May 7 08:10:12 cerberus kernel: [ 76.203999] serio_raw iTCO_wdt intel_pmc_bxt iTCO_vendor_support parport watchdog at24 button ext4 crc16 mbcache jbd2 crc32c_generic sg sd_mod t10_pi crc64_rocksoft crc64 crc_t10dif crct10dif_generic ahci libahci libata crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel psmouse scsi_mod i2c_i801 i2c_smbus ehci_pci ehci_hcd scsi_common lpc_ich usbcore igb i2c_algo_bit usb_common dca
> > May 7 08:10:12 cerberus kernel: [ 76.204039] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G OE 6.1.0-21-amd64 #1 Debian 6.1.90-1
> > May 7 08:10:12 cerberus kernel: [ 76.204044] Hardware name: Sophos UTM/To be filled by O.E.M., BIOS 4.6.4 11/08/2011
> > May 7 08:10:12 cerberus kernel: [ 76.204046] RIP: 0010:br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204056] Code: df e8 4b b7 cd fa 66 83 ab b8 00 00 00 08 eb 94 be 04 00 00 00 48 89 df e8 34 b7 cd fa 66 83 ab b8 00 00 00 04 e9 7a ff ff ff <0f> 0b e9 f0 fe ff ff 0f 0b e9 dd fe ff ff 48 89 ef e8 41 67 d8 fa
> > May 7 08:10:12 cerberus kernel: [ 76.204059] RSP: 0018:ffffbf5600144928 EFLAGS: 00010202
> > May 7 08:10:12 cerberus kernel: [ 76.204062] RAX: 0000000000000002 RBX: ffff9ac2862ff300 RCX: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204065] RDX: ffffbf5600144980 RSI: ffff9ac2862ff300 RDI: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204067] RBP: ffff9ac2848a8100 R08: 0000000000000001 R09: ffff9ac2872be980
> > May 7 08:10:12 cerberus kernel: [ 76.204070] R10: ffff9ac2872be000 R11: 0000000000000002 R12: ffffbf5600144980
> > May 7 08:10:12 cerberus kernel: [ 76.204072] R13: 0000000000000000 R14: ffff9ac282f4bac0 R15: ffff9ac2d027da00
> > May 7 08:10:12 cerberus kernel: [ 76.204074] FS: 0000000000000000(0000) GS:ffff9ac5b0180000(0000) knlGS:0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > May 7 08:10:12 cerberus kernel: [ 76.204080] CR2: 00005618751eb018 CR3: 000000002e610006 CR4: 00000000000606e0
> > May 7 08:10:12 cerberus kernel: [ 76.204083] Call Trace:
> > May 7 08:10:12 cerberus kernel: [ 76.204087] <IRQ>
> > May 7 08:10:12 cerberus kernel: [ 76.204090] ? __warn+0x7d/0xc0
> > May 7 08:10:12 cerberus kernel: [ 76.204097] ? br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204105] ? report_bug+0xe2/0x150
> > May 7 08:10:12 cerberus kernel: [ 76.204113] ? handle_bug+0x41/0x70
> > May 7 08:10:12 cerberus kernel: [ 76.204118] ? exc_invalid_op+0x13/0x60
> > May 7 08:10:12 cerberus kernel: [ 76.204122] ? asm_exc_invalid_op+0x16/0x20
> > May 7 08:10:12 cerberus kernel: [ 76.204128] ? br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204137] nf_hook_slow+0x41/0xc0
> > May 7 08:10:12 cerberus kernel: [ 76.204143] br_pass_frame_up+0x15d/0x1e0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204168] ? br_port_flags_change+0x80/0x80 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204190] br_handle_frame_finish+0x409/0x5b0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204213] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204234] br_nf_hook_thresh+0xec/0x100 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204243] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204264] br_nf_pre_routing_finish+0x184/0x470 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204272] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204294] ? nf_nat_ipv4_pre_routing+0x45/0xb0 [nf_nat]
> > May 7 08:10:12 cerberus kernel: [ 76.204306] br_nf_pre_routing+0x477/0x580 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204315] ? br_nf_hook_thresh+0x100/0x100 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204323] br_handle_frame+0x233/0x3c0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204345] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204366] ? br_handle_frame_finish+0x5b0/0x5b0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204387] __netif_receive_skb_core.constprop.0+0x263/0xef0
> > May 7 08:10:12 cerberus kernel: [ 76.204394] __netif_receive_skb_list_core+0x13a/0x2c0
> > May 7 08:10:12 cerberus kernel: [ 76.204400] netif_receive_skb_list_internal+0x1cd/0x300
> > May 7 08:10:12 cerberus kernel: [ 76.204405] ? dev_gro_receive+0x3b1/0x730
> > May 7 08:10:12 cerberus kernel: [ 76.204409] napi_complete_done+0x6d/0x1a0
> > May 7 08:10:12 cerberus kernel: [ 76.204415] igb_poll+0x883/0x1440 [igb]
> > May 7 08:10:12 cerberus kernel: [ 76.204435] ? enqueue_task_fair+0x87/0x3d0
> > May 7 08:10:12 cerberus kernel: [ 76.204440] __napi_poll+0x2b/0x160
> > May 7 08:10:12 cerberus kernel: [ 76.204445] net_rx_action+0x29e/0x350
> > May 7 08:10:12 cerberus kernel: [ 76.204451] __do_softirq+0xc6/0x2ab
> > May 7 08:10:12 cerberus kernel: [ 76.204456] ? handle_edge_irq+0x87/0x220
> > May 7 08:10:12 cerberus kernel: [ 76.204462] __irq_exit_rcu+0xaa/0xe0
> > May 7 08:10:12 cerberus kernel: [ 76.204467] common_interrupt+0x82/0xa0
> > May 7 08:10:12 cerberus kernel: [ 76.204472] </IRQ>
> > May 7 08:10:12 cerberus kernel: [ 76.204473] <TASK>
> > May 7 08:10:12 cerberus kernel: [ 76.204475] asm_common_interrupt+0x22/0x40
> > May 7 08:10:12 cerberus kernel: [ 76.204479] RIP: 0010:cpuidle_enter_state+0xde/0x420
> > May 7 08:10:12 cerberus kernel: [ 76.204483] Code: 00 00 31 ff e8 b3 24 97 ff 45 84 ff 74 16 9c 58 0f 1f 40 00 f6 c4 02 0f 85 25 03 00 00 31 ff e8 88 cf 9d ff fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
> > May 7 08:10:12 cerberus kernel: [ 76.204486] RSP: 0018:ffffbf56000b7e90 EFLAGS: 00000246
> > May 7 08:10:12 cerberus kernel: [ 76.204489] RAX: ffff9ac5b01b1a40 RBX: ffff9ac5b01bbf00 RCX: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204491] RDX: 0000000000000003 RSI: fffffffc174edff4 RDI: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204493] RBP: 0000000000000004 R08: 0000000000000004 R09: 0000000029625589
> > May 7 08:10:12 cerberus kernel: [ 76.204495] R10: 0000000000000018 R11: 00000000000026d1 R12: ffffffffbcb9ef20
> > May 7 08:10:12 cerberus kernel: [ 76.204498] R13: 00000011be19dc43 R14: 0000000000000004 R15: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204503] cpuidle_enter+0x29/0x40
> > May 7 08:10:12 cerberus kernel: [ 76.204506] do_idle+0x202/0x2a0
> > May 7 08:10:12 cerberus kernel: [ 76.204512] cpu_startup_entry+0x26/0x30
> > May 7 08:10:12 cerberus kernel: [ 76.204517] start_secondary+0x12a/0x150
> > May 7 08:10:12 cerberus kernel: [ 76.204523] secondary_startup_64_no_verify+0xe5/0xeb
> > May 7 08:10:12 cerberus kernel: [ 76.204531] </TASK>
> > May 7 08:10:12 cerberus kernel: [ 76.204532] ---[ end trace 0000000000000000 ]---
> > May 7 08:10:12 cerberus kernel: [ 76.204548] ------------[ cut here ]------------
> > May 7 08:10:12 cerberus kernel: [ 76.204549] WARNING: CPU: 3 PID: 0 at net/netfilter/nf_conntrack_core.c:1210 __nf_conntrack_confirm+0x58e/0x670 [nf_conntrack]
> > May 7 08:10:12 cerberus kernel: [ 76.204572] Modules linked in: ctr ccm nf_tables xt_nat xt_recent xt_geoip(OE) xt_NFQUEUE xt_mark xt_CT xt_tcpudp xt_helper nf_nat_ftp nf_conntrack_ftp ip6table_raw ip6table_mangle ip6table_nat xt_MASQUERADE iptable_nat nf_nat xt_TCPMSS xt_LOG nf_log_syslog ipt_REJECT nf_reject_ipv4 iptable_raw iptable_mangle xt_multiport xt_state xt_limit xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip6table_filter ip6_tables iptable_filter ip_tables x_tables ovpn_dco_v2(OE) ip6_udp_tunnel udp_tunnel tcp_bbr nct6775 nct6775_core hwmon_vid br_netfilter bridge stp llc nfnetlink_queue nfnetlink i915 ppdev intel_rapl_msr evdev intel_rapl_common x86_pkg_temp_thermal intel_powerclamp drm_buddy coretemp video rt2800usb wmi ghash_clmulni_intel drm_display_helper rt2x00usb sha512_ssse3 sha512_generic rt2800lib rt2x00lib cec sha256_ssse3 sha1_ssse3 rc_core mac80211 aesni_intel ttm crypto_simd drm_kms_helper libarc4 cryptd cfg80211 rapl intel_cstate
drm intel_uncore rfkill parport_pc pcspkr
> > May 7 08:10:12 cerberus kernel: [ 76.204649] serio_raw iTCO_wdt intel_pmc_bxt iTCO_vendor_support parport watchdog at24 button ext4 crc16 mbcache jbd2 crc32c_generic sg sd_mod t10_pi crc64_rocksoft crc64 crc_t10dif crct10dif_generic ahci libahci libata crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel psmouse scsi_mod i2c_i801 i2c_smbus ehci_pci ehci_hcd scsi_common lpc_ich usbcore igb i2c_algo_bit usb_common dca
> > May 7 08:10:12 cerberus kernel: [ 76.204684] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G W OE 6.1.0-21-amd64 #1 Debian 6.1.90-1
> > May 7 08:10:12 cerberus kernel: [ 76.204687] Hardware name: Sophos UTM/To be filled by O.E.M., BIOS 4.6.4 11/08/2011
> > May 7 08:10:12 cerberus kernel: [ 76.204689] RIP: 0010:__nf_conntrack_confirm+0x58e/0x670 [nf_conntrack]
> > May 7 08:10:12 cerberus kernel: [ 76.204708] Code: 04 84 c0 74 1b 8b 57 0c 48 01 f8 85 d2 0f 85 ae 00 00 00 48 85 c0 74 08 0f b6 db f0 48 0f ab 18 bb 01 00 00 00 e9 b9 fb ff ff <0f> 0b 48 89 d7 e8 b8 85 ed fa 8b 44 24 10 41 39 c7 75 4c be 00 02
> > May 7 08:10:12 cerberus kernel: [ 76.204710] RSP: 0018:ffffbf56001448b8 EFLAGS: 00010202
> > May 7 08:10:12 cerberus kernel: [ 76.204713] RAX: 0000000000000188 RBX: 000000000002132e RCX: ffff9ac2862ff300
> > May 7 08:10:12 cerberus kernel: [ 76.204716] RDX: ffffffffc0b85cb8 RSI: 0000000000000010 RDI: ffffffffc0b85cb8
> > May 7 08:10:12 cerberus kernel: [ 76.204718] RBP: 0000000000017010 R08: ffffbf5600144880 R09: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204720] R10: d01fd11969c5c8b7 R11: 77e4d90f021967d4 R12: 0000000000017010
> > May 7 08:10:12 cerberus kernel: [ 76.204722] R13: 000000000002132e R14: ffff9ac2848a8100 R15: 000000000000032e
> > May 7 08:10:12 cerberus kernel: [ 76.204725] FS: 0000000000000000(0000) GS:ffff9ac5b0180000(0000) knlGS:0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.204727] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > May 7 08:10:12 cerberus kernel: [ 76.204730] CR2: 00005618751eb018 CR3: 000000002e610006 CR4: 00000000000606e0
> > May 7 08:10:12 cerberus kernel: [ 76.204732] Call Trace:
> > May 7 08:10:12 cerberus kernel: [ 76.204734] <IRQ>
> > May 7 08:10:12 cerberus kernel: [ 76.204736] ? __warn+0x7d/0xc0
> > May 7 08:10:12 cerberus kernel: [ 76.204739] ? __nf_conntrack_confirm+0x58e/0x670 [nf_conntrack]
> > May 7 08:10:12 cerberus kernel: [ 76.204758] ? report_bug+0xe2/0x150
> > May 7 08:10:12 cerberus kernel: [ 76.204764] ? handle_bug+0x41/0x70
> > May 7 08:10:12 cerberus kernel: [ 76.204768] ? exc_invalid_op+0x13/0x60
> > May 7 08:10:12 cerberus kernel: [ 76.204772] ? asm_exc_invalid_op+0x16/0x20
> > May 7 08:10:12 cerberus kernel: [ 76.204777] ? __nf_conntrack_confirm+0x58e/0x670 [nf_conntrack]
> > May 7 08:10:12 cerberus kernel: [ 76.204795] ? __nf_conntrack_confirm+0xb0/0x670 [nf_conntrack]
> > May 7 08:10:12 cerberus kernel: [ 76.204815] br_nf_local_in+0xf4/0x1d0 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204824] nf_hook_slow+0x41/0xc0
> > May 7 08:10:12 cerberus kernel: [ 76.204828] br_pass_frame_up+0x15d/0x1e0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204850] ? br_port_flags_change+0x80/0x80 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204872] br_handle_frame_finish+0x409/0x5b0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204894] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204915] br_nf_hook_thresh+0xec/0x100 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204923] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204944] br_nf_pre_routing_finish+0x184/0x470 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204952] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.204974] ? nf_nat_ipv4_pre_routing+0x45/0xb0 [nf_nat]
> > May 7 08:10:12 cerberus kernel: [ 76.204985] br_nf_pre_routing+0x477/0x580 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.204994] ? br_nf_hook_thresh+0x100/0x100 [br_netfilter]
> > May 7 08:10:12 cerberus kernel: [ 76.205002] br_handle_frame+0x233/0x3c0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.205023] ? br_handle_local_finish+0x20/0x20 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.205044] ? br_handle_frame_finish+0x5b0/0x5b0 [bridge]
> > May 7 08:10:12 cerberus kernel: [ 76.205065] __netif_receive_skb_core.constprop.0+0x263/0xef0
> > May 7 08:10:12 cerberus kernel: [ 76.205071] __netif_receive_skb_list_core+0x13a/0x2c0
> > May 7 08:10:12 cerberus kernel: [ 76.205077] netif_receive_skb_list_internal+0x1cd/0x300
> > May 7 08:10:12 cerberus kernel: [ 76.205081] ? dev_gro_receive+0x3b1/0x730
> > May 7 08:10:12 cerberus kernel: [ 76.205086] napi_complete_done+0x6d/0x1a0
> > May 7 08:10:12 cerberus kernel: [ 76.205090] igb_poll+0x883/0x1440 [igb]
> > May 7 08:10:12 cerberus kernel: [ 76.205110] ? enqueue_task_fair+0x87/0x3d0
> > May 7 08:10:12 cerberus kernel: [ 76.205114] __napi_poll+0x2b/0x160
> > May 7 08:10:12 cerberus kernel: [ 76.205119] net_rx_action+0x29e/0x350
> > May 7 08:10:12 cerberus kernel: [ 76.205124] __do_softirq+0xc6/0x2ab
> > May 7 08:10:12 cerberus kernel: [ 76.205129] ? handle_edge_irq+0x87/0x220
> > May 7 08:10:12 cerberus kernel: [ 76.205134] __irq_exit_rcu+0xaa/0xe0
> > May 7 08:10:12 cerberus kernel: [ 76.205139] common_interrupt+0x82/0xa0
> > May 7 08:10:12 cerberus kernel: [ 76.205143] </IRQ>
> > May 7 08:10:12 cerberus kernel: [ 76.205145] <TASK>
> > May 7 08:10:12 cerberus kernel: [ 76.205146] asm_common_interrupt+0x22/0x40
> > May 7 08:10:12 cerberus kernel: [ 76.205150] RIP: 0010:cpuidle_enter_state+0xde/0x420
> > May 7 08:10:12 cerberus kernel: [ 76.205153] Code: 00 00 31 ff e8 b3 24 97 ff 45 84 ff 74 16 9c 58 0f 1f 40 00 f6 c4 02 0f 85 25 03 00 00 31 ff e8 88 cf 9d ff fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
> > May 7 08:10:12 cerberus kernel: [ 76.205156] RSP: 0018:ffffbf56000b7e90 EFLAGS: 00000246
> > May 7 08:10:12 cerberus kernel: [ 76.205159] RAX: ffff9ac5b01b1a40 RBX: ffff9ac5b01bbf00 RCX: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.205161] RDX: 0000000000000003 RSI: fffffffc174edff4 RDI: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.205163] RBP: 0000000000000004 R08: 0000000000000004 R09: 0000000029625589
> > May 7 08:10:12 cerberus kernel: [ 76.205165] R10: 0000000000000018 R11: 00000000000026d1 R12: ffffffffbcb9ef20
> > May 7 08:10:12 cerberus kernel: [ 76.205167] R13: 00000011be19dc43 R14: 0000000000000004 R15: 0000000000000000
> > May 7 08:10:12 cerberus kernel: [ 76.205172] cpuidle_enter+0x29/0x40
> > May 7 08:10:12 cerberus kernel: [ 76.205175] do_idle+0x202/0x2a0
> > May 7 08:10:12 cerberus kernel: [ 76.205181] cpu_startup_entry+0x26/0x30
> > May 7 08:10:12 cerberus kernel: [ 76.205185] start_secondary+0x12a/0x150
> > May 7 08:10:12 cerberus kernel: [ 76.205190] secondary_startup_64_no_verify+0xe5/0xeb
> > May 7 08:10:12 cerberus kernel: [ 76.205197] </TASK>
> > May 7 08:10:12 cerberus kernel: [ 76.205198] ---[ end trace 0000000000000000 ]---
>
> You seem to have loaded a OOT module. Does the issue happens as well
> without ovpn_dco_v2 ? And if so are you able to reliably reproduce it?
>
> Regards,
> Salvatore
Hi,
by searching through the logs it seems to happen reliably at shutdown (1 time) or after
rebooting (4 times) the machine:
grep -r "cut here" /var/log/
/var/log/messages:Apr 13 21:19:28 cerberus kernel: [ 74.032684] ------------[ cut here ]------------
/var/log/messages:May 4 08:03:36 cerberus kernel: [1766697.846830] ------------[ cut here ]------------
/var/log/messages:May 4 08:05:15 cerberus kernel: [ 74.881436] ------------[ cut here ]------------
/var/log/messages:May 7 08:10:12 cerberus kernel: [ 76.203881] ------------[ cut here ]------------
/var/log/messages:May 7 08:10:12 cerberus kernel: [ 76.204548] ------------[ cut here ]------------
after:
May 7 21:37:49 cerberus kernel: [ 58.392874] br0: port 7(wlan0) entered learning state
May 7 21:38:05 cerberus kernel: [ 73.495898] br0: port 7(wlan0) entered forwarding state
May 7 21:38:05 cerberus kernel: [ 73.495913] br0: topology change detected, propagating
If you want I can upload the other traces.
I have now blacklisted openvpn-dco-v2 module and will reboot the box to see if it happens again,
but I have also xtables-addons-dkms modules which I cannot unload as they are needed
for geoip filtering.
Sadly this is a production machine acting as my firewall/router/access point/ipc so I cannot
experiment that much with it.
After reboot I've got a new trace. so yes I can reproduce it reliably.
Let me know how I can help debug this.
Ciao,
Tito
May 7 21:37:49 cerberus kernel: [ 58.392874] br0: port 7(wlan0) entered learning state
May 7 21:38:05 cerberus kernel: [ 73.495898] br0: port 7(wlan0) entered forwarding state
May 7 21:38:05 cerberus kernel: [ 73.495913] br0: topology change detected, propagating
May 7 21:38:05 cerberus kernel: [ 73.523314] ------------[ cut here ]------------
May 7 21:38:05 cerberus kernel: [ 73.523321] WARNING: CPU: 3 PID: 0 at net/bridge/br_netfilter_hooks.c:622 br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523338] Modules linked in: tun ctr ccm nf_tables xt_nat xt_recent xt_geoip(OE) xt_NFQUEUE xt_mark xt_CT xt_tcpudp xt_helper nf_nat_ftp nf_conntrack_ftp ip6table_raw ip6table_mangle ip6table_nat xt_MASQUERADE iptable_nat nf_nat xt_TCPMSS xt_LOG nf_log_syslog ipt_REJECT nf_reject_ipv4 iptable_raw iptable_mangle xt_multiport xt_state xt_limit xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip6table_filter ip6_tables iptable_filter ip_tables x_tables tcp_bbr nct6775 nct6775_core hwmon_vid br_netfilter bridge stp llc nfnetlink_queue nfnetlink intel_rapl_msr rt2800usb intel_rapl_common ppdev i915 x86_pkg_temp_thermal evdev intel_powerclamp rt2x00usb rt2800lib drm_buddy coretemp video rt2x00lib ghash_clmulni_intel sha512_ssse3 wmi sha512_generic drm_display_helper sha256_ssse3 cec sha1_ssse3 mac80211 rc_core aesni_intel libarc4 crypto_simd cfg80211 cryptd ttm rapl drm_kms_helper intel_cstate rfkill drm intel_uncore iTCO_wdt intel_pmc
_bxt pcspkr iTCO_vendor_support
May 7 21:38:05 cerberus kernel: [ 73.523451] watchdog serio_raw parport_pc parport at24 button ext4 crc16 mbcache jbd2 crc32c_generic sg sd_mod t10_pi crc64_rocksoft crc64 crc_t10dif crct10dif_generic ehci_pci ahci ehci_hcd libahci crct10dif_pclmul crct10dif_common crc32_pclmul usbcore libata crc32c_intel usb_common lpc_ich psmouse scsi_mod i2c_i801 i2c_smbus scsi_common igb i2c_algo_bit dca
May 7 21:38:05 cerberus kernel: [ 73.523500] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G OE 6.1.0-21-amd64 #1 Debian 6.1.90-1
May 7 21:38:05 cerberus kernel: [ 73.523505] Hardware name: Sophos UTM/To be filled by O.E.M., BIOS 4.6.4 11/08/2011
May 7 21:38:05 cerberus kernel: [ 73.523507] RIP: 0010:br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523516] Code: df e8 4b c7 f9 ce 66 83 ab b8 00 00 00 08 eb 94 be 04 00 00 00 48 89 df e8 34 c7 f9 ce 66 83 ab b8 00 00 00 04 e9 7a ff ff ff <0f> 0b e9 f0 fe ff ff 0f 0b e9 dd fe ff ff 48 89 ef e8 41 77 04 cf
May 7 21:38:05 cerberus kernel: [ 73.523519] RSP: 0018:ffffb07200144928 EFLAGS: 00010202
May 7 21:38:05 cerberus kernel: [ 73.523523] RAX: 0000000000000002 RBX: ffff970e43d13f00 RCX: 0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.523525] RDX: ffffb07200144980 RSI: ffff970e43d13f00 RDI: 0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.523527] RBP: ffff970e4294e800 R08: 0000000000000001 R09: ffff970e43e8c980
May 7 21:38:05 cerberus kernel: [ 73.523529] R10: 0000000000000000 R11: 000000000000000c R12: ffffb07200144980
May 7 21:38:05 cerberus kernel: [ 73.523531] R13: 0000000000000000 R14: ffff970e428f5180 R15: ffff970e410e6400
May 7 21:38:05 cerberus kernel: [ 73.523539] FS: 0000000000000000(0000) GS:ffff971170180000(0000) knlGS:0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.523542] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 7 21:38:05 cerberus kernel: [ 73.523545] CR2: 0000563f7840b000 CR3: 000000030c210004 CR4: 00000000000606e0
May 7 21:38:05 cerberus kernel: [ 73.523549] Call Trace:
May 7 21:38:05 cerberus kernel: [ 73.523553] <IRQ>
May 7 21:38:05 cerberus kernel: [ 73.523556] ? __warn+0x7d/0xc0
May 7 21:38:05 cerberus kernel: [ 73.523562] ? br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523573] ? report_bug+0xe2/0x150
May 7 21:38:05 cerberus kernel: [ 73.523582] ? handle_bug+0x41/0x70
May 7 21:38:05 cerberus kernel: [ 73.523587] ? exc_invalid_op+0x13/0x60
May 7 21:38:05 cerberus kernel: [ 73.523591] ? asm_exc_invalid_op+0x16/0x20
May 7 21:38:05 cerberus kernel: [ 73.523597] ? br_nf_local_in+0x1a9/0x1d0 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523607] nf_hook_slow+0x41/0xc0
May 7 21:38:05 cerberus kernel: [ 73.523613] br_pass_frame_up+0x15d/0x1e0 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523642] ? br_port_flags_change+0x80/0x80 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523666] br_handle_frame_finish+0x409/0x5b0 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523692] ? br_handle_local_finish+0x20/0x20 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523714] br_nf_hook_thresh+0xec/0x100 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523723] ? br_handle_local_finish+0x20/0x20 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523746] br_nf_pre_routing_finish+0x184/0x470 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523754] ? br_handle_local_finish+0x20/0x20 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523776] ? nf_nat_ipv4_pre_routing+0x45/0xb0 [nf_nat]
May 7 21:38:05 cerberus kernel: [ 73.523789] br_nf_pre_routing+0x477/0x580 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523798] ? br_nf_hook_thresh+0x100/0x100 [br_netfilter]
May 7 21:38:05 cerberus kernel: [ 73.523808] br_handle_frame+0x233/0x3c0 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523831] ? br_handle_local_finish+0x20/0x20 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523853] ? br_handle_frame_finish+0x5b0/0x5b0 [bridge]
May 7 21:38:05 cerberus kernel: [ 73.523876] __netif_receive_skb_core.constprop.0+0x263/0xef0
May 7 21:38:05 cerberus kernel: [ 73.523883] __netif_receive_skb_list_core+0x13a/0x2c0
May 7 21:38:05 cerberus kernel: [ 73.523889] netif_receive_skb_list_internal+0x1cd/0x300
May 7 21:38:05 cerberus kernel: [ 73.523894] ? dev_gro_receive+0x3b1/0x730
May 7 21:38:05 cerberus kernel: [ 73.523898] ? sugov_get_util+0x7e/0x90
May 7 21:38:05 cerberus kernel: [ 73.523902] napi_complete_done+0x6d/0x1a0
May 7 21:38:05 cerberus kernel: [ 73.523907] igb_poll+0x883/0x1440 [igb]
May 7 21:38:05 cerberus kernel: [ 73.523929] ? enqueue_task_fair+0x87/0x3d0
May 7 21:38:05 cerberus kernel: [ 73.523934] __napi_poll+0x2b/0x160
May 7 21:38:05 cerberus kernel: [ 73.523939] net_rx_action+0x29e/0x350
May 7 21:38:05 cerberus kernel: [ 73.523944] __do_softirq+0xc6/0x2ab
May 7 21:38:05 cerberus kernel: [ 73.523951] ? handle_edge_irq+0x87/0x220
May 7 21:38:05 cerberus kernel: [ 73.523958] __irq_exit_rcu+0xaa/0xe0
May 7 21:38:05 cerberus kernel: [ 73.523963] common_interrupt+0x82/0xa0
May 7 21:38:05 cerberus kernel: [ 73.523968] </IRQ>
May 7 21:38:05 cerberus kernel: [ 73.523969] <TASK>
May 7 21:38:05 cerberus kernel: [ 73.523971] asm_common_interrupt+0x22/0x40
May 7 21:38:05 cerberus kernel: [ 73.523975] RIP: 0010:cpuidle_enter_state+0xde/0x420
May 7 21:38:05 cerberus kernel: [ 73.523980] Code: 00 00 31 ff e8 b3 24 97 ff 45 84 ff 74 16 9c 58 0f 1f 40 00 f6 c4 02 0f 85 25 03 00 00 31 ff e8 88 cf 9d ff fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
May 7 21:38:05 cerberus kernel: [ 73.523983] RSP: 0018:ffffb072000b7e90 EFLAGS: 00000246
May 7 21:38:05 cerberus kernel: [ 73.523986] RAX: ffff9711701b1a40 RBX: ffff9711701bbf00 RCX: 0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.523988] RDX: 0000000000000003 RSI: fffffffc13822415 RDI: 0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.523991] RBP: 0000000000000004 R08: 0000000000000004 R09: 00000000296253c8
May 7 21:38:05 cerberus kernel: [ 73.523993] R10: 0000000000000018 R11: 0000000000008baf R12: ffffffff90f9ef20
May 7 21:38:05 cerberus kernel: [ 73.523995] R13: 000000111e53bf09 R14: 0000000000000004 R15: 0000000000000000
May 7 21:38:05 cerberus kernel: [ 73.524001] cpuidle_enter+0x29/0x40
May 7 21:38:05 cerberus kernel: [ 73.524005] do_idle+0x202/0x2a0
May 7 21:38:05 cerberus kernel: [ 73.524010] cpu_startup_entry+0x26/0x30
May 7 21:38:05 cerberus kernel: [ 73.524015] start_secondary+0x12a/0x150
May 7 21:38:05 cerberus kernel: [ 73.524022] secondary_startup_64_no_verify+0xe5/0xeb
May 7 21:38:05 cerberus kernel: [ 73.524030] </TASK>
May 7 21:38:05 cerberus kernel: [ 73.524032] ---[ end trace 0000000000000000 ]---
Reply to: