Bug#753258: LIO crash
Package: linux-image-3.2.0-4-amd64
Version: 3.2.57-3+deb7u2
Severity: important
I'm running a redundant storage server pair with DRBD and LIO. On the
secondary node I had some RAID card resets, which triggered DRBD to
disconnect the node - but before that, requests were held for several
seconds in the DRBD layer, which seems to be a problem for LIO (or maybe
the subsequent initiator reconnects - I'm not sure).
warning kernel: [1022062.839595] block drbd0: Remote failed to finish a request within ko-count * timeout
info kernel: [1022062.839604] block drbd0: peer( Secondary -> Unknown ) conn( Connected -> Timeout ) pdsk( UpToDate -> DUnknown )
info kernel: [1022062.839697] block drbd0: new current UUID 9E9A652A9DC0D857:7115C7324E030315:8355E6AB18AD03EE:8354E6AB18AD03EF
info kernel: [1022062.839957] block drbd0: asender terminated
info kernel: [1022062.839962] block drbd0: Terminating drbd0_asender
info kernel: [1022062.840629] block drbd0: Connection closed
info kernel: [1022062.840636] block drbd0: conn( Timeout -> Unconnected )
info kernel: [1022062.840641] block drbd0: receiver terminated
info kernel: [1022062.840644] block drbd0: Restarting drbd0_receiver
info kernel: [1022062.840647] block drbd0: receiver (re)started
info kernel: [1022062.840651] block drbd0: conn( Unconnected -> WFConnection )
emerg kernel: [1022062.840840] general protection fault: 0000 [#1] SMP
warning kernel: [1022062.840986] CPU 5
warning kernel: [1022062.841028] Modules linked in: tcm_loop tcm_fc iscsi_target_mod target_core_pscsi target_core_file target_core_iblock target_core_mod netconsole parport_pc ppdev bnep rfcomm bluetooth rfkill lp parport drbd lru_cache libfc scsi_transport_fc scsi_tgt configfs uinput nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_tcpudp iptable_filter ip_tables x_tables loop snd_pcm snd_page_alloc snd_timer ioatdma acpi_cpufreq psmouse i7core_edac iTCO_wdt serio_raw mperf edac_core iTCO_vendor_support coretemp joydev evdev snd soundcore pcspkr processor i2c_i801 thermal_sys crc32c_intel button ext4 crc16 jbd2 mbcache dm_mod raid1 md_mod sg sd_mod ses enclosure crc_t10dif usbhid hid usb_storage uhci_hcd megaraid_sas ahci libahci libata scsi_mod ehci_hcd usbcore usb_common ixgbe mdio igb i2c_algo_bit i2c_core dca [last unloaded: target_core_mod]
warning kernel: [1022062.845110]
warning kernel: [1022062.845169] Pid: 5165, comm: iscsi_trx Not tainted 3.2.0-4-amd64 #1 Debian 3.2.57-3+deb7u2 Supermicro X8DT3/X8DT3
warning kernel: [1022062.845373] RIP: 0010:[<ffffffffa0442696>] [<ffffffffa0442696>] core_tmr_release_req+0x2c/0x66 [target_core_mod]
warning kernel: [1022062.845514] RSP: 0018:ffff880314badd80 EFLAGS: 00010046
warning kernel: [1022062.845581] RAX: 0000000000000286 RBX: ffff8802ce58d7c0 RCX: dead000000100100
warning kernel: [1022062.845668] RDX: dead000000200200 RSI: 0000000000000286 RDI: ffff880329dc45d4
warning kernel: [1022062.845754] RBP: ffff880329dc45d4 R08: ffff880314badd60 R09: ffff8803155fc040
warning kernel: [1022062.845840] R10: ffff8803155fc040 R11: ffff8803155fc040 R12: ffff88032f365ae8
warning kernel: [1022062.845927] R13: ffff8803121d0ac0 R14: ffff88032f365a08 R15: ffff8803121d0ac0
warning kernel: [1022062.846014] FS: 0000000000000000(0000) GS:ffff88033fca0000(0000) knlGS:0000000000000000
warning kernel: [1022062.846103] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
warning kernel: [1022062.846170] CR2: 00007f73283f89de CR3: 0000000001605000 CR4: 00000000000006e0
warning kernel: [1022062.846257] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
warning kernel: [1022062.846344] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
warning kernel: [1022062.846430] Process iscsi_trx (pid: 5165, threadinfo ffff880314bac000, task ffff88032e951780)
emerg kernel: [1022062.846519] Stack:
warning kernel: [1022062.846577] 0000000000000282 ffff8803156517c0 ffff8803151ea800 ffffffffa0445b6e
warning kernel: [1022062.846813] ffff88032f365800 ffffffffa053af12 0000000000000030 0000000000000001
warning kernel: [1022062.847046] ffff88032f365b68 ffff8803151ea800 0000000000000246 ffff88032f365800
emerg kernel: [1022062.847280] Call Trace:
warning kernel: [1022062.847349] [<ffffffffa0445b6e>] ? transport_release_cmd+0x21/0x71 [target_core_mod]
warning kernel: [1022062.847442] [<ffffffffa053af12>] ? iscsit_close_connection+0x120/0x4bb [iscsi_target_mod]
warning kernel: [1022062.847536] [<ffffffffa053a948>] ? iscsi_target_rx_thread+0x18e4/0x1930 [iscsi_target_mod]
warning kernel: [1022062.847630] [<ffffffffa0539064>] ? iscsit_thread_get_cpumask+0x88/0x88 [iscsi_target_mod]
warning kernel: [1022062.847723] [<ffffffff8105f6d9>] ? kthread+0x76/0x7e
warning kernel: [1022062.847792] [<ffffffff81356d74>] ? kernel_thread_helper+0x4/0x10
warning kernel: [1022062.847862] [<ffffffff8105f663>] ? kthread_worker_fn+0x139/0x139
warning kernel: [1022062.847931] [<ffffffff81356d70>] ? gs_change+0x13/0x13
emerg kernel: [1022062.847997] Code: 53 48 89 fb 56 48 8b 6f 30 48 85 ed 74 45 48 81 c5 d4 01 00 00 48 89 ef e8 98 d5 f0 e0 48 8b 4b 40 48 8b 53 48 48 89 c6 48 89 ef <48> 89 51 08 48 89 0a 48 ba 00 01 10 00 00 00 ad de 48 b9 00 02
alert kernel: [1022062.850596] RIP [<ffffffffa0442696>] core_tmr_release_req+0x2c/0x66 [target_core_mod]
warning kernel: [1022062.856021] RSP <ffff880314badd80>
warning kernel: [1022062.856083] ---[ end trace 953259b8f570f942 ]---
Reply to: