Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O

To: Rik Theys <Rik.Theys@esat.kuleuven.be>, 606968@bugs.debian.org
Subject: Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O
From: Ian Campbell <ijc@hellion.org.uk>
Date: Tue, 14 Dec 2010 13:28:08 +0000
Message-id: <[🔎] 1292333288.32368.20.camel@zakaz.uk.xensource.com>
Reply-to: Ian Campbell <ijc@hellion.org.uk>, 606968@bugs.debian.org
In-reply-to: <[🔎] 4D061A6E.7020307@esat.kuleuven.be>
References: <[🔎] 4D061A6E.7020307@esat.kuleuven.be>
Hi Rik,

On Mon, 2010-12-13 at 14:06 +0100, Rik Theys wrote: 
> Package: linux-2.6
> Version: 2.6.32-29
> Severity: normal
> 
> When performing a lot of I/O, the Xen dom0 kernel crashes with the 
> following error:
> 
> [  325.437727] console [netcon0] enabled
> [  325.437795] netconsole: network logging started
> [ 1076.017245] mpt2sas 0000:03:00.0: DMA: Out of SW-IOMMU space for 
> 32768 bytes.

Under Xen heavier use is made of the swiotlb than under native, because
psuedo-physically contiguous runs of pages may not actually be
contiguous in the machine address space and therefore need bouncing.

Assuming this is a real DMA allocation failure and not a symptom of the
bug which Ben mentioned then it is possible that you have genuinely run
out of room in the SWIOTLB. You can increase the size of the swiotlb by
passing the swiotlb=<N> parameter to the kernel.

The unit of <N> is "number of slabs" and I'm not entirely sure what the
default is, I think it may be 64 in which case you could try 128. In you
boot log you should see a message "DMA: Placing %luMB software IO TLB
between %p - %p" so you should be able to verify before and after that
you have made it larger.

Ian.

> [ 1076.017333] BUG: unable to handle kernel NULL pointer dereference at 
> 0000000000000010
> [ 1076.017517] IP: [<ffffffffa00668d8>] _scsih_qcmd+0x408/0x4d4 [mpt2sas]
> [ 1076.017618] PGD b169067 PUD 1b85a067 PMD 0
> [ 1076.017766] Oops: 0000 [#1] SMP
> [ 1076.017891] last sysfs file: /sys/module/configfs/refcnt
> [ 1076.017945] CPU 2
> [ 1076.018023] Modules linked in: netconsole configfs xen_evtchn xenfs 
> fuse bridge stp loop snd_pcm snd_timer snd soundcore snd_page_alloc 
> evdev joydev dcdbas pcspkr psmouse serio_raw button power_meter 
> processor acpi_processor ext4 mbcache jbd2 crc16 dm_mod sd_mod 
> crc_t10dif usb_storage hid_cherry usbhid hid sg sr_mod cdrom ata_generic 
> uhci_hcd ata_piix libata ehci_hcd lpfc igb scsi_transport_fc usbcore 
> mpt2sas scsi_transport_sas scsi_tgt nls_base dca scsi_mod bnx2 thermal 
> thermal_sys [last unloaded: configfs]
> [ 1076.019945] Pid: 629, comm: kdmflush Not tainted 2.6.32-5-xen-amd64 
> #1 PowerEdge R710
> [ 1076.020024] RIP: e030:[<ffffffffa00668d8>]  [<ffffffffa00668d8>] 
> _scsih_qcmd+0x408/0x4d4 [mpt2sas]
> [ 1076.020136] RSP: e02b:ffff88007b08dac0  EFLAGS: 00010002
> [ 1076.020191] RAX: 0000000000000008 RBX: 000000000000000e RCX: 
> 0000000000000000
> [ 1076.020248] RDX: 0000000000000000 RSI: 0000000014000000 RDI: 
> ffff88003f3cf420
> [ 1076.020306] RBP: ffff88007af2be08 R08: 0000000000004071 R09: 
> ffff88000969a000
> [ 1076.020363] R10: 0000000000000240 R11: ffff88007b47e000 R12: 
> 0000000000000000
> [ 1076.020420] R13: ffff88007c6cf5a0 R14: 00000000ffffffd3 R15: 
> 000000000000000f
> [ 1076.020481] FS:  00007f9c68b1d7a0(0000) GS:ffff8800036fb000(0000) 
> knlGS:0000000000000000
> [ 1076.020555] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 1076.020609] CR2: 0000000000000010 CR3: 0000000039622000 CR4: 
> 0000000000002660
> [ 1076.020668] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
> 0000000000000000
> [ 1076.020725] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
> 0000000000000400
> [ 1076.020782] Process kdmflush (pid: 629, threadinfo ffff88007b08c000, 
> task ffff88007aed8e20)
> [ 1076.020856] Stack:
> [ 1076.020905]  dead000000100100 ffff88005c138a80 0000005a7aeb0000 
> ffff88007c567800
> [ 1076.021050] <0> 94000000d5000000 00000000bc92be00 ffff88007af02d00 
> 140000005c138a80
> [ 1076.021275] <0> ffff88007af2be00 0000000000000000 ffff88004fd35300 
> ffff88007c6cf000
> [ 1076.021539] Call Trace:
> [ 1076.021593]  [<ffffffffa0021b77>] ? scsi_dispatch_cmd+0x1c0/0x23c 
> [scsi_mod]
> [ 1076.021653]  [<ffffffffa002725c>] ? scsi_request_fn+0x3a5/0x506 
> [scsi_mod]
> [ 1076.021714]  [<ffffffff8117fd48>] ? __blk_run_queue+0x35/0x66
> [ 1076.021771]  [<ffffffff81177abc>] ? elv_insert+0xad/0x260
> [ 1076.021833]  [<ffffffff81180977>] ? __make_request+0x3a4/0x428
> [ 1076.021891]  [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
> [ 1076.021948]  [<ffffffff8117f0a7>] ? generic_make_request+0x299/0x2f9
> [ 1076.022008]  [<ffffffffa01a4541>] ? 
> __split_and_process_bio+0x1d6/0x56b [dm_mod]
> [ 1076.022087]  [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
> [ 1076.022145]  [<ffffffff8130c8b2>] ? _spin_unlock_irqrestore+0xd/0xe
> [ 1076.022204]  [<ffffffffa01a3c28>] ? 
> dm_wait_for_completion+0x119/0x12a [dm_mod]
> [ 1076.022279]  [<ffffffffa01a491d>] ? dm_flush+0x47/0x59 [dm_mod]
> [ 1076.022337]  [<ffffffffa01a49e7>] ? dm_wq_work+0xb8/0x167 [dm_mod]
> [ 1076.022395]  [<ffffffff810626df>] ? worker_thread+0x188/0x21d
> [ 1076.022452]  [<ffffffffa01a492f>] ? dm_wq_work+0x0/0x167 [dm_mod]
> [ 1076.022509]  [<ffffffff81065d0a>] ? autoremove_wake_function+0x0/0x2e
> [ 1076.022567]  [<ffffffff81062557>] ? worker_thread+0x0/0x21d
> [ 1076.022622]  [<ffffffff81065a3d>] ? kthread+0x79/0x81
> [ 1076.022678]  [<ffffffff81012baa>] ? child_rip+0xa/0x20
> [ 1076.022732]  [<ffffffff81011d61>] ? int_ret_from_sys_call+0x7/0x1b
> [ 1076.022788]  [<ffffffff8101251d>] ? retint_restore_args+0x5/0x6
> [ 1076.022844]  [<ffffffff81012ba0>] ? child_rip+0x0/0x20
> [ 1076.022897] Code: 48 89 ef 81 ce 00 00 00 30 41 ff 95 38 03 00 00 85 
> db 74 0a 44 89 fb 48 8b 6c 24 40 eb 47 48 8b 6c 24 40 e9 9a 00 00 00 83 
> fb 01 <49> 8b 54 24 10 49 8b 85 38 03 00 00 75 06 8b 74 24 24 eb 04 8b
> [ 1076.024940] RIP  [<ffffffffa00668d8>] _scsih_qcmd+0x408/0x4d4 [mpt2sas]
> [ 1076.025028]  RSP <ffff88007b08dac0>
> [ 1076.025079] CR2: 0000000000000010
> [ 1076.025129] ---[ end trace 499ef1e81b5ec85f ]---
> 
> 
> I can easily reproduce this. This looks like the problem described here:
> http://xen.1045712.n5.nabble.com/Xen-Dom0-crash-doing-some-I-O-with-quot-Out-of-SW-IOMMU-space-quot-td3266112.html
> 
> This system is also an R710 with the same raid controller. The link 
> above says to try it with a RAID0
> instead of a RAID1, but that's not an option. I don't care that the RAID 
> is slow, but it shouldn't crash.
> 
> The dom0 has 2GB assigned to it using the dom0_mem=2G xen parameter.
> 
> I reproduce this by scp'ing a big file (20GB) to the system while 
> running a large aptitude install,
> for example aptitude install kde-desktop. I do the scp from another 
> physical box. There are no
> vm's running on the box.
> 
> So far I've been unable to reproduce this problem with the regular 
> (non-xen) kernel.
> 
> Regards,
> 
> Rik
> 
> 
> 
> -- Package-specific info:
> ** Version:
> Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-29) 
> (ben@decadent.org.uk) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Fri 
> Dec 10 17:41:50 UTC 2010
> 
> ** Command line:
> placeholder root=/dev/mapper/vg_bocq-root ro ipv6.disable=1 quiet
> 
> ** Not tainted
> 
> ** Kernel log:
> [   49.958271] XENBUS: Unable to read cpu state
> [   49.958540] XENBUS: Unable to read cpu state
> [   49.958709] XENBUS: Unable to read cpu state
> [   49.958822] XENBUS: Unable to read cpu state
> [   49.958934] XENBUS: Unable to read cpu state
> [   49.959044] XENBUS: Unable to read cpu state
> [   49.959170] XENBUS: Unable to read cpu state
> [   49.959291] XENBUS: Unable to read cpu state
> [   49.959407] XENBUS: Unable to read cpu state
> [   49.959522] XENBUS: Unable to read cpu state
> [   49.959632] XENBUS: Unable to read cpu state
> [   49.959743] XENBUS: Unable to read cpu state
> [   49.959853] XENBUS: Unable to read cpu state
> [   49.959964] XENBUS: Unable to read cpu state
> [   49.960076] XENBUS: Unable to read cpu state
> [   49.960187] XENBUS: Unable to read cpu state
> [   49.960297] XENBUS: Unable to read cpu state
> [   49.960407] XENBUS: Unable to read cpu state
> [   49.960517] XENBUS: Unable to read cpu state
> [   49.960628] XENBUS: Unable to read cpu state
> [   49.960738] XENBUS: Unable to read cpu state
> [   49.960849] XENBUS: Unable to read cpu state
> [   49.960959] XENBUS: Unable to read cpu state
> [   49.961088] XENBUS: Unable to read cpu state
> [   51.620247]   alloc irq_desc for 4426 on node -1
> [   51.620252]   alloc kstat_irqs on node -1
> [   51.620355]   alloc irq_desc for 4425 on node -1
> [   51.620358]   alloc kstat_irqs on node -1
> [   51.620445]   alloc irq_desc for 4424 on node -1
> [   51.620448]   alloc kstat_irqs on node -1
> [   51.620535]   alloc irq_desc for 4423 on node -1
> [   51.620537]   alloc kstat_irqs on node -1
> [   51.620624]   alloc irq_desc for 4422 on node -1
> [   51.620626]   alloc kstat_irqs on node -1
> [   51.620713]   alloc irq_desc for 4421 on node -1
> [   51.620716]   alloc kstat_irqs on node -1
> [   51.620802]   alloc irq_desc for 4420 on node -1
> [   51.620804]   alloc kstat_irqs on node -1
> [   51.620891]   alloc irq_desc for 4419 on node -1
> [   51.620894]   alloc kstat_irqs on node -1
> [   51.620980]   alloc irq_desc for 4418 on node -1
> [   51.620983]   alloc kstat_irqs on node -1
> [   51.678556] bnx2: eth5: using MSIX
> [   51.722552]   alloc irq_desc for 4417 on node -1
> [   51.722556]   alloc kstat_irqs on node -1
> [   51.722650]   alloc irq_desc for 4416 on node -1
> [   51.722653]   alloc kstat_irqs on node -1
> [   51.722740]   alloc irq_desc for 4415 on node -1
> [   51.722743]   alloc kstat_irqs on node -1
> [   51.722829]   alloc irq_desc for 4414 on node -1
> [   51.722832]   alloc kstat_irqs on node -1
> [   51.722919]   alloc irq_desc for 4413 on node -1
> [   51.722922]   alloc kstat_irqs on node -1
> [   51.723008]   alloc irq_desc for 4412 on node -1
> [   51.723011]   alloc kstat_irqs on node -1
> [   51.723097]   alloc irq_desc for 4411 on node -1
> [   51.723100]   alloc kstat_irqs on node -1
> [   51.723186]   alloc irq_desc for 4410 on node -1
> [   51.723189]   alloc kstat_irqs on node -1
> [   51.723275]   alloc irq_desc for 4409 on node -1
> [   51.723278]   alloc kstat_irqs on node -1
> [   51.774589] bnx2: eth6: using MSIX
> [   51.777167]   alloc irq_desc for 4408 on node -1
> [   51.777171]   alloc kstat_irqs on node -1
> [   51.777265]   alloc irq_desc for 4407 on node -1
> [   51.777268]   alloc kstat_irqs on node -1
> [   51.777355]   alloc irq_desc for 4406 on node -1
> [   51.777358]   alloc kstat_irqs on node -1
> [   51.777444]   alloc irq_desc for 4405 on node -1
> [   51.777448]   alloc kstat_irqs on node -1
> [   51.777539]   alloc irq_desc for 4404 on node -1
> [   51.777543]   alloc kstat_irqs on node -1
> [   51.777630]   alloc irq_desc for 4403 on node -1
> [   51.777632]   alloc kstat_irqs on node -1
> [   51.777719]   alloc irq_desc for 4402 on node -1
> [   51.777722]   alloc kstat_irqs on node -1
> [   51.777808]   alloc irq_desc for 4401 on node -1
> [   51.777811]   alloc kstat_irqs on node -1
> [   51.777897]   alloc irq_desc for 4400 on node -1
> [   51.777900]   alloc kstat_irqs on node -1
> [   51.829928] bnx2: eth7: using MSIX
> [   55.017016] bnx2: eth7 NIC Copper Link is Up, 1000 Mbps full duplex, 
> receive & transmit flow control ON
> [  172.154562] netconsole: local port 6665
> [  172.154567] netconsole: local IP 0.0.0.0
> [  172.154569] netconsole: interface eth7
> [  172.154572] netconsole: remote port 9999
> [  172.154575] netconsole: remote IP 192.168.1.2
> [  172.154577] netconsole: remote ethernet address ff:ff:ff:ff:ff:ff
> [  172.154582] netconsole: local IP 192.168.1.1
> [  172.187570] console [netcon0] enabled
> [  172.187573] netconsole: network logging started
> [  186.099513] netconsole: local port 6665
> [  186.099517] netconsole: local IP 0.0.0.0
> [  186.099520] netconsole: interface eth7
> [  186.099522] netconsole: remote port 9999
> [  186.099525] netconsole: remote IP 192.168.1.2
> [  186.099528] netconsole: remote ethernet address ff:ff:ff:ff:ff:ff
> [  186.099533] netconsole: local IP 192.168.1.1
> [  186.139227] console [netcon0] enabled
> [  186.139231] netconsole: network logging started
> 
> ** Model information
> sys_vendor: Dell Inc.
> product_name: PowerEdge R710
> product_version:
> chassis_vendor: Dell Inc.
> chassis_version:
> bios_vendor: Dell Inc.
> bios_version: 2.1.15
> board_vendor: Dell Inc.
> board_name: 0MD99X
> board_version: A05
> 
> ** Loaded modules:
> Module                  Size  Used by
> netconsole              5923  0
> configfs               19924  2 netconsole
> xen_evtchn              4339  1
> xenfs                   9600  1
> fuse                   50369  1
> bridge                 39662  0
> stp                     1440  1 bridge
> loop                   11799  0
> joydev                  8459  0
> snd_pcm                60551  0
> snd_timer              15582  1 snd_pcm
> snd                    46446  2 snd_pcm,snd_timer
> soundcore               4598  1 snd
> snd_page_alloc          6249  1 snd_pcm
> evdev                   7352  8
> dcdbas                  5048  0
> pcspkr                  1699  0
> psmouse                49777  0
> serio_raw               3752  0
> button                  4650  0
> power_meter             8302  0
> processor              35941  0
> acpi_processor          5087  1 processor,[permanent]
> ext4                  289033  3
> mbcache                 5050  1 ext4
> jbd2                   67015  1 ext4
> crc16                   1319  1 ext4
> dm_mod                 53754  9
> sd_mod                 29873  3
> crc_t10dif              1276  1 sd_mod
> usb_storage            39561  0
> hid_cherry              1501  0
> usbhid                 33276  0
> hid                    63193  2 hid_cherry,usbhid
> sg                     18760  0
> sr_mod                 12602  0
> cdrom                  29415  1 sr_mod
> ata_generic             3047  0
> uhci_hcd               18521  0
> lpfc                  361456  0
> scsi_transport_fc      35355  1 lpfc
> scsi_tgt                8482  1 scsi_transport_fc
> ata_piix               21124  0
> mpt2sas                87741  2
> libata                133616  2 ata_generic,ata_piix
> ehci_hcd               31151  0
> usbcore               122034  5 usb_storage,usbhid,uhci_hcd,ehci_hcd
> nls_base                6377  1 usbcore
> scsi_transport_sas     19865  1 mpt2sas
> igb                    77975  0
> dca                     3761  1 igb
> scsi_mod              122133  10 
> sd_mod,usb_storage,sg,sr_mod,lpfc,scsi_transport_fc,scsi_tgt,mpt2sas,libata,scsi_transport_sas
> thermal                11674  0
> thermal_sys            11942  2 processor,thermal
> bnx2                   57417  0
> 
> ** Network interface configuration:
> 
> auto lo
> iface lo inet loopback
> 
> auto eth4
> iface eth4 inet manual
> 
> auto br0
> iface br0 inet dhcp
> 	bridge_ports eth4
> 	bridge_stp off
> 	bridge_hello 0
> 	bridge_fd 0
> 	bridge_maxwait 0
> 
> 
> ** Network status:
> *** IP interfaces and addresses:
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>      inet 127.0.0.1/8 scope host lo
> 2: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP 
> qlen 1000
>      link/ether b8:ac:6f:90:fa:c9 brd ff:ff:ff:ff:ff:ff
> 3: eth5: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether b8:ac:6f:90:fa:cb brd ff:ff:ff:ff:ff:ff
> 4: eth6: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether b8:ac:6f:90:fa:cd brd ff:ff:ff:ff:ff:ff
> 5: eth7: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP 
> qlen 1000
>      link/ether b8:ac:6f:90:fa:cf brd ff:ff:ff:ff:ff:ff
>      inet 192.168.1.1/24 brd 192.168.1.255 scope global eth7
> 6: eth0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether 00:1b:21:7e:d7:a8 brd ff:ff:ff:ff:ff:ff
> 7: eth1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether 00:1b:21:7e:d7:a9 brd ff:ff:ff:ff:ff:ff
> 8: eth2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether 00:1b:21:7e:d7:ac brd ff:ff:ff:ff:ff:ff
> 9: eth3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state 
> DOWN qlen 1000
>      link/ether 00:1b:21:7e:d7:ad brd ff:ff:ff:ff:ff:ff
> 10: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state 
> UNKNOWN
>      link/ether b8:ac:6f:90:fa:c9 brd ff:ff:ff:ff:ff:ff
>      inet 10.33.138.28/24 brd 10.33.138.255 scope global br0
> 
> *** Device statistics:
> Inter-|   Receive                                                |  Transmit
>   face |bytes    packets errs drop fifo frame compressed multicast|bytes 
>     packets errs drop fifo colls carrier compressed
>      lo:     560       8    0    0    0     0          0         0 
> 560       8    0    0    0     0       0          0
>    eth4:  107652    1059    0    0    0     0          0         0 
> 66441     497    0    0    0     0       0          0
>    eth5:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>    eth6:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>    eth7:     230       3    0    0    0     0          0         0 
> 1614       7    0    0    0     0       0          0
>    eth0:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>    eth1:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>    eth2:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>    eth3:       0       0    0    0    0     0          0         0 
>    0       0    0    0    0     0       0          0
>     br0:   88622    1061    0    0    0     0          0       199 
> 64951     500    0    0    0     0       0          0
> 
> *** Protocol statistics:
> Ip:
>      904 total packets received
>      11 with invalid addresses
>      0 forwarded
>      0 incoming packets discarded
>      882 incoming packets delivered
>      502 requests sent out
> Icmp:
>      1 ICMP messages received
>      0 input ICMP message failed.
>      ICMP input histogram:
>          echo replies: 1
>      1 ICMP messages sent
>      0 ICMP messages failed
>      ICMP output histogram:
>          echo request: 1
> IcmpMsg:
>          InType0: 1
>          OutType8: 1
> Tcp:
>      3 active connections openings
>      3 passive connection openings
>      0 failed connection attempts
>      0 connection resets received
>      2 connections established
>      840 segments received
>      478 segments send out
>      0 segments retransmited
>      0 bad segments received.
>      0 resets sent
> Udp:
>      23 packets received
>      0 packets to unknown port received.
>      0 packet receive errors
>      23 packets sent
> UdpLite:
> TcpExt:
>      1 TCP sockets finished time wait in fast timer
>      5 delayed acks sent
>      4 packets directly queued to recvmsg prequeue.
>      321 packet headers predicted
>      23 acknowledgments not containing data payload received
>      416 predicted acknowledgments
> IpExt:
>      InMcastPkts: 4
>      InBcastPkts: 14
>      InOctets: 81030
>      OutOctets: 57499
>      InMcastOctets: 112
>      InBcastOctets: 1401
> 
> *** Device features:
> br0: 0x191833
> eth0: 0x2114bb3
> eth1: 0x2114bb3
> eth2: 0x2114bb3
> eth3: 0x2114bb3
> eth4: 0x1909b3
> eth5: 0x1909b3
> eth6: 0x1909b3
> eth7: 0x1909b3
> lo: 0x13865
> 
> ** PCI devices:
> 00:00.0 Host bridge [0600]: Intel Corporation 5520 I/O Hub to ESI Port 
> [8086:3406] (rev 13)
> 	Subsystem: Dell Device [1028:0235]
> 	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Interrupt: pin A routed to IRQ 15
> 	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
> 		Address: 00000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 128 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		RootCtl: ErrCorrectable- ErrNon-Fatal+ ErrFatal+ PMEIntEna- CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 17s to 64s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Capabilities: [160 v0] Vendor Specific Information: ID=0002 Rev=0 
> Len=00c <?>
> 
> 00:01.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI 
> Express Root Port 1 [8086:3408] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
> 	Memory behind bridge: d4000000-d7ffffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort+ <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee00618  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #1, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Capabilities: [160 v0] Vendor Specific Information: ID=0002 Rev=0 
> Len=00c <?>
> 	Kernel driver in use: pcieport
> 
> 00:03.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI 
> Express Root Port 3 [8086:340a] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
> 	Memory behind bridge: d8000000-dbffffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort+ <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee00638  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #3, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Capabilities: [160 v0] Vendor Specific Information: ID=0002 Rev=0 
> Len=00c <?>
> 	Kernel driver in use: pcieport
> 
> 00:04.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI 
> Express Root Port 4 [8086:340b] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
> 	I/O behind bridge: 0000f000-0000ffff
> 	Memory behind bridge: de900000-deafffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee00658  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #4, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Kernel driver in use: pcieport
> 
> 00:05.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI 
> Express Root Port 5 [8086:340c] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
> 	I/O behind bridge: 0000e000-0000efff
> 	Memory behind bridge: deb00000-debfffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee00678  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #5, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
> 			Slot #2, PowerLimit 25.000W; Interlock- NoCompl-
> 		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
> 			Control: AttnInd Off, PwrInd Off, Power- Interlock-
> 		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
> 			Changed: MRL- PresDet+ LinkState+
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Kernel driver in use: pcieport
> 
> 00:06.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI 
> Express Root Port 6 [8086:340d] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
> 	I/O behind bridge: 0000d000-0000dfff
> 	Memory behind bridge: dec00000-decfffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee00698  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #6, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
> 			Slot #1, PowerLimit 25.000W; Interlock- NoCompl-
> 		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
> 			Control: AttnInd Off, PwrInd Off, Power- Interlock-
> 		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
> 			Changed: MRL- PresDet+ LinkState+
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Kernel driver in use: pcieport
> 
> 00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI 
> Express Root Port 7 [8086:340e] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee006b8  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 128 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #7, Speed 5GT/s, Width x8, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled+ Retrain- CommClk-
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
> 			Slot #4, PowerLimit 25.000W; Interlock- NoCompl-
> 		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
> 			Control: AttnInd Off, PwrInd Off, Power- Interlock-
> 		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
> 			Changed: MRL- PresDet+ LinkState-
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Capabilities: [160 v0] Vendor Specific Information: ID=0002 Rev=0 
> Len=00c <?>
> 	Kernel driver in use: pcieport
> 
> 00:09.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI 
> Express Root Port 9 [8086:3410] (rev 13) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=00, secondary=07, subordinate=0a, sec-latency=0
> 	I/O behind bridge: 0000b000-0000cfff
> 	Memory behind bridge: dd000000-de7fffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Subsystem: Dell Device [1028:0235]
> 	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
> 		Address: fee006d8  Data: 0000
> 		Masking: 00000002  Pending: 00000000
> 	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
> 		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #9, Speed 5GT/s, Width x8, ASPM L0s L1, Latency L0 
> <512ns, L1 <64us
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
> 			Slot #3, PowerLimit 25.000W; Interlock- NoCompl-
> 		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
> 			Control: AttnInd Off, PwrInd Off, Power- Interlock-
> 		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
> 			Changed: MRL- PresDet+ LinkState+
> 		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
> 		RootCap: CRSVisible-
> 		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
> 		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
> 		DevCtl2: Completion Timeout: 1s to 3.5s, TimeoutDis- ARIFwd-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [e0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol+
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [150 v1] Access Control Services
> 		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ 
> EgressCtrl- DirectTrans-
> 	Kernel driver in use: pcieport
> 
> 00:14.0 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub System 
> Management Registers [8086:342e] (rev 13) (prog-if 00 [8259])
> 	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
> 		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 128 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed unknown, Width x0, ASPM L0s, Latency L0 
> unlimited, L1 unlimited
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
> 		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 
> 00:14.1 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub GPIO and 
> Scratch Pad Registers [8086:3422] (rev 13) (prog-if 00 [8259])
> 	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
> 		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 128 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed unknown, Width x0, ASPM L0s, Latency L0 
> unlimited, L1 unlimited
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
> 		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 
> 00:14.2 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub Control 
> Status and RAS Registers [8086:3423] (rev 13) (prog-if 00 [8259])
> 	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
> 		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 128 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed unknown, Width x0, ASPM L0s, Latency L0 
> unlimited, L1 unlimited
> 			ClockPM- Surprise+ LLActRep+ BwNot+
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
> 		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 
> 00:1a.0 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB UHCI Controller #4 [8086:2937] (rev 02) (prog-if 00 [UHCI])
> 	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
> 	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin A routed to IRQ 17
> 	Region 4: I/O ports at ac40 [size=32]
> 	Capabilities: [50] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: uhci_hcd
> 
> 00:1a.1 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB UHCI Controller #5 [8086:2938] (rev 02) (prog-if 00 [UHCI])
> 	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
> 	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin B routed to IRQ 18
> 	Region 4: I/O ports at ac60 [size=32]
> 	Capabilities: [50] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: uhci_hcd
> 
> 00:1a.7 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB2 EHCI Controller #2 [8086:293c] (rev 02) (prog-if 20 [EHCI])
> 	Subsystem: Dell PowerEdge R710 USB EHCI Controller [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin C routed to IRQ 19
> 	Region 0: Memory at de8ff800 (32-bit, non-prefetchable) [size=1K]
> 	Capabilities: [50] Power Management version 2
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA 
> PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [58] Debug port: BAR=1 offset=00a0
> 	Capabilities: [98] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: ehci_hcd
> 
> 00:1d.0 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB UHCI Controller #1 [8086:2934] (rev 02) (prog-if 00 [UHCI])
> 	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
> 	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin A routed to IRQ 21
> 	Region 4: I/O ports at ac80 [size=32]
> 	Capabilities: [50] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: uhci_hcd
> 
> 00:1d.1 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB UHCI Controller #2 [8086:2935] (rev 02) (prog-if 00 [UHCI])
> 	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
> 	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin B routed to IRQ 20
> 	Region 4: I/O ports at aca0 [size=32]
> 	Capabilities: [50] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: uhci_hcd
> 
> 00:1d.7 USB Controller [0c03]: Intel Corporation 82801I (ICH9 Family) 
> USB2 EHCI Controller #1 [8086:293a] (rev 02) (prog-if 20 [EHCI])
> 	Subsystem: Dell PowerEdge R710 USB EHCI Controller [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin A routed to IRQ 21
> 	Region 0: Memory at de8ffc00 (32-bit, non-prefetchable) [size=1K]
> 	Capabilities: [50] Power Management version 2
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA 
> PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [58] Debug port: BAR=1 offset=00a0
> 	Capabilities: [98] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: ehci_hcd
> 
> 00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge 
> [8086:244e] (rev 92) (prog-if 01 [Subtractive decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Bus: primary=00, secondary=0b, subordinate=0b, sec-latency=32
> 	Memory behind bridge: dc000000-dcffffff
> 	Prefetchable memory behind bridge: 00000000d3800000-00000000d3ffffff
> 	Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [50] Subsystem: Dell Device [1028:0235]
> 
> 00:1f.0 ISA bridge [0601]: Intel Corporation 82801IB (ICH9) LPC 
> Interface Controller [8086:2918] (rev 02)
> 	Subsystem: Dell Device [1028:0235]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
> 
> 00:1f.2 IDE interface [0101]: Intel Corporation 82801IB (ICH9) 2 port 
> SATA IDE Controller [8086:2921] (rev 02) (prog-if 8f [Master SecP SecO 
> PriP PriO])
> 	Subsystem: Dell PowerEdge R710 SATA IDE Controller [1028:0235]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0
> 	Interrupt: pin C routed to IRQ 23
> 	Region 0: I/O ports at ac10 [size=8]
> 	Region 1: I/O ports at ac08 [size=4]
> 	Region 2: I/O ports at ac18 [size=8]
> 	Region 3: I/O ports at ac0c [size=4]
> 	Region 4: I/O ports at ac20 [size=16]
> 	Region 5: I/O ports at ac30 [size=16]
> 	Capabilities: [70] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [b0] PCI Advanced Features
> 		AFCap: TP+ FLR+
> 		AFCtrl: FLR-
> 		AFStatus: TP-
> 	Kernel driver in use: ata_piix
> 
> 01:00.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme II 
> BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
> 	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 36
> 	Region 0: Memory at d4000000 (64-bit, non-prefetchable) [size=32M]
> 	Capabilities: [48] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] Vital Product Data
> 		Product Name: Broadcom NetXtreme II Ethernet Controller
> 		Read-only fields:
> 			[PN] Part number: BCM95709C0
> 			[EC] Engineering changes: 220197-2
> 			[SN] Serial number: 0123456789
> 			[MN] Manufacture ID: 31 30 32 38
> 			[V0] Vendor specific: 5.2.7
> 			[RV] Reserved: checksum good, 23 byte(s) reserved
> 		End
> 	Capabilities: [58] MSI: Enable- Count=1/16 Maskable- 64bit+
> 		Address: 0000000000000000  Data: 0000
> 	Capabilities: [a0] MSI-X: Enable+ Count=9 Masked-
> 		Vector table: BAR=0 offset=0000c000
> 		PBA: BAR=0 offset=0000e000
> 	Capabilities: [ac] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <2us, L1 <2us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Device Serial Number b8-ac-6f-ff-fe-90-fa-c9
> 	Capabilities: [110 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [150 v1] Power Budgeting <?>
> 	Capabilities: [160 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: bnx2
> 
> 01:00.1 Ethernet controller [0200]: Broadcom Corporation NetXtreme II 
> BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
> 	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin B routed to IRQ 48
> 	Region 0: Memory at d6000000 (64-bit, non-prefetchable) [size=32M]
> 	Capabilities: [48] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] Vital Product Data
> 		Product Name: Broadcom NetXtreme II Ethernet Controller
> 		Read-only fields:
> 			[PN] Part number: BCM95709C0
> 			[EC] Engineering changes: 220197-2
> 			[SN] Serial number: 0123456789
> 			[MN] Manufacture ID: 31 30 32 38
> 			[V0] Vendor specific: 5.2.7
> 			[RV] Reserved: checksum good, 23 byte(s) reserved
> 		End
> 	Capabilities: [58] MSI: Enable- Count=1/16 Maskable- 64bit+
> 		Address: 0000000000000000  Data: 0000
> 	Capabilities: [a0] MSI-X: Enable+ Count=9 Masked-
> 		Vector table: BAR=0 offset=0000c000
> 		PBA: BAR=0 offset=0000e000
> 	Capabilities: [ac] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <2us, L1 <2us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Device Serial Number b8-ac-6f-ff-fe-90-fa-cb
> 	Capabilities: [110 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [150 v1] Power Budgeting <?>
> 	Capabilities: [160 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: bnx2
> 
> 02:00.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme II 
> BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
> 	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 32
> 	Region 0: Memory at d8000000 (64-bit, non-prefetchable) [size=32M]
> 	Capabilities: [48] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] Vital Product Data
> 		Product Name: Broadcom NetXtreme II Ethernet Controller
> 		Read-only fields:
> 			[PN] Part number: BCM95709C0
> 			[EC] Engineering changes: 220197-2
> 			[SN] Serial number: 0123456789
> 			[MN] Manufacture ID: 31 30 32 38
> 			[V0] Vendor specific: 5.2.7
> 			[RV] Reserved: checksum good, 23 byte(s) reserved
> 		End
> 	Capabilities: [58] MSI: Enable- Count=1/16 Maskable- 64bit+
> 		Address: 0000000000000000  Data: 0000
> 	Capabilities: [a0] MSI-X: Enable+ Count=9 Masked-
> 		Vector table: BAR=0 offset=0000c000
> 		PBA: BAR=0 offset=0000e000
> 	Capabilities: [ac] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <2us, L1 <2us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Device Serial Number b8-ac-6f-ff-fe-90-fa-cd
> 	Capabilities: [110 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [150 v1] Power Budgeting <?>
> 	Capabilities: [160 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: bnx2
> 
> 02:00.1 Ethernet controller [0200]: Broadcom Corporation NetXtreme II 
> BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
> 	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
> 	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin B routed to IRQ 42
> 	Region 0: Memory at da000000 (64-bit, non-prefetchable) [size=32M]
> 	Capabilities: [48] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] Vital Product Data
> 		Product Name: Broadcom NetXtreme II Ethernet Controller
> 		Read-only fields:
> 			[PN] Part number: BCM95709C0
> 			[EC] Engineering changes: 220197-2
> 			[SN] Serial number: 0123456789
> 			[MN] Manufacture ID: 31 30 32 38
> 			[V0] Vendor specific: 5.2.7
> 			[RV] Reserved: checksum good, 23 byte(s) reserved
> 		End
> 	Capabilities: [58] MSI: Enable- Count=1/16 Maskable- 64bit+
> 		Address: 0000000000000000  Data: 0000
> 	Capabilities: [a0] MSI-X: Enable+ Count=9 Masked-
> 		Vector table: BAR=0 offset=0000c000
> 		PBA: BAR=0 offset=0000e000
> 	Capabilities: [ac] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <2us, L1 <2us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Device Serial Number b8-ac-6f-ff-fe-90-fa-cf
> 	Capabilities: [110 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [150 v1] Power Budgeting <?>
> 	Capabilities: [160 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: bnx2
> 
> 03:00.0 Serial Attached SCSI controller [0107]: LSI Logic / Symbios 
> Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
> 	Subsystem: Dell PERC H200 Integrated [1028:1f1e]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 33
> 	Region 0: I/O ports at fc00 [size=256]
> 	Region 1: Memory at deab0000 (64-bit, non-prefetchable) [size=64K]
> 	Region 3: Memory at deac0000 (64-bit, non-prefetchable) [size=256K]
> 	Expansion ROM at de900000 [disabled] [size=1M]
> 	Capabilities: [50] Power Management version 3
> 		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [68] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 4096 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 <64ns, L1 
> <1us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range BC, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [d0] Vital Product Data
> 		Not readable
> 	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
> 		Address: 0000000000000000  Data: 0000
> 	Capabilities: [c0] MSI-X: Enable+ Count=15 Masked-
> 		Vector table: BAR=1 offset=0000e000
> 		PBA: BAR=1 offset=0000f800
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [138 v1] Power Budgeting <?>
> 	Kernel driver in use: mpt2sas
> 
> 04:00.0 Fibre Channel [0c04]: Emulex Corporation Saturn-X: LightPulse 
> Fibre Channel Host Adapter [10df:f100] (rev 03)
> 	Subsystem: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host 
> Adapter [10df:f100]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 34
> 	Region 0: Memory at debfb000 (64-bit, non-prefetchable) [size=4K]
> 	Region 2: Memory at debfc000 (64-bit, non-prefetchable) [size=16K]
> 	Region 4: I/O ports at ec00 [size=256]
> 	Expansion ROM at deb00000 [disabled] [size=256K]
> 	Capabilities: [58] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [60] MSI: Enable- Count=1/16 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [78] MSI-X: Enable- Count=32 Masked-
> 		Vector table: BAR=2 offset=00002000
> 		PBA: BAR=2 offset=00003000
> 	Capabilities: [84] Vital Product Data
> 		Product Name: FG, LPE12000, 8GB/S, 1-PORT FC: PCI EXPRESS HBA SW DIAG 
> OPTICS, EMC
> 		Read-only fields:
> 			[PN] Part number: LPE12000-E
> 			[SN] Serial number: BT03575232
> 			[V0] Vendor specific: BT03575232
> 			[V1] Vendor specific: EMC LPe12000-E 8Gb PCIe Fibre Channel Adapter
> 			[V2] Vendor specific: LPe12000-E
> 			[V3] Vendor specific: T2:78,T3:79,7A,7B,7D,7E,7F,T7:73,TB:73,TFF:78
> 			[V4] Vendor specific:
> 			[RV] Reserved: checksum bad, 27 byte(s) reserved
> 		End
> 	Capabilities: [94] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <1us, L1 unlimited
> 			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 <4us, L1 
> <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [12c v1] Power Budgeting <?>
> 	Kernel driver in use: lpfc
> 
> 05:00.0 Fibre Channel [0c04]: Emulex Corporation Saturn-X: LightPulse 
> Fibre Channel Host Adapter [10df:f100] (rev 03)
> 	Subsystem: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host 
> Adapter [10df:f100]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 35
> 	Region 0: Memory at decfb000 (64-bit, non-prefetchable) [size=4K]
> 	Region 2: Memory at decfc000 (64-bit, non-prefetchable) [size=16K]
> 	Region 4: I/O ports at dc00 [size=256]
> 	Expansion ROM at dec00000 [disabled] [size=256K]
> 	Capabilities: [58] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [60] MSI: Enable- Count=1/16 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [78] MSI-X: Enable- Count=32 Masked-
> 		Vector table: BAR=2 offset=00002000
> 		PBA: BAR=2 offset=00003000
> 	Capabilities: [84] Vital Product Data
> 		Product Name: FG, LPE12000, 8GB/S, 1-PORT FC: PCI EXPRESS HBA SW DIAG 
> OPTICS, EMC
> 		Read-only fields:
> 			[PN] Part number: LPE12000-E
> 			[SN] Serial number: BT03456096
> 			[V0] Vendor specific: BT03456096
> 			[V1] Vendor specific: EMC LPe12000-E 8Gb PCIe Fibre Channel Adapter
> 			[V2] Vendor specific: LPe12000-E
> 			[V3] Vendor specific: T2:78,T3:79,7A,7B,7D,7E,7F,T7:73,TB:73,TFF:78
> 			[V4] Vendor specific:
> 			[RV] Reserved: checksum bad, 27 byte(s) reserved
> 		End
> 	Capabilities: [94] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <1us, L1 unlimited
> 			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed 5GT/s, Width x8, ASPM L0s, Latency L0 <4us, L1 
> <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [12c v1] Power Budgeting <?>
> 	Kernel driver in use: lpfc
> 
> 07:00.0 PCI bridge [0604]: Integrated Device Technology, Inc. PES12N3A 
> PCI Express Switch [111d:8018] (rev 0e) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=07, secondary=08, subordinate=0a, sec-latency=0
> 	I/O behind bridge: 0000b000-0000cfff
> 	Memory behind bridge: dd000000-de7fffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Express (v1) Upstream Port, MSI 00
> 		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-SlotPowerLimit 25.000W
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <4us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 	Capabilities: [c0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [200 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=4
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=02 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed+ WRR32+ WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 			Port Arbitration Table <?>
> 	Kernel driver in use: pcieport
> 
> 08:02.0 PCI bridge [0604]: Integrated Device Technology, Inc. PES12N3A 
> PCI Express Switch [111d:8018] (rev 0e) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=08, secondary=09, subordinate=09, sec-latency=0
> 	I/O behind bridge: 0000c000-0000cfff
> 	Memory behind bridge: ddc00000-de7fffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Express (v1) Downstream Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #2, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <4us
> 			ClockPM- Surprise+ LLActRep+ BwNot-
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 	Capabilities: [c0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
> 		Address: 00000000fee006f8  Data: 0000
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [200 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: pcieport
> 
> 08:04.0 PCI bridge [0604]: Integrated Device Technology, Inc. PES12N3A 
> PCI Express Switch [111d:8018] (rev 0e) (prog-if 00 [Normal decode])
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Bus: primary=08, secondary=0a, subordinate=0a, sec-latency=0
> 	I/O behind bridge: 0000b000-0000bfff
> 	Memory behind bridge: dd000000-ddbfffff
> 	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- <SERR- <PERR-
> 	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
> 		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> 	Capabilities: [40] Express (v1) Downstream Port (Slot-), MSI 00
> 		DevCap:	MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
> 			ExtTag+ RBE+ FLReset-
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
> 			MaxPayload 256 bytes, MaxReadReq 128 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #4, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <512ns, L1 <4us
> 			ClockPM- Surprise+ LLActRep+ BwNot-
> 		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ 
> BWMgmt- ABWMgmt-
> 	Capabilities: [c0] Power Management version 3
> 		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> 	Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
> 		Address: 00000000fee00718  Data: 0000
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES+ TLP+ FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC+ UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
> 	Capabilities: [200 v1] Virtual Channel
> 		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
> 		Arb:	Fixed- WRR32- WRR64- WRR128-
> 		Ctrl:	ArbSelect=Fixed
> 		Status:	InProgress-
> 		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> 			Arb:	Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
> 			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> 			Status:	NegoPending- InProgress-
> 	Kernel driver in use: pcieport
> 
> 09:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit 
> Network Connection [8086:10e8] (rev 01)
> 	Subsystem: Intel Corporation Gigabit ET Quad Port Server Adapter 
> [8086:a02c]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 55
> 	Region 0: Memory at ddfc0000 (32-bit, non-prefetchable) [size=128K]
> 	Region 2: I/O ports at ccc0 [size=32]
> 	Region 3: Memory at ddfb8000 (32-bit, non-prefetchable) [size=16K]
> 	Capabilities: [40] Power Management version 3
> 		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
> 		Vector table: BAR=3 offset=00000000
> 		PBA: BAR=3 offset=00002000
> 	Capabilities: [a0] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #2, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <4us, L1 <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-7e-d7-a8
> 	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
> 		ARICap:	MFVC- ACS-, Next Function: 1
> 		ARICtl:	MFVC- ACS-, Function Group: 0
> 	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
> 		IOVCap:	Migration-, Interrupt Message Number: 000
> 		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy-
> 		IOVSta:	Migration-
> 		Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency 
> Link: 00
> 		VF offset: 384, stride: 2, Device ID: 10ca
> 		Supported Page Size: 00000553, System Page Size: 00000001
> 		Region 0: Memory at 00000000ddc00000 (64-bit, non-prefetchable)
> 		Region 3: Memory at 00000000ddc20000 (64-bit, non-prefetchable)
> 		VF Migration: offset: 00000000, BIR: 0
> 	Kernel driver in use: igb
> 
> 09:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit 
> Network Connection [8086:10e8] (rev 01)
> 	Subsystem: Intel Corporation Gigabit ET Quad Port Server Adapter 
> [8086:a02c]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin B routed to IRQ 49
> 	Region 0: Memory at ddfe0000 (32-bit, non-prefetchable) [size=128K]
> 	Region 2: I/O ports at cce0 [size=32]
> 	Region 3: Memory at ddfbc000 (32-bit, non-prefetchable) [size=16K]
> 	Capabilities: [40] Power Management version 3
> 		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
> 		Vector table: BAR=3 offset=00000000
> 		PBA: BAR=3 offset=00002000
> 	Capabilities: [a0] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
> 		LnkCap:	Port #2, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <4us, L1 <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-7e-d7-a8
> 	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
> 		ARICap:	MFVC- ACS-, Next Function: 0
> 		ARICtl:	MFVC- ACS-, Function Group: 0
> 	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
> 		IOVCap:	Migration-, Interrupt Message Number: 000
> 		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy-
> 		IOVSta:	Migration-
> 		Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency 
> Link: 01
> 		VF offset: 384, stride: 2, Device ID: 10ca
> 		Supported Page Size: 00000553, System Page Size: 00000001
> 		Region 0: Memory at 00000000ddc40000 (64-bit, non-prefetchable)
> 		Region 3: Memory at 00000000ddc60000 (64-bit, non-prefetchable)
> 		VF Migration: offset: 00000000, BIR: 0
> 	Kernel driver in use: igb
> 
> 0a:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit 
> Network Connection [8086:10e8] (rev 01)
> 	Subsystem: Intel Corporation Gigabit ET Quad Port Server Adapter 
> [8086:a02c]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 40
> 	Region 0: Memory at dd3c0000 (32-bit, non-prefetchable) [size=128K]
> 	Region 2: I/O ports at bcc0 [size=32]
> 	Region 3: Memory at dd3b8000 (32-bit, non-prefetchable) [size=16K]
> 	Capabilities: [40] Power Management version 3
> 		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
> 		Vector table: BAR=3 offset=00000000
> 		PBA: BAR=3 offset=00002000
> 	Capabilities: [a0] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #4, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <4us, L1 <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-7e-d7-ac
> 	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
> 		ARICap:	MFVC- ACS-, Next Function: 1
> 		ARICtl:	MFVC- ACS-, Function Group: 0
> 	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
> 		IOVCap:	Migration-, Interrupt Message Number: 000
> 		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy-
> 		IOVSta:	Migration-
> 		Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency 
> Link: 00
> 		VF offset: 384, stride: 2, Device ID: 10ca
> 		Supported Page Size: 00000553, System Page Size: 00000001
> 		Region 0: Memory at 00000000dd000000 (64-bit, non-prefetchable)
> 		Region 3: Memory at 00000000dd020000 (64-bit, non-prefetchable)
> 		VF Migration: offset: 00000000, BIR: 0
> 	Kernel driver in use: igb
> 
> 0a:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit 
> Network Connection [8086:10e8] (rev 01)
> 	Subsystem: Intel Corporation Gigabit ET Quad Port Server Adapter 
> [8086:a02c]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx+
> 	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
> <MAbort- >SERR- <PERR- INTx-
> 	Latency: 0, Cache Line Size: 64 bytes
> 	Interrupt: pin B routed to IRQ 50
> 	Region 0: Memory at dd3e0000 (32-bit, non-prefetchable) [size=128K]
> 	Region 2: I/O ports at bce0 [size=32]
> 	Region 3: Memory at dd3bc000 (32-bit, non-prefetchable) [size=16K]
> 	Capabilities: [40] Power Management version 3
> 		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
> 	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
> 		Address: 0000000000000000  Data: 0000
> 		Masking: 00000000  Pending: 00000000
> 	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
> 		Vector table: BAR=3 offset=00000000
> 		PBA: BAR=3 offset=00002000
> 	Capabilities: [a0] Express (v2) Endpoint, MSI 00
> 		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
> 			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
> 		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
> 			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
> 			MaxPayload 256 bytes, MaxReadReq 512 bytes
> 		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
> 		LnkCap:	Port #4, Speed 2.5GT/s, Width x4, ASPM L0s L1, Latency L0 
> <4us, L1 <64us
> 			ClockPM- Surprise- LLActRep- BwNot-
> 		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
> 			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> 		LnkSta:	Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- 
> BWMgmt- ABWMgmt-
> 		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
> 		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-
> 		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, 
> Selectable De-emphasis: -6dB
> 			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
> ComplianceSOS-
> 			 Compliance De-emphasis: -6dB
> 		LnkSta2: Current De-emphasis Level: -6dB
> 	Capabilities: [100 v1] Advanced Error Reporting
> 		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- 
> MalfTLP- ECRC- UnsupReq- ACSViol-
> 		UESvrt:	DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ 
> MalfTLP+ ECRC- UnsupReq- ACSViol-
> 		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
> 		CEMsk:	RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
> 		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
> 	Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-7e-d7-ac
> 	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
> 		ARICap:	MFVC- ACS-, Next Function: 0
> 		ARICtl:	MFVC- ACS-, Function Group: 0
> 	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
> 		IOVCap:	Migration-, Interrupt Message Number: 000
> 		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy-
> 		IOVSta:	Migration-
> 		Initial VFs: 8, Total VFs: 8, Number of VFs: 8, Function Dependency 
> Link: 01
> 		VF offset: 384, stride: 2, Device ID: 10ca
> 		Supported Page Size: 00000553, System Page Size: 00000001
> 		Region 0: Memory at 00000000dd040000 (64-bit, non-prefetchable)
> 		Region 3: Memory at 00000000dd060000 (64-bit, non-prefetchable)
> 		VF Migration: offset: 00000000, BIR: 0
> 	Kernel driver in use: igb
> 
> 0b:03.0 VGA compatible controller [0300]: Matrox Graphics, Inc. MGA 
> G200eW WPCM450 [102b:0532] (rev 0a) (prog-if 00 [VGA controller])
> 	Subsystem: Dell PowerEdge R710 MGA G200eW WPCM450 [1028:0235]
> 	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
> 	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 	Latency: 32 (4000ns min, 8000ns max), Cache Line Size: 64 bytes
> 	Interrupt: pin A routed to IRQ 10
> 	Region 0: Memory at d3800000 (32-bit, prefetchable) [size=8M]
> 	Region 1: Memory at dc7fc000 (32-bit, non-prefetchable) [size=16K]
> 	Region 2: Memory at dc800000 (32-bit, non-prefetchable) [size=8M]
> 	[virtual] Expansion ROM at dc000000 [disabled] [size=64K]
> 	Capabilities: [dc] Power Management version 1
> 		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
> 		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> 
> 
> ** USB devices:
> Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 005 Device 003: ID 0624:0248 Avocent Corp.
> Bus 005 Device 002: ID 046a:0023 Cherry GmbH CyMotion Master Linux Keyboard
> Bus 005 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> Bus 001 Device 003: ID 1307:0165 Transcend Information, Inc. 2GB/4GB 
> Flash Drive
> Bus 001 Device 002: ID 0424:2514 Standard Microsystems Corp. USB 2.0 Hub
> Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> 
> 
> -- System Information:
> Debian Release: squeeze/sid
>    APT prefers testing
>    APT policy: (500, 'testing')
> Architecture: amd64 (x86_64)
> 
> Kernel: Linux 2.6.32-5-xen-amd64 (SMP w/24 CPU cores)
> Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/dash
> 
> Versions of packages linux-image-2.6.32-5-xen-amd64 depends on:
> ii  debconf [debconf-2.0]         1.5.36     Debian configuration 
> management sy
> ii  initramfs-tools               0.98.5     tools for generating an 
> initramfs
> ii  linux-base                    2.6.32-29  Linux image base package
> ii  module-init-tools             3.12-1     tools for managing Linux 
> kernel mo
> 
> Versions of packages linux-image-2.6.32-5-xen-amd64 recommends:
> ii  firmware-linux-free           2.6.32-29  Binary firmware for various 
> driver
> 
> Versions of packages linux-image-2.6.32-5-xen-amd64 suggests:
> pn  grub                          <none>     (no description available)
> pn  linux-doc-2.6.32              <none>     (no description available)
> 
> Versions of packages linux-image-2.6.32-5-xen-amd64 is related to:
> ii  firmware-bnx2                 0.27       Binary firmware for 
> Broadcom NetXt
> pn  firmware-bnx2x                <none>     (no description available)
> pn  firmware-ipw2x00              <none>     (no description available)
> pn  firmware-ivtv                 <none>     (no description available)
> pn  firmware-iwlwifi              <none>     (no description available)
> pn  firmware-linux                <none>     (no description available)
> pn  firmware-linux-nonfree        <none>     (no description available)
> pn  firmware-qlogic               <none>     (no description available)
> pn  firmware-ralink               <none>     (no description available)
> ii  xen-hypervisor-4.0-amd64 [xen 4.0.1-1    The Xen Hypervisor on AMD64
> 
> -- debconf information:
>  
> linux-image-2.6.32-5-xen-amd64/postinst/depmod-error-initrd-2.6.32-5-xen-amd64: 
> false
>  
> linux-image-2.6.32-5-xen-amd64/postinst/ignoring-do-bootloader-2.6.32-5-xen-amd64:
>  
> linux-image-2.6.32-5-xen-amd64/prerm/removing-running-kernel-2.6.32-5-xen-amd64: 
> true
>  
> linux-image-2.6.32-5-xen-amd64/postinst/missing-firmware-2.6.32-5-xen-amd64:
> 
> 
> 

-- 
Ian Campbell
Current Noise: Sigh - The Summer Funeral

Age before beauty; and pearls before swine.
		-- Dorothy Parker
Reply to:
References:
- Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O
  - From: Rik Theys <Rik.Theys@esat.kuleuven.be>
Prev by Date: Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O
Next by Date: Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O
Previous by thread: Bug#606968: DMA: Out of SW-IOMMU space with Xen kernel during heavy I/O
Next by thread: Bug#591031: Acknowledgement (linux-image-2.6.35-rc6-686: suspend works for a while (once?) then stops working)
Index(es):
- Date
- Thread