Bug#729567: marked as done (linux 3.10: large TCP packets, formed by GRO, split for sending to a tunnel have the wrong checksum)

To: Ben Hutchings <ben@decadent.org.uk>
Subject: Bug#729567: marked as done (linux 3.10: large TCP packets, formed by GRO, split for sending to a tunnel have the wrong checksum)
From: owner@bugs.debian.org (Debian Bug Tracking System)
Date: Thu, 23 Jan 2014 14:57:05 +0000
Message-id: <[🔎] handler.729567.D729567.139048895532264.ackdone@bugs.debian.org>
References: <1390488948.1547.9.camel@deadeye.wl.decadent.org.uk> <20131114121233.11964.71062.reportbug@ivernia.CalvaEDI.COM>

Your message dated Thu, 23 Jan 2014 14:55:48 +0000
with message-id <1390488948.1547.9.camel@deadeye.wl.decadent.org.uk>
and subject line Re: Bug#729567: fixed in 3.10.27
has caused the Debian Bug report #729567,
regarding linux 3.10: large TCP packets, formed by GRO, split for sending to a tunnel have the wrong checksum
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
729567: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=729567
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems

--- Begin Message ---

To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: linux-image-3.10-0.bpo.3-amd64: Forwarding TCP from one LAN to another via an OpenVPN tunnel is extremely slow
From: John Hughes <john@calva.com>
Date: Thu, 14 Nov 2013 13:12:33 +0100
Message-id: <20131114121233.11964.71062.reportbug@ivernia.CalvaEDI.COM>

Package: src:linux
Version: 3.10.11-1~bpo70+1
Severity: important

Dear Maintainer,

   * What led up to the situation?

We have two offices connected by an OpenVPN tunnel

   * What exactly did you do (or not do) that was effective (or
     ineffective)?

We upgraded the kernel on our routers from 2.6 to 3.10 (wheezy backport)

   * What was the outcome of this action?

ssh and scp sessions from one office to the other are extremely slow if large
files are transmitted or large amounts of output are sent to the screen.

   * What outcome did you expect instead?

We'd expect that things stayed as fast as they used to be - we have a 100Mbit/s
fibre-optic connection.

More detail.

If I do a scp from the "router" (the machine with the OpenVPN tunnel) to a
machine in the remote office, via the OpenVPN tunnel everything works well, I
get around 10 megabytes a second transfer rate:

# scp linux-image-2.6.32-5-amd64_2.6.32-41_amd64.deb olympic:
root@olympic's password: 
linux-image-2.6.32-5-amd64_2.6.32-41_amd64.de 100%   27MB   9.1MB/s   00:03 

If I try the same SCP from a machine on the same LAN as the router then I get
an extremely low transfer rate, often seeing "stalled".

caronia:~# scp linux-image-2.6.32-5-amd64_2.6.32-41_amd64.deb olympic:
root@olympic's password: 
linux-image-2.6.32-5-amd64_2.6.32-41_amd64.de   7% 2208KB 322.1KB/s - stalled -

I've run tcpdump on the sending machine, the router (both the ethernet and
the OpenVPN tunnel) and the destination machine.  What seems to be happening
is that:

1. the sending machine sends a sequence of largish IP packets
2. these are received by the network stack on the router as one
   big IP packet
3. the router breaks the big packet up into packets that will fit into
   the OpenVPN tunnel
4. the receiving machine ignores these packets, and when the next packet
   is received sends a SACK to the sender, producing a retry.

For example, on the router I see:

11:59:23.020426 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 3073:9843, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 6770
11:59:23.041072 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 9843:11197, ack 2233, win 148, options [nop,nop,TS val 215919297 ecr 1199882508], length 1354

(The router gets a 6770 byte packet from the sender, then a 1354 byte packet).

This goes out on the OpenVPN tunnel as:

11:59:23.020449 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 3073:4427, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.020534 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 4427:5781, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.020536 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 5781:7135, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.020539 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 7135:8489, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.020543 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 8489:9843, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.041086 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 9843:11197, ack 2233, win 148, options [nop,nop,TS val 215919297 ecr 1199882508], length 1354

(The 6770 byte packet is broken up into 5 1354 byte packets to fit into the
tunnel)

This is immediately followed by the reception of a SACK from the receiving
machine, olympic:

11:59:23.045040 IP olympic.calvaedi.com.ssh > caronia.CalvaEDI.COM.33232: Flags [.], ack 3073, win 1933, options [nop,nop,TS val 1199882514 ecr 215919290,nop,nop,sack 1 {9843:11197}], length 0

Olympic says it's got segment 9843:11197 but it was expecting 3073.  It looks
as if it olympic didn't see the five packets that the router created by
splitting the big 6770 byte packet.

However, if I look at the trace on olympic I see:

11:59:23.025658 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 3073:4427, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.025907 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 4427:5781, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.025990 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 5781:7135, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.026183 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 7135:8489, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.026231 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 8489:9843, ack 2233, win 148, options [nop,nop,TS val 215919291 ecr 1199882508], length 1354
11:59:23.046163 IP caronia.CalvaEDI.COM.33232 > olympic.calvaedi.com.ssh: Flags [.], seq 9843:11197, ack 2233, win 148, options [nop,nop,TS val 215919297 ecr 1199882508], length 1354
11:59:23.046181 IP olympic.calvaedi.com.ssh > caronia.CalvaEDI.COM.33232: Flags [.], ack 3073, win 1933, options [nop,nop,TS val 1199882514 ecr 215919290,nop,nop,sack 1 {9843:11197}], length 0

I.E. the five "missing" packets *were* received by olympic, but for reasons
I don't understand were ignored.

Note that this bug has some features in common with bug #726676, but as far
as I can tell has nothing to do with ARP spoofing.

Help!

Full tcpdump traces available on request (they're about 40Mbyts each).

-- Package-specific info:
** Version:
Linux version 3.10-0.bpo.3-amd64 (debian-kernel@lists.debian.org) (gcc version 4.7.2 (Debian 4.7.2-5) ) #1 SMP Debian 3.10.11-1~bpo70+1 (2013-09-24)

** Command line:
BOOT_IMAGE=/vmlinuz-3.10-0.bpo.3-amd64 root=/dev/mapper/ivernia--vg-root ro quiet

** Tainted: I (2048)
 * Working around severe firmware bug.

** Kernel log:
[  368.805070]    prefetch64-sse: 12424.000 MB/sec
[  368.845066]    generic_sse: 10989.000 MB/sec
[  368.845068] xor: using function: prefetch64-sse (12424.000 MB/sec)
[  368.921076] raid6: sse2x1    7590 MB/s
[  368.989089] raid6: sse2x2    8776 MB/s
[  369.057115] raid6: sse2x4    9858 MB/s
[  369.057117] raid6: using algorithm sse2x4 (9858 MB/s)
[  369.057118] raid6: using ssse3x2 recovery algorithm
[  369.078696] bio: create slab <bio-2> at 2
[  369.082012] Btrfs loaded
[  369.091095] fuse init (API version 7.22)
[84727.764464] md: md127 stopped.
[84727.766162] md: bind<sdad>
[84727.766395] md: bind<sde>
[84727.788030] md: raid10 personality registered for level 10
[84727.790060] md/raid10:md127: active with 2 out of 2 devices
[84727.793299] created bitmap (1 pages) for device md127
[84727.793505] md127: bitmap initialized from disk: read 1 pages, set 0 of 1118 bits
[84727.810091] md127: detected capacity change from 0 to 299932581888
[84727.812364]  md127: p1 p2
[84728.185366] device vnet2 entered promiscuous mode
[84728.197521] redbus: port 3(vnet2) entered listening state
[84728.197541] redbus: port 3(vnet2) entered listening state
[84728.281401] device vnet3 entered promiscuous mode
[84728.293422] calvaedi: port 3(vnet3) entered listening state
[84728.293455] calvaedi: port 3(vnet3) entered listening state
[84743.246101] redbus: port 3(vnet2) entered learning state
[84743.310025] calvaedi: port 3(vnet3) entered learning state
[84758.286939] redbus: topology change detected, sending tcn bpdu
[84758.286958] redbus: port 3(vnet2) entered forwarding state
[84758.350882] calvaedi: topology change detected, sending tcn bpdu
[84758.350892] calvaedi: port 3(vnet3) entered forwarding state
[98306.295318] device redbus entered promiscuous mode
[98306.461177] device redbus left promiscuous mode
[98309.519426] device redbus entered promiscuous mode
[98343.514457] device redbus left promiscuous mode
[98358.878279] device redbus entered promiscuous mode
[98378.835046] device redbus left promiscuous mode
[98396.436410] device redbus entered promiscuous mode
[98404.251355] device redbus left promiscuous mode
[98419.321752] Netfilter messages via NETLINK v0.30.
[98516.139143] device redbus entered promiscuous mode
[98524.660761] device redbus left promiscuous mode
[98850.470133] device redbus entered promiscuous mode
[98859.216718] device redbus left promiscuous mode
[98883.503951] device lo entered promiscuous mode
[98891.009237] device lo left promiscuous mode
[98916.433855] device tun1 entered promiscuous mode
[98924.553613] device tun1 left promiscuous mode
[99055.625740] device redbus entered promiscuous mode
[99062.787366] device redbus left promiscuous mode
[99222.131176] device tun1 entered promiscuous mode
[99233.261342] device tun1 left promiscuous mode
[99536.845081] device tun1 entered promiscuous mode
[99546.305250] device tun1 left promiscuous mode
[99644.827152] device tun1 entered promiscuous mode
[99658.754679] device tun1 left promiscuous mode
[99695.405963] device redbus entered promiscuous mode
[99713.227256] device redbus left promiscuous mode
[188078.730730] device tun1 entered promiscuous mode
[188137.087911] device tun1 left promiscuous mode
[188339.737522] device tun1 entered promiscuous mode
[188370.882892] device tun1 left promiscuous mode
[599542.559349] device tun1 entered promiscuous mode
[599565.994748] device tun1 left promiscuous mode
[653577.098378] UDP: bad checksum. From 80.80.129.3:62557 to 89.202.138.114:53 ulen 49
[686113.262476] device tun1 entered promiscuous mode
[686129.983422] device redbus entered promiscuous mode
[686160.129894] device redbus left promiscuous mode
[686162.034074] device tun1 left promiscuous mode
[688811.031715] device redbus entered promiscuous mode
[688822.772373] device tun1 entered promiscuous mode
[689029.227818] device tun1 left promiscuous mode
[689030.940560] device redbus left promiscuous mode
[697768.243946] device redbus entered promiscuous mode
[697798.859849] device redbus left promiscuous mode
[698231.114187] device calvaedi entered promiscuous mode
[698241.193059] device calvaedi left promiscuous mode
[698449.535160] device calvaedi entered promiscuous mode
[698733.134736] device calvaedi left promiscuous mode
[698772.204834] device redbus entered promiscuous mode
[698787.807505] device redbus left promiscuous mode
[699108.551922] device redbus entered promiscuous mode
[699141.243873] device redbus left promiscuous mode
[699295.258537] device calvaedi entered promiscuous mode
[699296.189726] device calvaedi left promiscuous mode
[699298.546699] device calvaedi entered promiscuous mode
[699309.237835] device calvaedi left promiscuous mode
[699385.915673] device calvaedi entered promiscuous mode
[699401.070887] device calvaedi left promiscuous mode
[771352.817554] device redbus entered promiscuous mode
[771382.411252] device tun1 entered promiscuous mode
[771449.193326] device tun1 left promiscuous mode
[771451.857378] device redbus left promiscuous mode
[773302.792280] device redbus entered promiscuous mode
[773302.828737] device redbus left promiscuous mode
[773331.197872] device redbus entered promiscuous mode
[773346.842776] device tun1 entered promiscuous mode
[773750.897863] device redbus left promiscuous mode
[773757.089641] device tun1 left promiscuous mode

** Model information
sys_vendor: Dell Inc.
product_name: PowerEdge R710
product_version: 
chassis_vendor: Dell Inc.
chassis_version: 
bios_vendor: Dell Inc.
bios_version: 1.2.6
board_vendor: Dell Inc.
board_name: 0N047H
board_version: A02

** Loaded modules:
nfnetlink_log
nfnetlink
raid10
md_mod
fuse
btrfs
raid6_pq
zlib_deflate
xor
ufs
qnx4
hfsplus
hfs
minix
ntfs
vfat
msdos
fat
jfs
xfs
reiserfs
ext4
crc16
jbd2
ext2
efivars
vhost_net
macvtap
macvlan
tun
ip6table_filter
ip6_tables
ebtable_nat
ebtables
ip_vs
nf_conntrack
libcrc32c
8021q
garp
mrp
xt_tcpudp
iptable_mangle
iptable_filter
ip_tables
x_tables
bridge
stp
llc
loop
mperf
coretemp
kvm_intel
kvm
dcdbas
snd_pcm
snd_page_alloc
snd_timer
snd
soundcore
pcspkr
iTCO_wdt
iTCO_vendor_support
psmouse
serio_raw
i7core_edac
edac_core
lpc_ich
mfd_core
shpchp
crc32c_intel
joydev
processor
evdev
thermal_sys
acpi_power_meter
button
ext3
mbcache
jbd
dm_mod
sr_mod
cdrom
ata_generic
hid_generic
usbhid
hid
sg
ses
sd_mod
crc_t10dif
enclosure
microcode
ata_piix
uhci_hcd
ehci_pci
libata
ehci_hcd
mptsas
scsi_transport_sas
mptscsih
mptbase
usbcore
usb_common
megaraid_sas
scsi_mod
bnx2

** Network interface configuration:

auto lo
iface lo inet loopback

auto redbus
iface redbus inet static
	address 192.168.130.253
	netmask 255.255.255.0
	network 192.168.130.0
	broadcast 192.168.130.255
	bridge_ports predbus
	bridge_stp on
	bridge_maxwait 0

auto calvaedi
iface calvaedi inet static
	address 193.188.249.253
	netmask 255.255.255.0
	broadcast 193.188.249.255
	bridge_ports pcalvaedi
	bridge_stp on
	bridge_maxwait 0

auto external
iface external inet manual
	bridge_ports pexternal
	bridge_stp on
	bridge_maxwait 0

** Network status:
*** IP interfaces and addresses:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: predbus: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master redbus state UP qlen 1000
    link/ether 00:22:19:34:a0:fa brd ff:ff:ff:ff:ff:ff
3: pcalvaedi: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master calvaedi state UP qlen 1000
    link/ether 00:22:19:34:a0:fc brd ff:ff:ff:ff:ff:ff
4: pexternal: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master external state UP qlen 1000
    link/ether 00:22:19:34:a0:fe brd ff:ff:ff:ff:ff:ff
5: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
    link/ether 00:22:19:34:a1:00 brd ff:ff:ff:ff:ff:ff
6: redbus: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether 00:22:19:34:a0:fa brd ff:ff:ff:ff:ff:ff
    inet 192.168.130.253/24 brd 192.168.130.255 scope global redbus
       valid_lft forever preferred_lft forever
    inet6 fe80::222:19ff:fe34:a0fa/64 scope link 
       valid_lft forever preferred_lft forever
7: calvaedi: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether 00:22:19:34:a0:fc brd ff:ff:ff:ff:ff:ff
    inet 193.188.249.253/24 brd 193.188.249.255 scope global calvaedi
       valid_lft forever preferred_lft forever
    inet6 fe80::222:19ff:fe34:a0fc/64 scope link 
       valid_lft forever preferred_lft forever
8: external: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether 00:22:19:34:a0:fe brd ff:ff:ff:ff:ff:ff
    inet6 fe80::222:19ff:fe34:a0fe/64 scope link 
       valid_lft forever preferred_lft forever
9: bgp_interoute@external: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether 00:22:19:34:a0:fe brd ff:ff:ff:ff:ff:ff
    inet 89.202.138.114/30 brd 89.202.138.115 scope global bgp_interoute
       valid_lft forever preferred_lft forever
    inet6 fe80::222:19ff:fe34:a0fe/64 scope link 
       valid_lft forever preferred_lft forever
10: telecity_auber@external: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether 00:22:19:34:a0:fe brd ff:ff:ff:ff:ff:ff
    inet 217.117.144.58/30 scope global telecity_auber
       valid_lft forever preferred_lft forever
    inet6 fe80::222:19ff:fe34:a0fe/64 scope link 
       valid_lft forever preferred_lft forever
11: tun0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1422 qdisc pfifo_fast state UNKNOWN qlen 100
    link/none 
    inet 10.9.0.1 peer 10.9.0.2/32 scope global tun0
       valid_lft forever preferred_lft forever
12: tun1: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1422 qdisc pfifo_fast state UNKNOWN qlen 100
    link/none 
    inet 10.5.0.1 peer 10.5.0.2/32 scope global tun1
       valid_lft forever preferred_lft forever
13: tun2: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1422 qdisc pfifo_fast state UNKNOWN qlen 100
    link/none 
    inet 10.7.0.1 peer 10.7.0.2/32 scope global tun2
       valid_lft forever preferred_lft forever
14: tun3: <POINTOPOINT,MULTICAST,NOARP> mtu 1500 qdisc noop state DOWN qlen 100
    link/none 
15: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master redbus state UNKNOWN qlen 500
    link/ether fe:16:3e:01:02:01 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fc16:3eff:fe01:201/64 scope link 
       valid_lft forever preferred_lft forever
16: vnet1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master calvaedi state UNKNOWN qlen 500
    link/ether fe:16:3e:01:02:02 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fc16:3eff:fe01:202/64 scope link 
       valid_lft forever preferred_lft forever
17: vnet2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master redbus state UNKNOWN qlen 500
    link/ether fe:16:3e:02:01:01 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fc16:3eff:fe02:101/64 scope link 
       valid_lft forever preferred_lft forever
18: vnet3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master calvaedi state UNKNOWN qlen 500
    link/ether fe:16:3e:02:01:02 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fc16:3eff:fe02:102/64 scope link 
       valid_lft forever preferred_lft forever

*** Device statistics:
Inter-|   Receive                                                |  Transmit
 face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
  tun0: 16538250  270095    0    0    0     0          0         0 86267236  307696    0    0    0     0       0          0
  tun1: 641834210 4361958    0    0    0     0          0         0 6860956017 6582818    0  545    0     0       0          0
  tun2: 26589842  264546    0    0    0     0          0         0 16742011  263144    0    0    0     0       0          0
  tun3:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0
pexternal: 7209606991 26808548    0 25861    0     0          0   1231251 10963669124 28134316    0    0    0     0       0          0
 vnet1: 41676052  118658    0    0    0     0          0         0 186682985 2780226    0    0    0     0       0          0
pcalvaedi: 3374825124 21737557    0 25860    0     0          0   1194334 4686787521 19355976    0    0    0     0       0          0
calvaedi: 2866128941 20566572    0    0    0     0          0         0 4537456904 19147692    0    0    0     0       0          0
 vnet3: 9882898   37852    0    0    0     0          0         0 133436867 2429344    0    0    0     0       0          0
  eth3:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0
redbus: 5965692079 7276856    0    0    0     0          0         0 5416694559 5487964    0    0    0     0       0          0
    lo: 47011463  116231    0    0    0     0          0         0 47011463  116231    0    0    0     0       0          0
 vnet0: 1468722   17823    0    0    0     0          0         0 66210047 1210960    0    0    0     0       0          0
telecity_auber: 141293880  524742    0    0    0     0          0      5997 7453930421 7214315    0    0    0     0       0          0
predbus: 6211665431 8850256    0    1    0     0          0   1164405 5662871460 8598950    0    0    0     0       0          0
external: 6596056273 26297513    0    0    0     0          0         0 10723861749 28134322    0    0    0     0       0          0
 vnet2: 8283524   14873    0    0    0     0          0         0 62420844 1092183    0    0    0     0       0          0
bgp_interoute: 6421085348 24950373    0    0    0     0          0     18919 3269905744 20919403    0    0    0     0       0          0

*** Protocol statistics:
Ip:
    57911019 total packets received
    11899 with invalid headers
    44183356 forwarded
    0 incoming packets discarded
    12935279 incoming packets delivered
    57187715 requests sent out
    76286 outgoing packets dropped
    16799 dropped because of missing route
    184 reassemblies required
    49 packets reassembled ok
    636 fragments received ok
    76281 fragments failed
    1272 fragments created
Icmp:
    96129 ICMP messages received
    137 input ICMP message failed.
    ICMP input histogram:
        destination unreachable: 90991
        timeout in transit: 140
        echo requests: 4889
        echo replies: 107
        timestamp request: 2
    245212 ICMP messages sent
    0 ICMP messages failed
    ICMP output histogram:
        destination unreachable: 152420
        time exceeded: 11502
        redirect: 5
        echo request: 76401
        echo replies: 4852
        timestamp replies: 2
IcmpMsg:
        InType0: 107
        InType3: 90991
        InType8: 4889
        InType11: 140
        InType13: 2
        OutType0: 4852
        OutType3: 152420
        OutType5: 5
        OutType8: 76401
        OutType11: 11502
        OutType14: 2
        OutType69: 30
Tcp:
    2989 active connections openings
    85986 passive connection openings
    180 failed connection attempts
    22 connection resets received
    10 connections established
    4549294 segments received
    7594072 segments send out
    20105 segments retransmited
    26 bad segments received.
    6580 resets sent
    InCsumErrors: 24
Udp:
    6687768 packets received
    4621 packets to unknown port received.
    4 packet receive errors
    8967410 packets sent
    InCsumErrors: 4
UdpLite:
TcpExt:
    8 invalid SYN cookies received
    174 resets received for embryonic SYN_RECV sockets
    81492 TCP sockets finished time wait in fast timer
    38301 delayed acks sent
    10 delayed acks further delayed because of locked socket
    Quick ack mode was activated 295 times
    42 SYNs to LISTEN sockets dropped
    38445 packets directly queued to recvmsg prequeue.
    8 bytes directly in process context from backlog
    555395 bytes directly received in process context from prequeue
    1599634 packet headers predicted
    30611 packets header predicted and directly queued to user
    224582 acknowledgments not containing data payload received
    1527964 predicted acknowledgments
    4196 times recovered from packet loss by selective acknowledgements
    Detected reordering 1 times using SACK
    Detected reordering 14 times using time stamp
    19 congestion windows fully recovered without slow start
    168 congestion windows partially recovered using Hoe heuristic
    2 congestion windows recovered without slow start by DSACK
    387 congestion windows recovered without slow start after partial ack
    TCPLostRetransmit: 10
    23 timeouts after SACK recovery
    1742 timeouts in loss state
    9518 fast retransmits
    72 forward retransmits
    4614 retransmits in slow start
    332 other TCP timeouts
    TCPLossProbes: 1004
    TCPLossProbeRecovery: 377
    754 SACK retransmits failed
    299 DSACKs sent for old packets
    139 DSACKs received
    1 DSACKs for out of order packets received
    16 connections reset due to unexpected data
    9 connections reset due to early user close
    3 connections aborted due to timeout
    TCPDSACKIgnoredNoUndo: 51
    TCPSpuriousRTOs: 364
    TCPSackShifted: 24029
    TCPSackMerged: 11385
    TCPSackShiftFallback: 8556
    TCPRcvCoalesce: 20988
    TCPOFOQueue: 473
    TCPChallengeACK: 4
    TCPSYNChallenge: 1
IpExt:
    InNoRoutes: 24
    InMcastPkts: 1597111
    OutMcastPkts: 12002
    InBcastPkts: 48210
    OutBcastPkts: 11822
    InOctets: -1081337400
    OutOctets: 1432718758
    InMcastOctets: 63356660
    OutMcastOctets: 384120
    InBcastOctets: 3718735
    OutBcastOctets: 898472


** PCI devices:
00:00.0 Host bridge [0600]: Intel Corporation 5520 I/O Hub to ESI Port [8086:3406] (rev 13)
	Subsystem: Dell Device [1028:0235]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 15
	Capabilities: <access denied>

00:01.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 [8086:3408] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	Memory behind bridge: d6000000-d9ffffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:03.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 [8086:340a] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	Memory behind bridge: da000000-ddffffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:04.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 4 [8086:340b] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: 0000f000-0000ffff
	Memory behind bridge: df100000-df1fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:05.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 5 [8086:340c] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:06.0 PCI bridge [0604]: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 6 [8086:340d] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [8086:340e] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=06, subordinate=07, sec-latency=0
	I/O behind bridge: 0000e000-0000efff
	Memory behind bridge: df200000-df3fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:09.0 PCI bridge [0604]: Intel Corporation 7500/5520/5500/X58 I/O Hub PCI Express Root Port 9 [8086:3410] (rev 13) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=08, subordinate=09, sec-latency=0
	I/O behind bridge: 0000d000-0000dfff
	Memory behind bridge: df400000-df5fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>
	Kernel driver in use: pcieport

00:14.0 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub System Management Registers [8086:342e] (rev 13) (prog-if 00 [8259])
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: <access denied>
	Kernel driver in use: i7core_edac

00:14.1 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers [8086:3422] (rev 13) (prog-if 00 [8259])
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: <access denied>

00:14.2 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers [8086:3423] (rev 13) (prog-if 00 [8259])
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: <access denied>

00:1a.0 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #4 [8086:2937] (rev 02) (prog-if 00 [UHCI])
	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 17
	Region 4: I/O ports at cc40 [size=32]
	Capabilities: <access denied>
	Kernel driver in use: uhci_hcd

00:1a.1 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #5 [8086:2938] (rev 02) (prog-if 00 [UHCI])
	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin B routed to IRQ 18
	Region 4: I/O ports at cc60 [size=32]
	Capabilities: <access denied>
	Kernel driver in use: uhci_hcd

00:1a.7 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #2 [8086:293c] (rev 02) (prog-if 20 [EHCI])
	Subsystem: Dell PowerEdge R710 USB EHCI Controller [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin C routed to IRQ 19
	Region 0: Memory at df0ff800 (32-bit, non-prefetchable) [size=1K]
	Capabilities: <access denied>
	Kernel driver in use: ehci-pci

00:1d.0 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #1 [8086:2934] (rev 02) (prog-if 00 [UHCI])
	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 21
	Region 4: I/O ports at cc80 [size=32]
	Capabilities: <access denied>
	Kernel driver in use: uhci_hcd

00:1d.1 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #2 [8086:2935] (rev 02) (prog-if 00 [UHCI])
	Subsystem: Dell PowerEdge R710 USB UHCI Controller [1028:0235]
	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin B routed to IRQ 20
	Region 4: I/O ports at cca0 [size=32]
	Capabilities: <access denied>
	Kernel driver in use: uhci_hcd

00:1d.7 USB controller [0c03]: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #1 [8086:293a] (rev 02) (prog-if 20 [EHCI])
	Subsystem: Dell PowerEdge R710 USB EHCI Controller [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 21
	Region 0: Memory at df0ffc00 (32-bit, non-prefetchable) [size=1K]
	Capabilities: <access denied>
	Kernel driver in use: ehci-pci

00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev 92) (prog-if 01 [Subtractive decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Bus: primary=00, secondary=0a, subordinate=0a, sec-latency=32
	Memory behind bridge: de000000-deffffff
	Prefetchable memory behind bridge: 00000000d5800000-00000000d5ffffff
	Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>

00:1f.0 ISA bridge [0601]: Intel Corporation 82801IB (ICH9) LPC Interface Controller [8086:2918] (rev 02)
	Subsystem: Dell Device [1028:0235]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Capabilities: <access denied>
	Kernel driver in use: lpc_ich

00:1f.2 IDE interface [0101]: Intel Corporation 82801IB (ICH9) 2 port SATA Controller [IDE mode] [8086:2921] (rev 02) (prog-if 8f [Master SecP SecO PriP PriO])
	Subsystem: Dell PowerEdge R710 SATA IDE Controller [1028:0235]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin C routed to IRQ 23
	Region 0: I/O ports at cc10 [size=8]
	Region 1: I/O ports at cc08 [size=4]
	Region 2: I/O ports at cc18 [size=8]
	Region 3: I/O ports at cc0c [size=4]
	Region 4: I/O ports at cc20 [size=16]
	Region 5: I/O ports at cc30 [size=16]
	Capabilities: <access denied>
	Kernel driver in use: ata_piix

01:00.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 36
	Region 0: Memory at d6000000 (64-bit, non-prefetchable) [size=32M]
	Capabilities: <access denied>
	Kernel driver in use: bnx2

01:00.1 Ethernet controller [0200]: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 48
	Region 0: Memory at d8000000 (64-bit, non-prefetchable) [size=32M]
	Capabilities: <access denied>
	Kernel driver in use: bnx2

02:00.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 32
	Region 0: Memory at da000000 (64-bit, non-prefetchable) [size=32M]
	Capabilities: <access denied>
	Kernel driver in use: bnx2

02:00.1 Ethernet controller [0200]: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet [14e4:1639] (rev 20)
	Subsystem: Dell PowerEdge R710 BCM5709 Gigabit Ethernet [1028:0235]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 42
	Region 0: Memory at dc000000 (64-bit, non-prefetchable) [size=32M]
	Capabilities: <access denied>
	Kernel driver in use: bnx2

03:00.0 RAID bus controller [0104]: LSI Logic / Symbios Logic MegaRAID SAS 1078 [1000:0060] (rev 04)
	Subsystem: Dell PERC 6/i Integrated RAID Controller [1028:1f0c]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 33
	Region 0: Memory at df180000 (64-bit, non-prefetchable) [size=256K]
	Region 2: I/O ports at fc00 [size=256]
	Region 3: Memory at df1c0000 (64-bit, non-prefetchable) [size=256K]
	Expansion ROM at df100000 [disabled] [size=32K]
	Capabilities: <access denied>
	Kernel driver in use: megaraid_sas

06:00.0 PCI bridge [0604]: Intel Corporation 6702PXH PCI Express-to-PCI Bridge A [8086:032c] (rev 09) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=06, secondary=07, subordinate=07, sec-latency=64
	I/O behind bridge: 0000e000-0000efff
	Memory behind bridge: df200000-df3fffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>

07:08.0 SCSI storage controller [0100]: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS [1000:0054] (rev 01)
	Subsystem: Dell SAS 5/E Adapter Controller [1028:1f04]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 72 (16000ns min, 2500ns max), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 38
	Region 0: I/O ports at ec00 [disabled] [size=256]
	Region 1: Memory at df3ec000 (64-bit, non-prefetchable) [size=16K]
	Region 3: Memory at df3f0000 (64-bit, non-prefetchable) [size=64K]
	Expansion ROM at df200000 [disabled] [size=1M]
	Capabilities: <access denied>
	Kernel driver in use: mptsas

08:00.0 PCI bridge [0604]: Intel Corporation 6702PXH PCI Express-to-PCI Bridge A [8086:032c] (rev 09) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=08, secondary=09, subordinate=09, sec-latency=64
	I/O behind bridge: 0000d000-0000dfff
	Memory behind bridge: df400000-df5fffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: <access denied>

09:08.0 SCSI storage controller [0100]: LSI Logic / Symbios Logic SAS1068 PCI-X Fusion-MPT SAS [1000:0054] (rev 01)
	Subsystem: Dell SAS 5/E Adapter Controller [1028:1f04]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 72 (16000ns min, 2500ns max), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 40
	Region 0: I/O ports at dc00 [disabled] [size=256]
	Region 1: Memory at df5ec000 (64-bit, non-prefetchable) [size=16K]
	Region 3: Memory at df5f0000 (64-bit, non-prefetchable) [size=64K]
	Expansion ROM at df400000 [disabled] [size=1M]
	Capabilities: <access denied>
	Kernel driver in use: mptsas

0a:03.0 VGA compatible controller [0300]: Matrox Electronics Systems Ltd. MGA G200eW WPCM450 [102b:0532] (rev 0a) (prog-if 00 [VGA controller])
	Subsystem: Dell PowerEdge R710 MGA G200eW WPCM450 [1028:0235]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32 (4000ns min, 8000ns max), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 10
	Region 0: Memory at d5800000 (32-bit, prefetchable) [size=8M]
	Region 1: Memory at de7fc000 (32-bit, non-prefetchable) [size=16K]
	Region 2: Memory at de800000 (32-bit, non-prefetchable) [size=8M]
	[virtual] Expansion ROM at de000000 [disabled] [size=64K]
	Capabilities: <access denied>

fe:00.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers [8086:2c40] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:00.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder [8086:2c01] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:02.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 0 [8086:2c10] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:02.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Physical 0 [8086:2c11] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:02.4 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 1 [8086:2c14] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:02.5 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Physical 1 [8086:2c15] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:03.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller [8086:2c18] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:03.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Target Address Decoder [8086:2c19] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:03.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller RAS Registers [8086:2c1a] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:03.4 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Test Registers [8086:2c1c] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:04.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Control Registers [8086:2c20] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:04.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Address Registers [8086:2c21] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:04.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Rank Registers [8086:2c22] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:04.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Thermal Control Registers [8086:2c23] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:05.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Control Registers [8086:2c28] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:05.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Address Registers [8086:2c29] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:05.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Rank Registers [8086:2c2a] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:05.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Thermal Control Registers [8086:2c2b] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:06.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Control Registers [8086:2c30] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:06.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Address Registers [8086:2c31] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:06.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Rank Registers [8086:2c32] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

fe:06.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Thermal Control Registers [8086:2c33] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:00.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers [8086:2c40] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:00.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder [8086:2c01] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:02.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 0 [8086:2c10] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:02.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Physical 0 [8086:2c11] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:02.4 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 1 [8086:2c14] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:02.5 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Physical 1 [8086:2c15] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:03.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller [8086:2c18] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:03.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Target Address Decoder [8086:2c19] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:03.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller RAS Registers [8086:2c1a] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:03.4 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Test Registers [8086:2c1c] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:04.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Control Registers [8086:2c20] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:04.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Address Registers [8086:2c21] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:04.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Rank Registers [8086:2c22] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:04.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Thermal Control Registers [8086:2c23] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:05.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Control Registers [8086:2c28] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:05.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Address Registers [8086:2c29] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:05.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Rank Registers [8086:2c2a] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:05.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Thermal Control Registers [8086:2c2b] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:06.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Control Registers [8086:2c30] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:06.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Address Registers [8086:2c31] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:06.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Rank Registers [8086:2c32] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

ff:06.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Thermal Control Registers [8086:2c33] (rev 05)
	Subsystem: Intel Corporation Device [8086:8086]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0


** USB devices:
Bus 003 Device 002: ID 0624:0248 Avocent Corp. 
Bus 005 Device 002: ID 0424:2514 Standard Microsystems Corp. USB 2.0 Hub
Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 006 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub


-- System Information:
Debian Release: 7.2
  APT prefers stable-updates
  APT policy: (500, 'stable-updates'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 3.10-0.bpo.3-amd64 (SMP w/16 CPU cores)
Locale: LANG=C, LC_CTYPE=C (charmap=ANSI_X3.4-1968)
Shell: /bin/sh linked to /bin/dash

Versions of packages linux-image-3.10-0.bpo.3-amd64 depends on:
ii  debconf [debconf-2.0]                   1.5.49
ii  initramfs-tools [linux-initramfs-tool]  0.113~bpo70+1
ii  kmod                                    9-3
ii  linux-base                              3.5
ii  module-init-tools                       9-3

Versions of packages linux-image-3.10-0.bpo.3-amd64 recommends:
ii  firmware-linux-free  3.2

Versions of packages linux-image-3.10-0.bpo.3-amd64 suggests:
pn  debian-kernel-handbook  <none>
ii  grub-pc                 1.99-27+deb7u2
pn  linux-doc-3.10          <none>

Versions of packages linux-image-3.10-0.bpo.3-amd64 is related to:
pn  firmware-atheros        <none>
ii  firmware-bnx2           0.40~bpo70+1
pn  firmware-bnx2x          <none>
pn  firmware-brcm80211      <none>
pn  firmware-intelwimax     <none>
pn  firmware-ipw2x00        <none>
pn  firmware-ivtv           <none>
pn  firmware-iwlwifi        <none>
pn  firmware-libertas       <none>
ii  firmware-linux          0.36+wheezy.1
ii  firmware-linux-nonfree  0.36+wheezy.1
pn  firmware-myricom        <none>
pn  firmware-netxen         <none>
pn  firmware-qlogic         <none>
pn  firmware-ralink         <none>
pn  firmware-realtek        <none>
pn  xen-hypervisor          <none>

-- debconf information:
  linux-image-3.10-0.bpo.3-amd64/postinst/missing-firmware-3.10-0.bpo.3-amd64:
  linux-image-3.10-0.bpo.3-amd64/postinst/ignoring-ramdisk:
  linux-image-3.10-0.bpo.3-amd64/prerm/removing-running-kernel-3.10-0.bpo.3-amd64: true
  linux-image-3.10-0.bpo.3-amd64/postinst/depmod-error-initrd-3.10-0.bpo.3-amd64: false

--- End Message ---

--- Begin Message ---

To: 729567-done@bugs.debian.org

Subject: Re: Bug#729567: fixed in 3.10.27

From: Ben Hutchings <ben@decadent.org.uk>

Date: Thu, 23 Jan 2014 14:55:48 +0000

Message-id: <1390488948.1547.9.camel@deadeye.wl.decadent.org.uk>

In-reply-to: <[🔎] 20140123142727.GA21308@msgid.wurtel.net>

References: <[🔎] 20140123142727.GA21308@msgid.wurtel.net>
Version: 3.11~rc4-1~exp1

On Thu, 2014-01-23 at 15:27 +0100, Paul Slootman wrote:
> I can confirm that with the 3.10.27 linux kernel version there is a
> solution (not a real fix as far as I can see) for this problem so that
> gro can be left on and connections that get forwarded through an OpenVPN
> link keep on working at the normal speed.
> 
> Relevant parts of the changelog included below:
> 
> commit 1e42fa04afb0dae65292683a5dcad85572ab7553
> Author: Simon Horman <horms@verge.net.au>
> 
>     net: Loosen constraints for recalculating checksum in skb_segment()
> 
>     [ Upstream commit 1cdbcb7957cf9e5f841dbcde9b38fd18a804208b ]
[...]

This originally went into 3.11-rc1, so I'm marking this closed by the
first Debian package of 3.11-rcN.

Ben.

-- 
Ben Hutchings
compatible: Gracefully accepts erroneous data from any source
Attachment: signature.asc
Description: This is a digitally signed message part

--- End Message ---

Reply to:

Prev by Date: Bug#726676: marked as done (linux 3.10: large TCP packets, formed by GRO, split for sending to a tunnel have the wrong checksum)
Next by Date: Upcoming stable point release (7.4)
Previous by thread: Bug#726676: marked as done (linux 3.10: large TCP packets, formed by GRO, split for sending to a tunnel have the wrong checksum)
Next by thread: Upcoming stable point release (7.4)
Index(es):
- Date
- Thread