[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#603632: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))



Thanks for the report Vincent.

I've added xen-devel to the CC as well as Cris Daniluk who previously
reported a very similar issue[0] also on an R410 -- Cris did you ever
get a resolution to your issue?

Vincent's full report is at:
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=603632
I've also attached the boot log here of which the interesting part looks
to be:
        
        [    8.422639] xen: acpi sci 9
        [    8.434217] Console: colour VGA+ 80x25
        [    8.441350] console [hvc0] enabled, bootconsole disabled
        [    8.441350] console [hvc0] enabled, bootconsole disabled
        [    8.462694] Xen: using vcpuop timer interface
        [    8.471508] installing Xen timer for CPU 0
        [    8.479841] BUG: unable to handle kernel paging request at 0000000000005a08
        [    8.493868] IP: [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    8.507041] PGD 0 
        [    8.511199] Thread overran stack, or stack corrupted
        [    8.521253] Oops: 0000 [#1] SMP 
        [    8.527838] last sysfs file: 
        [    8.533941] CPU 0 
        [    8.538100] Modules linked in:
        [    8.544342] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge R410
        [    8.559594] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    8.577620] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
        [    8.588366] RAX: 0000000000000000 RBX: 0000000000005220 RCX: 0000000000005a00
        [    8.602752] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000005220
        [    8.617139] RBP: 0000000000004020 R08: 0000000000000002 R09: ffff88003fc1c010
        [    8.631525] R10: ffffffff813c2700 R11: 00000000000186a0 R12: 0000000000005220
        [    8.645910] R13: 0000000000000002 R14: 0000000000000000 R15: ffff88000000da28
        [    8.660300] FS:  0000000000000000(0000) GS:ffff88000349b000(0000) knlGS:0000000000000000
        [    8.676591] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
        [    8.688203] CR2: 0000000000005a08 CR3: 0000000001001000 CR4: 0000000000002660
        [    8.702589] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
        [    8.716975] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
        [    8.731361] Process swapper (pid: 0, threadinfo ffffffff81442000, task ffffffff814771f0)
        [    8.747654] Stack:
        [    8.751813]  ffff88000000da00 00000010813c2765 00000000000212d0 00000000000186a0
        [    8.766199] <0> ffff88000000ac10 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
        [    8.781625] <0> 00000000000186a0 0000000000000000 0000000000005a00 0000000000000000
        [    8.797572] Call Trace:
        [    8.802603]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
        [    8.815600]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
        [    8.826695]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
        [    8.837267]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
        [    8.848707]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.861704]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
        [    8.873317]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.886316]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.899317]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
        [    8.911103]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
        [    8.923062]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
        [    8.936063]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
        [    8.948368]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
        [    8.961368]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
        [    8.972982]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
        [    8.984247]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
        [    8.996206]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
        [    9.007646]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
        [    9.019777] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf 
        [    9.057561] RIP  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    9.070909]  RSP <ffffffff81443c88>
        [    9.078015] CR2: 0000000000005a08
        [    9.084780] ---[ end trace a7919e7f17c0a725 ]---
        [    9.094136] Kernel panic - not syncing: Attempted to kill the idle task!

It's worth noting that the Debian kernels are based on
e73f4955a821f850f5b88c32d12a81714523a95f (less the GPU fixes merged by
bcf16b6b4f34fb40a7aaf637947c7d3bce0be671, which the Debian kernel
maintainer chose to exclude).

The baseline is slightly old but Debian is now pretty deeply frozen so a
wholesale rebase is not possible, if either of you have run a more
recent kernel the result would be interesting to know.

The actual crashing RIP corresponds to mm/page_alloc.c:1975 which is in
__alloc_pages_nodemask:

        /*
         * Check the zones suitable for the gfp_mask contain at least one
         * valid zone. It's possible to have an empty zonelist as a result
         * of GFP_THISNODE and a memoryless node
         */
        if (unlikely(!zonelist->_zonerefs->zone))
                return NULL;

zonelist->_zonerefs is an array but looking at the disassembly and the
register dump zonelist itself appears to be 0x5a00 which seems unlikely
to be valid.

The zonelist ultimately comes from node which is always passed as 0 in
the outer most caller in this stack trace (find_unbound_irq calling
irq_to_desc_alloc_node).

I'm not sure but looking at the complete bootlog it looks as if the
system may only have node==1 i.e. no 0 node which could plausibly lead
to this sort of issue:
        [    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
        [    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
        [    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
        [    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
        [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
        [    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
        [    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
        [    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
        [    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
        [    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
        [    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
        [    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
        [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
        [    0.000000] Zone PFN ranges:
        [    0.000000]   DMA      0x00000000 -> 0x00001000
        [    0.000000]   DMA32    0x00001000 -> 0x00100000
        [    0.000000]   Normal   0x00100000 -> 0x00100000
        [    0.000000] Movable zone start PFN for each node
        [    0.000000] early_node_map[2] active PFN ranges
        [    0.000000]     1: 0x00000000 -> 0x000000a0
        [    0.000000]     1: 0x00000100 -> 0x00040000
        [    0.000000] On node 1 totalpages: 262048
        [    0.000000]   DMA zone: 56 pages used for memmap
        [    0.000000]   DMA zone: 483 pages reserved
        [    0.000000]   DMA zone: 3461 pages, LIFO batch:0
        [    0.000000]   DMA32 zone: 3528 pages used for memmap
        [    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31

Perhaps we should be passing numa_node_id() (e.g. current node) instead
of node 0? There doesn't seem to be another obvious alternative to
passing in an explicit node number to this callchain (some places cope
with -1 but not this path AFAICT).

It's also not obvious if dom0 should be seeing the tables which describe
the hosts nodes anyway or if we should be clobbering something. Given
that dom0 sees a pseudo-physical address map I'm not convinced seeing
the real SRAT is in any way beneficial. Perhaps we should simply be
clobbering NUMAness until actual PV understanding of NUMA is ready?

One thing I notice when googling R410 issues is that they apparently
have a "Cores per CPU" BIOS option which might be worth playing with,
since configuring a reduced number of cores might remove node 0 but not
node 1 (odd but not invalid?). Presumably it is also worth making sure
you have the latest BIOS etc.

It's very much an outside possibility but it is also worth trying the
packages at http://xenbits.xen.org/people/ianc/ which reinstates the
changesets from bcf16b6b4f34fb40a7aaf637947c7d3bce0be671

Ian.

[0]
http://lists.xensource.com/archives/html/xen-devel/2010-06/msg01140.html

On Tue, 2010-11-16 at 00:32 +0100, Vincent CARON wrote:
> Package: linux-image-2.6.32-5-xen-amd64
> Version: 2.6.32-27
> Severity: important
> 
> I just tried d-i 6beta1 and booted Squeeeze and its 2.6.32 kernel for
> the first time on my usual server hardware (Dell R410).
> 
> I opted for the xen-amd64 kernel, and it boots fine on bare metal. But
> as soon as I tried to boot it as dom0 over Xen hypervisor, it BUG's:
> 
> [    8.479841] BUG: unable to handle kernel paging request at
> 0000000000005a08^M
> [    8.493868] IP: [<ffffffff810badce>]
> __alloc_pages_nodemask+0x8f/0x5f5^M
> 
>   Then quickly oopses and panics. I tried various flags:
>   - upping dom0_mem from 256M to 1024M (I've been running Lenny/Xen 3.2
>     with 256M happily for several months on the same hw)
>   - using Xen 'nommu'
>   - using Linux nomodeset
> 
>   Then I followed instructions on a Xen wiki page to provide verbose
>   traces (although they do not look much more verbose than the regular
>   boot).
> 
>   I'm using an IPMI serial-over-lan console which appears as a regular
>   UART to Xen.
> 
>   I'm attaching a boot log to this report.
> 
> -- System Information:
> Debian Release: squeeze/sid
>   APT prefers testing
>   APT policy: (500, 'testing')
> Architecture: amd64 (x86_64)
> 
> Kernel: Linux 2.6.32-5-amd64 (SMP w/2 CPU cores)
> Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/bash
> 
> 
> 

-- 
Ian Campbell
Current Noise: Wolf - Seize The Night

If you will practice being fictional for a while, you will understand that
fictional characters are sometimes more real than people with bodies and
heartbeats.
Booting command-list

root  (hd0,0)
 Filesystem type is ext2fs, partition type 0x83
kernel  /boot/xen-4.0-amd64.gz com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=102
4M loglvl=all guest_loglvl=all sync_console console_to_ring lapic=debug apic_ve
rbosity=debug apic=debug iommu=off
   [Multiboot-elf, <0x100000:0x15d000:0x143000>, shtab=0x3a0078, entry=0x100000
]
module  /boot/vmlinuz-2.6.32-5-xen-amd64 root=/dev/sda1 console=hvc0 nomodeset 
earlyprintk=xen initcall_debug debug loglevel=10
   [Multiboot-module @ 0x3a1000, 0x25baa0 bytes]
module  /boot/initrd.img-2.6.32-5-xen-amd64
   [Multiboot-module @ 0x5fd000, 0x1b8fe00 bytes]

(XEN) Xen version 4.0.1 (Debian 4.0.1-1) (waldi@debian.org) (gcc version 4.4.5 20100824 (prerelease) (Debian 4.4.4-11) ) Fri Sep  3 15:38:12 UTC 2010
(XEN) Console output is synchronous.
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=1024M loglvl=all guest_loglvl=all sync_console console_to_ring lapic=debug apic_verbosity=debug apic=debug iommu=off
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  0000000000100000 - 00000000cf679000 (usable)
(XEN)  00000000cf679000 - 00000000cf68f000 (reserved)
(XEN)  00000000cf68f000 - 00000000cf6ce000 (ACPI data)
(XEN)  00000000cf6ce000 - 00000000d0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fe000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000230000000 (usable)
(XEN) ACPI: RSDP 000F09E0, 0024 (r2 DELL  )
(XEN) ACPI: XSDT 000F0AE4, 009C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: FACP CF6B3F9C, 00F4 (r3 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DSDT CF68F000, 3B39 (r1 DELL   PE_SC3          1 INTL 20050624)
(XEN) ACPI: FACS CF6B6000, 0040
(XEN) ACPI: APIC CF6B3478, 015E (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SPCR CF6B35D8, 0050 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HPET CF6B362C, 0038 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DM__ CF6B3668, 01B0 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: MCFG CF6B38C4, 003C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: WD__ CF6B3904, 0134 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SLIC CF6B3A3C, 0024 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: ERST CF692CBC, 0270 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HEST CF692F2C, 03A8 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: BERT CF692B3C, 0030 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: EINJ CF692B6C, 0150 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SRAT CF6B3BC0, 0370 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: TCPA CF6B3F34, 0064 (r2 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SSDT CF6B7000, 2104 (r1  INTEL PPM RCM  80000001 INTL 20061109)
(XEN) System RAM: 8182MB (8378468kB)
(XEN) SRAT: PXM 1 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 0 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 2 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 20 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 4 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 22 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 6 -> Node 1
(XEN) SRAT: Node 1 PXM 2 0-d0000000
(XEN) SRAT: Node 1 PXM 2 100000000-130000000
(XEN) SRAT: Node 0 PXM 1 130000000-230000000
(XEN) NUMA: Using 16 for the hash shift.
(XEN) Reserving non-aligned node boundary @ mfn 0x130000
(XEN) Domain heap initialised DMA width 30 bits
(XEN) found SMP MP-table at 000fe710
(XEN) DMI 2.6 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI:                  wakeup_vec[cf6b600c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
(XEN) Processor #16 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
(XEN) Processor #0 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
(XEN) Processor #18 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
(XEN) Processor #2 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
(XEN) Processor #20 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
(XEN) Processor #4 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
(XEN) Processor #22 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
(XEN) Processor #6 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
(XEN) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
(XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) mapped APIC to ffff82c3ffffe000 (fee00000)
(XEN) mapped IOAPIC to ffff82c3ffffd000 (fec00000)
(XEN) mapped IOAPIC to ffff82c3ffffc000 (fec80000)
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2261.080 MHz processor.
(XEN) Initing memory sharing.
(XEN) CPU0: VMX disabled by BIOS.
(XEN) VMX: failed to initialise.
(XEN) Intel machine check reporting enabled
(XEN) I/O virtualisation disabled
(XEN) Getting VERSION: 60015
(XEN) Getting VERSION: 60015
(XEN) Getting ID: 10000000
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) masked ExtINT on CPU#1
(XEN) masked ExtINT on CPU#2
(XEN) masked ExtINT on CPU#3
(XEN) masked ExtINT on CPU#4
(XEN) masked ExtINT on CPU#5
(XEN) masked ExtINT on CPU#6
(XEN) masked ExtINT on CPU#7
(XEN) Total of 8 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN)  IO-APIC (apicid-pin) 0-0, 0-16, 0-17, 0-18, 0-19, 0-20, 0-21, 0-22, 0-23, 1-0, 1-1, 1-2, 1-3, 1-4, 1-5, 1-6, 1-7, 1-8, 1-9, 1-10, 1-11, 1-12, 1-13, 1-14, 1-15, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #0 registers: 24.
(XEN) number of IO-APIC #1 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #0......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 001 01  0    0    0   0   0    1    1    28
(XEN)  02 001 01  0    0    0   0   0    1    1    F0
(XEN)  03 0FF 0F  0    0    0   0   0    1    1    F2
(XEN)  04 001 01  0    0    0   0   0    1    1    30
(XEN)  05 001 01  0    0    0   0   0    1    1    38
(XEN)  06 001 01  0    0    0   0   0    1    1    40
(XEN)  07 001 01  0    0    0   0   0    1    1    48
(XEN)  08 001 01  0    0    0   0   0    1    1    50
(XEN)  09 001 01  1    1    0   0   0    1    1    58
(XEN)  0a 001 01  0    0    0   0   0    1    1    60
(XEN)  0b 001 01  0    0    0   0   0    1    1    68
(XEN)  0c 001 01  0    0    0   0   0    1    1    70
(XEN)  0d 001 01  0    0    0   0   0    1    1    78
(XEN)  0e 001 01  0    0    0   0   0    1    1    88
(XEN)  0f 001 01  0    0    0   0   0    1    1    90
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) IO APIC #1......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... register #02: 00000000
(XEN) .......     : arbitration: 00
(XEN) .... register #03: 00000001
(XEN) .......     : Boot DT    : 1
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  1    0    0   0   0    0    0    00
(XEN)  02 000 00  1    0    0   0   0    0    0    00
(XEN)  03 000 00  1    0    0   0   0    0    0    00
(XEN)  04 000 00  1    0    0   0   0    0    0    00
(XEN)  05 000 00  1    0    0   0   0    0    0    00
(XEN)  06 000 00  1    0    0   0   0    0    0    00
(XEN)  07 000 00  1    0    0   0   0    0    0    00
(XEN)  08 000 00  1    0    0   0   0    0    0    00
(XEN)  09 000 00  1    0    0   0   0    0    0    00
(XEN)  0a 000 00  1    0    0   0   0    0    0    00
(XEN)  0b 000 00  1    0    0   0   0    0    0    00
(XEN)  0c 000 00  1    0    0   0   0    0    0    00
(XEN)  0d 000 00  1    0    0   0   0    0    0    00
(XEN)  0e 000 00  1    0    0   0   0    0    0    00
(XEN)  0f 000 00  1    0    0   0   0    0    0    00
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ242 -> 0:3
(XEN) IRQ48 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2260.9880 MHz.
(XEN) ..... host bus clock speed is 132.9992 MHz.
(XEN) ..... bus_scale = 0x00008834
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
�(XEN) Allocated console ring of 64 KiB.
(XEN) microcode.c:73:d32767 microcode: CPU1 resumed
(XEN) microcode.c:73:d32767 microcode: CPU4 resumed
(XEN) microcode.c:73:d32767 microcode: CPU3 resumed
(XEN) Brought up 8 CPUs
(XEN) microcode.c:73:d32767 microcode: CPU7 resumed
(XEN) microcode.c:73:d32767 microcode: CPU2 resumed
(XEN) microcode.c:73:d32767 microcode: CPU5 resumed
(XEN) microcode.c:73:d32767 microcode: CPU6 resumed
(XEN) Turbo Mode detected!
(XEN) HPET: 4 timers in total, 0 timers will be used for broadcast
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x16b5000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000224000000->0000000228000000 (245760 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff816b5000
(XEN)  Init. ramdisk: ffffffff816b5000->ffffffff83244e00
(XEN)  Phys-Mach map: ffffffff83245000->ffffffff83445000
(XEN)  Start info:    ffffffff83445000->ffffffff834454b4
(XEN)  Page tables:   ffffffff83446000->ffffffff83465000
(XEN)  Boot stack:    ffffffff83465000->ffffffff83466000
(XEN)  TOTAL:         ffffffff80000000->ffffffff83800000
(XEN)  ENTRY ADDRESS: ffffffff81506200
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Scrubbing Free RAM: ....................................................................done.
(XEN) trace.c:89:d32767 calc_tinfo_first_offset: NR_CPUs 128, offset_in_bytes 258, t_info_first_offset 65
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) **********************************************
(XEN) ******* WARNING: CONSOLE OUTPUT IS SYNCHRONOUS
(XEN) ******* This option is intended to aid debugging of Xen by ensuring
(XEN) ******* that all output is synchronously delivered on the serial line.
(XEN) ******* However it can introduce SIGNIFICANT latencies and affect
(XEN) ******* timekeeping. It is NOT recommended for production use!
(XEN) **********************************************
(XEN) 3... 2... 1... 
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 176kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-27) (maks@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Sat Oct 30 17:04:10 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset earlyprintk=xen initcall_debug debug loglevel=10
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] bootconsole [xenboot0] enabled
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000]  0000000000 - 0040000000 page 4k
[    0.000000] kernel direct mapping tables up to 40000000 @ 100000-302000
[    0.000000] RAMDISK: 016b5000 - 03244e00
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DM__ 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] NUMA: Using 28 for the hash shift.
[    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
[    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x00040000
[    0.000000] On node 1 totalpages: 262048
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 483 pages reserved
[    0.000000]   DMA zone: 3461 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 3528 pages used for memmap
[    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 288
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:2
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff88000349b000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    7.851572] trying to map vcpu_info 0 at ffff8800034a6020, mfn 2274a6, offset 32
[    7.866294] cpu 0 using vcpu_info at ffff8800034a6020
[    7.876346] trying to map vcpu_info 1 at ffff8800034c4020, mfn 2274c4, offset 32
[    7.891079] cpu 1 using vcpu_info at ffff8800034c4020
[    7.901132] trying to map vcpu_info 2 at ffff8800034e2020, mfn 2274e2, offset 32
[    7.915865] cpu 2 using vcpu_info at ffff8800034e2020
[    7.925918] trying to map vcpu_info 3 at ffff880003500020, mfn 227500, offset 32
[    7.940651] cpu 3 using vcpu_info at ffff880003500020
[    7.950704] trying to map vcpu_info 4 at ffff88000351e020, mfn 22751e, offset 32
[    7.965436] cpu 4 using vcpu_info at ffff88000351e020
[    7.975489] trying to map vcpu_info 5 at ffff88000353c020, mfn 22753c, offset 32
[    7.990223] cpu 5 using vcpu_info at ffff88000353c020
[    8.000275] trying to map vcpu_info 6 at ffff88000355a020, mfn 22755a, offset 32
[    8.015008] cpu 6 using vcpu_info at ffff88000355a020
[    8.025060] trying to map vcpu_info 7 at ffff880003578020, mfn 227578, offset 32
[    8.039794] cpu 7 using vcpu_info at ffff880003578020
[    8.049845] Xen: using vcpu_info placement
[    8.057996] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    8.073939] Policy zone: DMA32
[    8.080005] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset earlyprintk=xen initcall_debug debug loglevel=10
[    8.101540] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    8.113753] Initializing CPU#0
[    8.127981] DMA: Placing 64MB software IO TLB between ffff88000466f000 - ffff88000866f000
[    8.143963] DMA: software IO TLB at phys 0x466f000 - 0x866f000
[    8.155569] xen_swiotlb_fixup: buf=ffff88000466f000 size=67108864
[    8.186987] xen_swiotlb_fixup: buf=ffff8800086cf000 size=32768
[    8.202655] Memory: 927524k/1048576k available (3145k kernel code, 384k absent, 120668k reserved, 1902k data, 596k init)
[    8.224047] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=2
[    8.239288] Hierarchical RCU implementation.
[    8.247755] NR_IRQS:4352 nr_irqs:2304
[    8.255124] xen: --> irq=0
[    8.260406] xen: --> irq=1
[    8.265779] xen: --> irq=2
[    8.271151] xen: --> irq=3
[    8.276525] xen: --> irq=4
[    8.281897] xen: --> irq=5
[    8.287272] xen: --> irq=6
[    8.292643] xen: --> irq=7
[    8.298017] xen: --> irq=8
[    8.303389] xen: --> irq=9
[    8.308763] xen: --> irq=10
[    8.314308] xen: --> irq=11
[    8.319856] xen: --> irq=12
[    8.325402] xen: --> irq=13
[    8.330950] xen: --> irq=14
[    8.336494] xen: --> irq=15
[    8.342053] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    8.354692] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    8.367865] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    8.382077] xen: registering gsi 9 triggering 0 polarity 0
[    8.392998] xen_allocate_pirq: returning irq 9 for gsi 9
[    8.403569] xen: --> irq=9
(XEN) IOAPIC[0]: Set PCI routing entry (0-9 -> 0x58 -> IRQ 9 Mode:1 Active:0)
[    8.422639] xen: acpi sci 9
[    8.434217] Console: colour VGA+ 80x25
[    8.441350] console [hvc0] enabled, bootconsole disabled
[    8.441350] console [hvc0] enabled, bootconsole disabled
[    8.462694] Xen: using vcpuop timer interface
[    8.471508] installing Xen timer for CPU 0
[    8.479841] BUG: unable to handle kernel paging request at 0000000000005a08
[    8.493868] IP: [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    8.507041] PGD 0 
[    8.511199] Thread overran stack, or stack corrupted
[    8.521253] Oops: 0000 [#1] SMP 
[    8.527838] last sysfs file: 
[    8.533941] CPU 0 
[    8.538100] Modules linked in:
[    8.544342] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge R410
[    8.559594] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    8.577620] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
[    8.588366] RAX: 0000000000000000 RBX: 0000000000005220 RCX: 0000000000005a00
[    8.602752] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000005220
[    8.617139] RBP: 0000000000004020 R08: 0000000000000002 R09: ffff88003fc1c010
[    8.631525] R10: ffffffff813c2700 R11: 00000000000186a0 R12: 0000000000005220
[    8.645910] R13: 0000000000000002 R14: 0000000000000000 R15: ffff88000000da28
[    8.660300] FS:  0000000000000000(0000) GS:ffff88000349b000(0000) knlGS:0000000000000000
[    8.676591] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[    8.688203] CR2: 0000000000005a08 CR3: 0000000001001000 CR4: 0000000000002660
[    8.702589] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    8.716975] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[    8.731361] Process swapper (pid: 0, threadinfo ffffffff81442000, task ffffffff814771f0)
[    8.747654] Stack:
[    8.751813]  ffff88000000da00 00000010813c2765 00000000000212d0 00000000000186a0
[    8.766199] <0> ffff88000000ac10 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
[    8.781625] <0> 00000000000186a0 0000000000000000 0000000000005a00 0000000000000000
[    8.797572] Call Trace:
[    8.802603]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    8.815600]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    8.826695]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    8.837267]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    8.848707]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.861704]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    8.873317]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.886316]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.899317]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    8.911103]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    8.923062]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    8.936063]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    8.948368]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    8.961368]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    8.972982]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    8.984247]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    8.996206]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    9.007646]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
[    9.019777] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf 
[    9.057561] RIP  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    9.070909]  RSP <ffffffff81443c88>
[    9.078015] CR2: 0000000000005a08
[    9.084780] ---[ end trace a7919e7f17c0a725 ]---
[    9.094136] Kernel panic - not syncing: Attempted to kill the idle task!
[    9.107655] Pid: 0, comm: swapper Tainted: G      D    2.6.32-5-xen-amd64 #1
[    9.121866] Call Trace:
[    9.126897]  [<ffffffff8130a45a>] ? panic+0x86/0x141
[    9.136948]  [<ffffffff8130a563>] ? printk+0x4e/0x5b
[    9.147004]  [<ffffffff81051f7b>] ? do_exit+0x72/0x6b5
[    9.157402]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    9.168496]  [<ffffffff8130d1bd>] ? oops_end+0xaf/0xb4
[    9.178895]  [<ffffffff8103338c>] ? no_context+0x1e9/0x1f8
[    9.189987]  [<ffffffff81033541>] ? __bad_area_nosemaphore+0x1a6/0x1ca
[    9.203158]  [<ffffffff8130e541>] ? do_page_fault+0x2b/0x2fc
[    9.214598]  [<ffffffff8130c695>] ? page_fault+0x25/0x30
[    9.225345]  [<ffffffff810badce>] ? __alloc_pages_nodemask+0x8f/0x5f5
[    9.238344]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    9.251344]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    9.262436]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    9.273010]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    9.284449]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.297450]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    9.309061]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.322061]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.335061]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    9.346847]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    9.358807]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    9.371806]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    9.384112]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    9.397113]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    9.408725]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    9.419992]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    9.431951]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    9.443391]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.

Reply to: