Bug#606964: linux-image-2.6.32-5-xen-amd64: Xen fails to boot dom0 kernel on system with, lots of RAM
Hi,
On 12/22/2010 10:34 AM, Ian Campbell wrote:
I was wondering about clamping something in the kernel to correspond to
CONFIG_XEN_MAX_DOMAIN_MEMORY and avoid the issue but you say the crash
is after "x VCPUS" and before "Scrubbing Free RAM" so I'm surprised the
dom0 kernel has run at this point and hence changing it would not help.
The hypervisor doesn't know about this guest configuration item so there
isn't much which can be done there.
To try and confirm what is going on is there any chance you could you
collect a serial console log with verbose debugging enabled by using the
command line parameters described in "Are there more debugging options I
could enable to troubleshoot booting problems?" of
http://wiki.xensource.com/xenwiki/XenParavirtOps (without the
recommended dom0_mem).
The console log is attached.
Assuming that shows that the domain 0 kernel did actually get a chance
to run and crash I'll take a look at what else needs to be clamped to
have it just work.
From what I can see in the log, the dom0 kernel doesn't seem to get
started.
Hope this helps.
Regards,
Rik
(XEN) Xen version 4.0.1 (Debian 4.0.1-1) (waldi@debian.org) (gcc version 4.4.5 20100824 (prerelease) (Debian 4.4.4-11) ) Fri Sep 3 15:38:12 UTC 2010
(XEN) Console output is synchronous.
(XEN) Bootloader: GRUB 1.98+20100804-10
(XEN) Command line: placeholder loglvl=all guest_loglvl=all sync_console console_to_ring com1=115200,8n1 console=com1
(XEN) Video information:
(XEN) VGA is text mode 80x25, font 8x16
(XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN) EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN) Found 1 MBR signatures
(XEN) Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) 0000000000000000 - 00000000000a0000 (usable)
(XEN) 0000000000100000 - 00000000bf379000 (usable)
(XEN) 00000000bf379000 - 00000000bf38f000 (reserved)
(XEN) 00000000bf38f000 - 00000000bf3ce000 (ACPI data)
(XEN) 00000000bf3ce000 - 00000000c0000000 (reserved)
(XEN) 00000000e0000000 - 00000000f0000000 (reserved)
(XEN) 00000000fe000000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 0000001240000000 (usable)
(XEN) ACPI: RSDP 000F1240, 0024 (r2 DELL )
(XEN) ACPI: XSDT 000F1344, 009C (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: FACP BF3B3F9C, 00F4 (r3 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: DSDT BF38F000, 3D72 (r1 DELL PE_SC3 1 INTL 20050624)
(XEN) ACPI: FACS BF3B6000, 0040
(XEN) ACPI: APIC BF3B3478, 015E (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: SPCR BF3B35D8, 0050 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: HPET BF3B362C, 0038 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: DMAR BF3B3668, 01C0 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: MCFG BF3B38C4, 003C (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: WD__ BF3B3904, 0134 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: SLIC BF3B3A3C, 0024 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: ERST BF392EF4, 0270 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: HEST BF393164, 03A8 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: BERT BF392D74, 0030 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: EINJ BF392DA4, 0150 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: SRAT BF3B3BC0, 0370 (r1 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: TCPA BF3B3F34, 0064 (r2 DELL PE_SC3 1 DELL 1)
(XEN) ACPI: SSDT BF3B7000, 6C0C (r1 INTEL PPM RCM 80000001 INTL 20061109)
(XEN) System RAM: 73715MB (75484260kB)
(XEN) SRAT: PXM 1 -> APIC 32 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 0 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 34 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 2 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 36 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 4 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 48 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 16 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 50 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 18 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 52 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 20 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 33 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 1 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 35 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 3 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 37 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 5 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 49 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 17 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 51 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 19 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 53 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 21 -> Node 1
(XEN) SRAT: Node 1 PXM 2 0-c0000000
(XEN) SRAT: Node 1 PXM 2 100000000-940000000
(XEN) SRAT: Node 0 PXM 1 940000000-1240000000
(XEN) NUMA: Allocated memnodemap from 123fdfe000 - 123fdff000
(XEN) NUMA: Using 18 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) found SMP MP-table at 000fe710
(XEN) DMI 2.6 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI: wakeup_vec[bf3b600c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x20] enabled)
(XEN) Processor #32 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
(XEN) Processor #0 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x22] enabled)
(XEN) Processor #34 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
(XEN) Processor #2 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x24] enabled)
(XEN) Processor #36 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
(XEN) Processor #4 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x30] enabled)
(XEN) Processor #48 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] enabled)
(XEN) Processor #16 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x32] enabled)
(XEN) Processor #50 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x12] enabled)
(XEN) Processor #18 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x34] enabled)
(XEN) Processor #52 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x14] enabled)
(XEN) Processor #20 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x21] enabled)
(XEN) Processor #33 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x01] enabled)
(XEN) Processor #1 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x23] enabled)
(XEN) Processor #35 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x03] enabled)
(XEN) Processor #3 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x25] enabled)
(XEN) Processor #37 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
(XEN) Processor #5 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x31] enabled)
(XEN) Processor #49 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x11] enabled)
(XEN) Processor #17 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x33] enabled)
(XEN) Processor #51 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x13] enabled)
(XEN) Processor #19 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x35] enabled)
(XEN) Processor #53 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x15] enabled)
(XEN) Processor #21 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
(XEN) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode: Phys. Using 2 I/O APICs
(XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2660.082 MHz processor.
(XEN) Initing memory sharing.
(XEN) VMX: Supported advanced features:
(XEN) - APIC MMIO access virtualisation
(XEN) - APIC TPR shadow
(XEN) - Extended Page Tables (EPT)
(XEN) - Virtual-Processor Identifiers (VPID)
(XEN) - Virtual NMI
(XEN) - MSR direct-access bitmap
(XEN) - Unrestricted Guest
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) Intel machine check reporting enabled
(XEN) Intel VT-d Snoop Control supported.
(XEN) Intel VT-d DMA Passthrough not supported.
(XEN) Intel VT-d Queued Invalidation supported.
(XEN) Intel VT-d Interrupt Remapping supported.
(XEN) I/O virtualisation enabled
(XEN) - Dom0 mode: Relaxed
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) Total of 24 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
ÿ(XEN) Allocated console ring of 256 KiB.
(XEN) microcode.c:73:d32767 microcode: CPU1 resumed
(XEN) microcode.c:73:d32767 microcode: CPU22 resumed
(XEN) microcode.c:73:d32767 microcode: CPU10 resumed
(XEN) Brought up 24 CPUs
(XEN) microcode.c:73:d32767 microcode: CPU12 resumed
(XEN) microcode.c:73:d32767 microcode: CPU7 resumed
(XEN) microcode.c:73:d32767 microcode: CPU20 resumed
(XEN) microcode.c:73:d32767 microcode: CPU8 resumed
(XEN) microcode.c:73:d32767 microcode: CPU18 resumed
(XEN) microcode.c:73:d32767 microcode: CPU6 resumed
(XEN) microcode.c:73:d32767 microcode: CPU14 resumed
(XEN) microcode.c:73:d32767 microcode: CPU2 resumed
(XEN) microcode.c:73:d32767 microcode: CPU16 resumed
(XEN) microcode.c:73:d32767 microcode: CPU4 resumed
(XEN) microcode.c:73:d32767 microcode: CPU21 resumed
(XEN) microcode.c:73:d32767 microcode: CPU5 resumed
(XEN) microcode.c:73:d32767 microcode: CPU11 resumed
(XEN) microcode.c:73:d32767 microcode: CPU3 resumed
(XEN) microcode.c:73:d32767 microcode: CPU23 resumed
(XEN) microcode.c:73:d32767 microcode: CPU19 resumed
(XEN) microcode.c:73:d32767 microcode: CPU17 resumed
(XEN) microcode.c:73:d32767 microcode: CPU9 resumed
(XEN) microcode.c:73:d32767 microcode: CPU15 resumed
(XEN) microcode.c:73:d32767 microcode: CPU13 resumed
(XEN) Turbo Mode detected!
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x16b6000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000001200000000->0000001210000000 (18567761 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff81000000->ffffffff816b6000
(XEN) Init. ramdisk: ffffffff816b6000->ffffffff83268800
(XEN) Phys-Mach map: ffffffff83269000->ffffffff8c092288
(XEN) Start info: ffffffff8c093000->ffffffff8c0934b4
(XEN) Page tables: ffffffff8c094000->ffffffff8c0f9000
(XEN) Boot stack: ffffffff8c0f9000->ffffffff8c0fa000
(XEN) TOTAL: ffffffff80000000->ffffffff8c400000
(XEN) ENTRY ADDRESS: ffffffff81506200
(XEN) Dom0 has maximum 24 VCPUs
Reply to: