Bug#699913: Memory hotplug (VMware) often fails
tags 699913 + moreinfo
quit
Hi Bernhard,
Bernhard Schmidt wrote:
> Adding additional RAM to a virtual machine running Debian Wheezy on
> VMware ESXi 5.0 often, but not always leads to the attached backtrace.
[...]
> [504133.812000] VMCIUtil: Updating context id from 0x4d2c44d9 to 0x4d2c44d9 on event 0.
> [504133.936000] Hotplug Mem Device
> [504133.956000] init_memory_mapping: 0000000040000000-0000000080000000
> [504133.956000] 0040000000 - 0080000000 page 2M
> [504134.044000] kworker/0:1: page allocation failure: order:9, mode:0x80d0
> [504134.044000] Pid: 15680, comm: kworker/0:1 Tainted: G O 3.2.0-4-amd64 #1 Debian 3.2.35-2
> [504134.044000] Call Trace:
> [504134.044000] [<ffffffff810b8417>] ? warn_alloc_failed+0x11a/0x12d
> [504134.044000] [<ffffffff810363d8>] ? should_resched+0x5/0x23
> [504134.044000] [<ffffffff8134bd27>] ? _cond_resched+0x7/0x1c
> [504134.044000] [<ffffffff813487db>] ? __alloc_pages_direct_compact+0x162/0x174
> [504134.044000] [<ffffffff810bb143>] ? __alloc_pages_nodemask+0x704/0x7aa
> [504134.044000] [<ffffffff811aa431>] ? ida_get_new_above+0xf4/0x198
> [504134.044000] [<ffffffff81344113>] ? vmemmap_alloc_block+0x5f/0xdc
> [504134.044000] [<ffffffff8134330e>] ? vmemmap_populate+0xf7/0x1f6
> [504134.044000] [<ffffffff81344531>] ? sparse_mem_map_populate+0x24/0x34
> [504134.044000] [<ffffffff81344017>] ? sparse_add_one_section+0x4e/0xeb
> [504134.044000] [<ffffffff81331782>] ? __add_pages+0x73/0x1fe
> [504134.044000] [<ffffffff8102d892>] ? arch_add_memory+0x5d/0xd1
> [504134.044000] [<ffffffff810363d8>] ? should_resched+0x5/0x23
> [504134.044000] [<ffffffff8104cd44>] ? request_resource_conflict+0x30/0x3b
> [504134.044000] [<ffffffff81331a5d>] ? add_memory+0xcc/0x14e
> [504134.044000] [<ffffffffa0159167>] ? acpi_memory_enable_device+0x7d/0xbf [acpi_memhotplug]
> [504134.044000] [<ffffffffa0159518>] ? acpi_memory_device_add+0xbe/0xdd [acpi_memhotplug]
> [504134.044000] [<ffffffff811f0456>] ? acpi_device_probe+0x42/0x10d
> [504134.044000] [<ffffffff81250add>] ? driver_probe_device+0xa8/0x138
> [504134.044000] [<ffffffff81250bdc>] ? __driver_attach+0x6f/0x6f
> [504134.044000] [<ffffffff8124f691>] ? bus_for_each_drv+0x47/0x7b
> [504134.044000] [<ffffffff812509fe>] ? device_attach+0x6f/0x8f
> [504134.044000] [<ffffffff81250280>] ? bus_probe_device+0x25/0x8d
> [504134.044000] [<ffffffff8124e897>] ? device_add+0x3fd/0x590
> [504134.044000] [<ffffffff81258509>] ? pm_runtime_init+0xb5/0xc9
> [504134.044000] [<ffffffff811f1788>] ? acpi_add_single_object+0x8f9/0xaec
> [504134.044000] [<ffffffff81070ad5>] ? arch_local_irq_save+0x11/0x17
> [504134.044000] [<ffffffff812056e0>] ? acpi_get_data+0x63/0x6e
> [504134.044000] [<ffffffff811f1aa7>] ? acpi_bus_check_add+0x12c/0x18e
> [504134.044000] [<ffffffff81039817>] ? finish_task_switch+0x88/0xb9
> [504134.044000] [<ffffffff81070ad5>] ? arch_local_irq_save+0x11/0x17
> [504134.044000] [<ffffffff8134d03c>] ? _raw_spin_lock_irqsave+0x9/0x25
> [504134.044000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.044000] [<ffffffff811f1b3a>] ? acpi_bus_scan+0x31/0x76
> [504134.044000] [<ffffffff811eded8>] ? acpi_os_signal_semaphore+0x19/0x24
> [504134.044000] [<ffffffff811f1bde>] ? acpi_bus_add+0x24/0x2a
> [504134.044000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.044000] [<ffffffffa01592ad>] ? acpi_memory_device_notify+0xa5/0x221 [acpi_memhotplug]
> [504134.044000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.044000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.044000] [<ffffffff811fb583>] ? acpi_ev_notify_dispatch+0x5b/0x6f
> [504134.044000] [<ffffffff811ed5a3>] ? acpi_os_execute_deferred+0x1e/0x2a
> [504134.044000] [<ffffffff8105b0ed>] ? process_one_work+0x163/0x284
> [504134.044000] [<ffffffff8105c0cc>] ? worker_thread+0xc2/0x145
> [504134.044000] [<ffffffff8105c00a>] ? manage_workers.isra.25+0x15b/0x15b
> [504134.044000] [<ffffffff8105f201>] ? kthread+0x76/0x7e
> [504134.044000] [<ffffffff81354174>] ? kernel_thread_helper+0x4/0x10
> [504134.044000] [<ffffffff8105f18b>] ? kthread_worker_fn+0x139/0x139
> [504134.044000] [<ffffffff81354170>] ? gs_change+0x13/0x13
> [504134.044000] Mem-Info:
[...]
> [504134.048000] WARNING: at /build/buildd-linux_3.2.35-2-amd64-v9djlH/linux-3.2.35/arch/x86/mm/init_64.c:676 arch_add_memory+0x7f/0xd1()
> [504134.048000] Hardware name: VMware Virtual Platform
> [504134.048000] Modules linked in: joydev vsock(O) vmmemctl(O) nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ext4 crc16 jbd2 mbcache snd_pcm snd_page_alloc i2c_piix4 snd_timer coretemp vmci(O) snd vmwgfx parport_pc ttm drm parport soundcore shpchp crc32c_intel psmouse pcspkr i2c_core serio_raw ac power_supply processor evdev thermal_sys container button acpi_memhotplug loop autofs4 xfs vmxnet(O) sr_mod cdrom sg ata_generic sd_mod crc_t10dif floppy ata_piix libata vmxnet3 vmw_pvscsi scsi_mod [last unloaded: scsi_wait_scan]
> [504134.048000] Pid: 15680, comm: kworker/0:1 Tainted: G O 3.2.0-4-amd64 #1 Debian 3.2.35-2
> [504134.048000] Call Trace:
> [504134.048000] [<ffffffff81046a75>] ? warn_slowpath_common+0x78/0x8c
> [504134.048000] [<ffffffff8102d8b4>] ? arch_add_memory+0x7f/0xd1
> [504134.048000] [<ffffffff810363d8>] ? should_resched+0x5/0x23
> [504134.048000] [<ffffffff81331a5d>] ? add_memory+0xcc/0x14e
> [504134.048000] [<ffffffffa0159167>] ? acpi_memory_enable_device+0x7d/0xbf [acpi_memhotplug]
> [504134.048000] [<ffffffffa0159518>] ? acpi_memory_device_add+0xbe/0xdd [acpi_memhotplug]
> [504134.048000] [<ffffffff811f0456>] ? acpi_device_probe+0x42/0x10d
> [504134.048000] [<ffffffff81250add>] ? driver_probe_device+0xa8/0x138
> [504134.048000] [<ffffffff81250bdc>] ? __driver_attach+0x6f/0x6f
> [504134.048000] [<ffffffff8124f691>] ? bus_for_each_drv+0x47/0x7b
> [504134.048000] [<ffffffff812509fe>] ? device_attach+0x6f/0x8f
> [504134.048000] [<ffffffff81250280>] ? bus_probe_device+0x25/0x8d
> [504134.048000] [<ffffffff8124e897>] ? device_add+0x3fd/0x590
> [504134.048000] [<ffffffff81258509>] ? pm_runtime_init+0xb5/0xc9
> [504134.048000] [<ffffffff811f1788>] ? acpi_add_single_object+0x8f9/0xaec
> [504134.048000] [<ffffffff81070ad5>] ? arch_local_irq_save+0x11/0x17
> [504134.048000] [<ffffffff812056e0>] ? acpi_get_data+0x63/0x6e
> [504134.048000] [<ffffffff811f1aa7>] ? acpi_bus_check_add+0x12c/0x18e
> [504134.048000] [<ffffffff81039817>] ? finish_task_switch+0x88/0xb9
> [504134.048000] [<ffffffff81070ad5>] ? arch_local_irq_save+0x11/0x17
> [504134.048000] [<ffffffff8134d03c>] ? _raw_spin_lock_irqsave+0x9/0x25
> [504134.048000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.048000] [<ffffffff811f1b3a>] ? acpi_bus_scan+0x31/0x76
> [504134.048000] [<ffffffff811eded8>] ? acpi_os_signal_semaphore+0x19/0x24
> [504134.048000] [<ffffffff811f1bde>] ? acpi_bus_add+0x24/0x2a
> [504134.048000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.048000] [<ffffffffa01592ad>] ? acpi_memory_device_notify+0xa5/0x221 [acpi_memhotplug]
> [504134.048000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.048000] [<ffffffff811ed585>] ? acpi_os_wait_events_complete+0x1c/0x1c
> [504134.048000] [<ffffffff811fb583>] ? acpi_ev_notify_dispatch+0x5b/0x6f
> [504134.048000] [<ffffffff811ed5a3>] ? acpi_os_execute_deferred+0x1e/0x2a
> [504134.048000] [<ffffffff8105b0ed>] ? process_one_work+0x163/0x284
> [504134.048000] [<ffffffff8105c0cc>] ? worker_thread+0xc2/0x145
> [504134.048000] [<ffffffff8105c00a>] ? manage_workers.isra.25+0x15b/0x15b
> [504134.048000] [<ffffffff8105f201>] ? kthread+0x76/0x7e
> [504134.048000] [<ffffffff81354174>] ? kernel_thread_helper+0x4/0x10
> [504134.048000] [<ffffffff8105f18b>] ? kthread_worker_fn+0x139/0x139
> [504134.048000] [<ffffffff81354170>] ? gs_change+0x13/0x13
> [504134.048000] ---[ end trace f7146bc50aa7470a ]---
> [504134.048000] ACPI:memory_hp:add_memory failed
> [504134.048000] ACPI:memory_hp:Error in acpi_memory_enable_device
> [504134.048000] acpi_memhotplug: probe of PNP0C80:04 failed with error -22
[...]
> It happens with Squeeze 2.6.32, Squeeze with bpo and Wheezy 3.2.0-4
>
> The tainted warning comes from the kernel modules in the official VMware
> tools package, I will try to reproduce without them tomorrow.
Thanks. Please also attach /proc/iomem.
Looking forward to hearing how it goes,
Jonathan
Reply to: