[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#646917: marked as done (base: Debian gets unresponsive on higher IO load - BUG: soft lockup - CPU#0 stuck for 61s)

Your message dated Tue, 17 Jan 2012 18:17:09 +0000
with message-id <E1RnDan-0004FP-6S@franck.debian.org>
and subject line Bug#638172: fixed in user-mode-linux 2.6.32-1um-4+41
has caused the Debian Bug report #638172,
regarding base: Debian gets unresponsive on higher IO load - BUG: soft lockup - CPU#0 stuck for 61s
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
638172: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=638172
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message --- 
Package: base
Severity: important


On higher IO load, for example by creating a new Xen VPS by issuing xen-create-image the system freezes and is totally responsive for a few seconds up to a minute. Even a ping to the server doesn't reply back but when finished the server is responsive again. Also I noticed when running applications which generate more IO such as a Java crawler the server hangs a big and ping to the server get quite slow although I am pinging from a LAN. Below is the full stack trace which got generated while issuing xen-create-image (extract from dmesg).

[930756.024114] BUG: soft lockup - CPU#0 stuck for 61s! [kblockd/0:22]
[930756.024114] Modules linked in: dm_snapshot nfs lockd fscache nfs_acl auth_rpcgss sunrpc xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables ipmi_si mpt2sas scsi_transport_sas mptctl mptbase ipmi_devintf ipmi_msghandler dell_rbu xen_evtchn xenfs bridge stp bonding ext2 loop snd_pcm radeon snd_timer ttm drm_kms_helper snd drm joydev i2c_algo_bit psmouse soundcore i2c_core dcdbas snd_page_alloc serio_raw evdev pcspkr video output e752x_edac rng_core processor shpchp edac_core pci_hotplug button acpi_processor ext4 mbcache jbd2 crc16 dm_mod usbhid hid sd_mod sg sr_mod cdrom crc_t10dif ata_generic megaraid_mbox pata_sil680 uhci_hcd floppy ata_piix thermal thermal_sys megaraid_mm libata scsi_mod ehci_hcd e1000 usbcore nls_base [last unloaded: ipmi_si]
[930756.024114] CPU 0:
[930756.024114] Modules linked in: dm_snapshot nfs lockd fscache nfs_acl auth_rpcgss sunrpc xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables ipmi_si mpt2sas scsi_transport_sas mptctl mptbase ipmi_devintf ipmi_msghandler dell_rbu xen_evtchn xenfs bridge stp bonding ext2 loop snd_pcm radeon snd_timer ttm drm_kms_helper snd drm joydev i2c_algo_bit psmouse soundcore i2c_core dcdbas snd_page_alloc serio_raw evdev pcspkr video output e752x_edac rng_core processor shpchp edac_core pci_hotplug button acpi_processor ext4 mbcache jbd2 crc16 dm_mod usbhid hid sd_mod sg sr_mod cdrom crc_t10dif ata_generic megaraid_mbox pata_sil680 uhci_hcd floppy ata_piix thermal thermal_sys megaraid_mm libata scsi_mod ehci_hcd e1000 usbcore nls_base [last unloaded: ipmi_si]
[930756.024114] Pid: 22, comm: kblockd/0 Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge 2850
[930756.024114] RIP: e030:[<ffffffff8100922a>]  [<ffffffff8100922a>] hypercall_page+0x22a/0x1001
[930756.024114] RSP: e02b:ffff88000350ecc8  EFLAGS: 00000246
[930756.024114] RAX: 0000000000040000 RBX: 0000000000000000 RCX: ffffffff8100922a
[930756.024114] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000000
[930756.024114] RBP: ffff880002f4e000 R08: ffff88003ebe0690 R09: ffffffff8118aed0
[930756.024114] R10: 0000000000000000 R11: 0000000000000246 R12: ffff88000243f800
[930756.024114] R13: ffff880002bdc000 R14: ffff88000243f848 R15: ffff8800024369c0
[930756.024114] FS:  00007fed4f83e700(0000) GS:ffff88000350b000(0000) knlGS:0000000000000000
[930756.024114] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[930756.024114] CR2: 0000000001ac31d0 CR3: 000000003e46d000 CR4: 0000000000000660
[930756.024114] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[930756.024114] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[930756.024114] Call Trace:
[930756.024114]  <IRQ>  [<ffffffff8100ecf2>] ? check_events+0x12/0x20
[930756.024114]  [<ffffffff8100e635>] ? xen_force_evtchn_callback+0x9/0xa
[930756.024114]  [<ffffffff8100ecf2>] ? check_events+0x12/0x20
[930756.024114]  [<ffffffff8118aed0>] ? __cfq_slice_expired+0xc4/0xd4
[930756.024114]  [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
[930756.024114]  [<ffffffffa006a2f0>] ? scsi_request_fn+0x41f/0x506 [scsi_mod]
[930756.024114]  [<ffffffff8117ff72>] ? __blk_run_queue+0x35/0x66
[930756.024114]  [<ffffffff81180047>] ? blk_run_queue+0x21/0x35
[930756.024114]  [<ffffffffa0069881>] ? scsi_run_queue+0x2ce/0x36f [scsi_mod]
[930756.024114]  [<ffffffffa006a5d0>] ? scsi_next_command+0x2d/0x39 [scsi_mod]
[930756.024114]  [<ffffffffa006b0da>] ? scsi_io_completion+0x3d1/0x3fa [scsi_mod]
[930756.024114]  [<ffffffff8130d55c>] ? _spin_lock_irqsave+0x15/0x34
[930756.024114]  [<ffffffff811840ea>] ? blk_done_softirq+0x6e/0x7b
[930756.024114]  [<ffffffff81054d1b>] ? __do_softirq+0xdd/0x1a6
[930756.024114]  [<ffffffff81012cac>] ? call_softirq+0x1c/0x30
[930756.024114]  [<ffffffff8101422b>] ? do_softirq+0x3f/0x7c
[930756.024114]  [<ffffffff81054b8b>] ? irq_exit+0x36/0x76
[930756.024114]  [<ffffffff811f28a5>] ? xen_evtchn_do_upcall+0x33/0x42
[930756.024114]  [<ffffffff81012cfe>] ? xen_do_hypervisor_callback+0x1e/0x30
[930756.024114]  <EOI>  [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
[930756.024114]  [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
[930756.024114]  [<ffffffff8100ecf2>] ? check_events+0x12/0x20
[930756.024114]  [<ffffffff8100e635>] ? xen_force_evtchn_callback+0x9/0xa
[930756.024114]  [<ffffffff8100ecf2>] ? check_events+0x12/0x20
[930756.024114]  [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
[930756.024114]  [<ffffffffa006a38f>] ? scsi_request_fn+0x4be/0x506 [scsi_mod]
[930756.024114]  [<ffffffff8100ecf2>] ? check_events+0x12/0x20
[930756.024114]  [<ffffffff811800f6>] ? generic_unplug_device+0x21/0x34
[930756.024114]  [<ffffffff81062953>] ? worker_thread+0x188/0x21d
[930756.024114]  [<ffffffff811783ca>] ? blk_unplug_work+0x0/0x44
[930756.024114]  [<ffffffff81065f86>] ? autoremove_wake_function+0x0/0x2e
[930756.024114]  [<ffffffff810627cb>] ? worker_thread+0x0/0x21d
[930756.024114]  [<ffffffff81065cb9>] ? kthread+0x79/0x81
[930756.024114]  [<ffffffff81012baa>] ? child_rip+0xa/0x20
[930756.024114]  [<ffffffff81011d61>] ? int_ret_from_sys_call+0x7/0x1b
[930756.024114]  [<ffffffff8101251d>] ? retint_restore_args+0x5/0x6
[930756.024114]  [<ffffffff81012ba0>] ? child_rip+0x0/0x20

Just in case here is the output of "lspci":

00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 09)
00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 09)
00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 09)
00:05.0 PCI bridge: Intel Corporation E7520 PCI Express Port B1 (rev 09)
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 09)
00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)
00:1d.1 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #2 (rev 02)
00:1d.2 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #3 (rev 02)
00:1d.7 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB2 EHCI Controller (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2)
00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC Interface Bridge (rev 02)
00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE Controller (rev 02)
01:00.0 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (A-Segment Bridge) (rev 06)
01:00.2 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (B-Segment Bridge) (rev 06)
02:0e.0 RAID bus controller: Dell PowerEdge Expandable RAID controller 4 (rev 06)
05:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge A (rev 09)
05:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge B (rev 09)
06:07.0 Ethernet controller: Intel Corporation 82541GI Gigabit Ethernet Controller (rev 05)
07:08.0 Ethernet controller: Intel Corporation 82541GI Gigabit Ethernet Controller (rev 05)
08:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge A (rev 09)
08:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge B (rev 09)
0b:05.0 Unassigned class [ff00]: Dell Remote Access Card 4 Daughter Card
0b:05.1 Unassigned class [ff00]: Dell Remote Access Card 4 Daughter Card Virtual UART
0b:05.2 Unassigned class [ff00]: Dell Remote Access Card 4 Daughter Card SMIC interface
0b:06.0 IDE interface: Silicon Image, Inc. PCI0680 Ultra ATA-133 Host Controller (rev 02)
0b:0d.0 VGA compatible controller: ATI Technologies Inc Radeon RV100 QY [Radeon 7000/VE]

and the output of "/proc/cpu":

processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 3
model name	: Intel(R) Xeon(TM) CPU 3.40GHz
stepping	: 4
cpu MHz		: 3391.656
cache size	: 1024 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall lm constant_tsc pni est cid hypervisor
bogomips	: 6783.31
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 3
model name	: Intel(R) Xeon(TM) CPU 3.40GHz
stepping	: 4
cpu MHz		: 3391.656
cache size	: 1024 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall lm constant_tsc pni est cid hypervisor
bogomips	: 6783.31
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

Please do let me know if you need more information, I am happy to provide information which might help.

Many thanks in advance.


-- System Information:
Debian Release: 6.0.3
  APT prefers stable-updates
  APT policy: (500, 'stable-updates'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 2.6.32-5-xen-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

--- End Message ---
--- Begin Message --- 
Source: user-mode-linux
Source-Version: 2.6.32-1um-4+41

We believe that the bug you reported is fixed in the latest version of
user-mode-linux, which is due to be installed in the Debian FTP archive:

user-mode-linux_2.6.32-1um-4+41.diff.gz
  to main/u/user-mode-linux/user-mode-linux_2.6.32-1um-4+41.diff.gz
user-mode-linux_2.6.32-1um-4+41.dsc
  to main/u/user-mode-linux/user-mode-linux_2.6.32-1um-4+41.dsc
user-mode-linux_2.6.32-1um-4+41_amd64.deb
  to main/u/user-mode-linux/user-mode-linux_2.6.32-1um-4+41_amd64.deb



A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 638172@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
dann frazier <dannf@debian.org> (supplier of updated user-mode-linux package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Format: 1.8
Date: Mon, 16 Jan 2012 15:10:25 -0700
Source: user-mode-linux
Binary: user-mode-linux
Architecture: source amd64
Version: 2.6.32-1um-4+41
Distribution: stable
Urgency: high
Maintainer: User Mode Linux Maintainers <pkg-uml-pkgs@lists.alioth.debian.org>
Changed-By: dann frazier <dannf@debian.org>
Description: 
 user-mode-linux - User-mode Linux (kernel)
Closes: 586494 633526 637234 637308 638172 641661 645308 647624 650160 650652 651255 651367 652857 653398 655049
Changes: 
 user-mode-linux (2.6.32-1um-4+41) stable; urgency=high
 .
   * Rebuild against linux-source-2.6.32 (2.6.32-41):
     * Add longterm releases 2.6.32.47 and 2.6.32.48, including:
       - atm: br2684: Fix oops due to skb->dev being NULL
       - md/linear: avoid corrupting structure while waiting for rcu_free to
         complete.
       - xen/smp: Warn user why they keel over - nosmp or noapic and what to use
         instead. (Closes: #637308)
       - md: Fix handling for devices from 2TB to 4TB in 0.90 metadata.
       - net/9p: fix client code to fail more gracefully on protocol error
       - fs/9p: Fid is not valid after a failed clunk.
       - TPM: Call tpm_transmit with correct size (CVE-2011-1161)
       - TPM: Zero buffer after copying to userspace (CVE-2011-1162)
       - libiscsi_tcp: fix LLD data allocation
       - cfg80211: Fix validation of AKM suites
       - USB: pid_ns: ensure pid is not freed during kill_pid_info_as_uid
       - kobj_uevent: Ignore if some listeners cannot handle message
         (Closes: #641661)
       - nfsd4: ignore WANT bits in open downgrade
       - [s390] KVM: check cpu_id prior to using it
       - cfq: merge cooperating cfq_queues
       - [x86] KVM: Reset tsc_timestamp on TSC writes (fixes guest performance
         regression introduced in 2.6.32-35)
       - ext4: fix BUG_ON() in ext4_ext_insert_extent()
       - ext2,ext3,ext4: don't inherit APPEND_FL or IMMUTABLE_FL for new inodes
       For the complete list of changes, see:
        http://www.kernel.org/pub/linux/kernel/v2.6/longterm/ChangeLog-2.6.32.47
        http://www.kernel.org/pub/linux/kernel/v2.6/longterm/ChangeLog-2.6.32.48
       and the bug report which this closes: #647624.
     * tg3: Fix I/O failures after chip reset (Closes: #645308; regression in
       2.6.32-36)
     * Add longterm release 2.6.32.49, including:
       - SCSI: st: fix race in st_scsi_execute_end
       - NFS/sunrpc: don't use a credential with extra groups.
       - netlink: validate NLA_MSECS length
       - hfs: add sanity check for file name length (CVE-2011-4330)
       - md/raid5: abort any pending parity operations when array fails.
       - mm: avoid null pointer access in vm_struct via /proc/vmallocinfo
       - ipv6: udp: fix the wrong headroom check (CVE-2011-4326)
       - USB: Fix Corruption issue in USB ftdi driver ftdi_sio.c
       For the complete list of changes, see:
        http://www.kernel.org/pub/linux/kernel/v2.6/longterm/ChangeLog-2.6.32.49
       and the bug report which this closes: #650160.
     * ipv6: Allow inet6_dump_addr() to handle more than 64 addresses
       (Closes: #651255)
     * Add longterm release 2.6.32.50, including:
       - PCI hotplug: shpchp: don't blindly claim non-AMD 0x7450 device IDs
         (see #638863)
       - sched, x86: Avoid unnecessary overflow in sched_clock
       - [x86] mpparse: Account for bus types other than ISA and PCI
         (Closes: #586494)
       For the complete list of changes, see:
        http://www.kernel.org/pub/linux/kernel/v2.6/longterm/ChangeLog-2.6.32.50
       and the bug report which this closes: #651367.
     * [vserver] Update patch to 2.6.32.48-vs2.3.0.36.29.8
       - nfs: Fix client uid/gid caching (Closes: #633526)
     * [x86] Add isci driver from Linux 3.1 (Closes: #652857)
       - libsas: fix definition of wideport, include local sas address
       - [x86] Introduce pci_map_biosrom()
     * Add longterm release 2.6.32.51, including:
       - percpu: fix chunk range calculation
       - xfrm: Fix key lengths for rfc3686(ctr(aes)) (Closes: #650652)
       - jbd/jbd2: validate sb->s_first in journal_get_superblock()
         (CVE-2011-4132)
       - Make taskstats require root access (CVE-2011-2494)
       - hfs: fix hfs_find_init() sb->ext_tree NULL ptr oops (CVE-2011-2203)
       - oprofile, x86: Fix nmi-unsafe callgraph support
       - ext4: avoid hangs in ext4_da_should_update_i_disksize()
     * xen: backport upstream (xen.git#xen/stable-2.6.32.y) fixes to event
       handling:
       - multiple fixes to PIRQ event channel handling (Closes: #638172)
       - setup IRQ before binding VIRQ to it.
       - correctly setup event channel mask for secondary CPUs on restore.
       - use locked set/clear bit when manipulating event channel masks.
       - ensure event channels are handled in a fair/round-robin order preventing
         lower numbered event channels from starving higher.
     * xen: blkback: don't fail empty barrier requests (Closes: #637234)
     * ipv6: make fragment identifications less predictable (CVE-2011-2699)
       - fix NULL dereference in udp6_ufo_fragment (see #643817)
     * Add longterm release 2.6.32.52:
       - Revert "clockevents: Set noop handler in clockevents_exchange_device()",
         included in stable update 2.6.32.50 (Closes: #653398)
     * Add longterm release 2.6.32.53, including:
       - cfq-iosched: fix cfq_cic_link() race confition
       For the complete list of changes, see:
        http://www.kernel.org/pub/linux/kernel/v2.6/longterm/ChangeLog-2.6.32.53
       and the bug report which this closes: #655049.
Checksums-Sha1: 
 f494d27c53a7b37ca3a4347b436edd3524e68c02 2030 user-mode-linux_2.6.32-1um-4+41.dsc
 b488267ef63e4218f70c47ee51b40502007b5233 19896 user-mode-linux_2.6.32-1um-4+41.diff.gz
 9f7914a7a62777ecf85299f2b72ede31753c8afd 7082050 user-mode-linux_2.6.32-1um-4+41_amd64.deb
Checksums-Sha256: 
 ba2f5619cd4026bd17a83d3b6a0eaed47b9c62bc0cf46ec3ddf56f1d23f5593b 2030 user-mode-linux_2.6.32-1um-4+41.dsc
 5ccf08629fadd90d1083e938c8000fa2499028bfb91f0914b673e4b031214942 19896 user-mode-linux_2.6.32-1um-4+41.diff.gz
 f84c0799d02381f79ccbf1b78d2704011eb5a1158b63d4a724cbbf6e771c3e67 7082050 user-mode-linux_2.6.32-1um-4+41_amd64.deb
Files: 
 99409f5e1cce01848a20d64c09487d7c 2030 kernel extra user-mode-linux_2.6.32-1um-4+41.dsc
 80d12b694c2947277796884f1d9c36cd 19896 kernel extra user-mode-linux_2.6.32-1um-4+41.diff.gz
 491732fc5e1e2a828e84767f691059a1 7082050 kernel extra user-mode-linux_2.6.32-1um-4+41_amd64.deb

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iQIcBAEBAgAGBQJPFZhVAAoJEBv4PF5U/IZAweUP/2IDeab0q+3jvY0zgrkw2fKt
l/6jcVFOkCAor73xMXLOasLCh51REj1+rW2wPpAG2w+M5qICIdUGG0YhaCpM1D//
4Dba1k89R4LMUp7cQMst7DHd0yoxk/ZsBi7kqcP8dKY1GKS3FPIRIsUbghtsymW4
p8/by24tqsKEJdeK1eWwj0mtYk3NWFDdnR9BWVgBeUjpQTpmbK8U0RIXzXMzBiYM
JtsoYC/Pbob62vE+ON1flm0XzbJ8FjdpuOqrxseY9l/H0NbsSlpoyVpxhgnAAD7H
nWeqxe0DDgLw6r6nJGvsYyqymD5y1KFNq0DmiY5NBOUXlD43sjcJj4h0sNeBhM+r
nh8EbXLPkTCGwsDPIhKIR5aGYK+i60Tkgj1Qc87uAOOyFUrERVcRsBhZt0tG7NMS
PvUc6lTJM047yCPmn78F/WLQ4ow0CqcCFAzWO51i1a+vew9MAyvHZj9FYiiO/yBn
EEamFuO9ZT/QIy52tAlatD+nrHQQ4o4PGXtDMLcuL7aNEElWRUgoz7fmGKBh9KHc
mIkBBLF5o3SyhwrHSHJSaVwmK4E8Nuz8eVkPvJyVMMD0WfuK01anwqx0igi5XirC
PP5HC3RWHiBaOU4atkvWOpO8J4Vq7t591ymm+pHlS6GsqQYf/TEWjF5UWd4l7XLd
YUI29ib/LlKPB7BiVW2Y
=JLYM
-----END PGP SIGNATURE-----

--- End Message ---
Reply to: