[UDD] Again: Help needed with unicode

[Andreas Tille <andreas@an3as.eu>]

Hi,

the ftpnew gatherer[1] has some mysterious trouble with non-ASCII
characters and the means which proved successful in other cases are
failing here.

For instance when importing this file:

   http://ftp-master.debian.org/new/font-hosny-amiri_0.001-1.html

it results in the following debug output:

UnicodeEncodeError probably in 'Maintainer' or 'Changed-By' field, but should be prevented by to_unicode()
'ascii' codec can't encode characters in position 0-3: ordinal not in range(128) 
{..., 'maintainer_email': u'pkg-fonts-devel@lists.alioth.debian.org', 'Source': u'font-hosny-amiri', 'maintainer_name': u'Debian Fonts Task Force', 'Changed-By': u'\u0623\u062d\u0645\u062f \u0627\u0644\u0645\u062d\u0645\u0648\u062f\u064a (Ahmed El-Mahmoudy) <aelmahmoudy@sabily.org>', 'Maintainer': u'Debian Fonts Task Force <pkg-fonts-devel@lists.alioth.debian.org>', ...}

I wonder whether I missed somthing to enable proper insertion of names featuring
non-ASCII names into UDD.

Thanks for any help

      Andreas.


[1] svn://svn.debian.org/svn/collab-qa/udd/udd/ftpnew_gatherer.py

-- 
http://fam-tille.de