Re: [GSoC] Reg Blends Web Sentinel

[Andreas Tille <andreas@an3as.eu>]

Hi Akshita,

thanks for working on this even before GSoC has started.  That is a
clear sign for me that you are really honest about the task and a very
good way to prepare yourself.

On Thu, Mar 05, 2015 at 11:51:51AM +0530, Akshita Jha wrote:
> > Traceback (most recent call last):
> >   File "./bugs_udd.py", line 476, in <module>
> >     main()
> >   File "./bugs_udd.py", line 453, in main
> >     print >> f, template.generate(**data).render('xhtml')
> > UnicodeEncodeError: 'ascii' codec can't encode character u'\xed' in
> > position 22128: ordinal not in range(128)Akshita Jha
> 
> I've sent a patch fixing the above error. Now, when I run './bugs_udd.py
> debian-junior', I do not get any error message. But I am not sure how else
> to test it, in case some other issue has cropped up. How do we check that ?
> Can you please have a look at it and let me know in case of any issue?

I confirm that the problem vanished for debian-junior which is a big
step forward.  The fix was also obviously simple (and in turn a sign for
you that my Python experience - specifically if it comes to encoding
issues) is poorer than I would like it to be. :-)

However we have now a remaining problem:

   bugs_udd.py debian-games

Traceback (most recent call last):
  File "./bugs_udd.py", line 476, in <module>
    main()
  File "./bugs_udd.py", line 471, in main
    print >> f, template.generate(**data).render('xhtml')
  File "/usr/lib/python2.7/dist-packages/genshi/core.py", line 184, in render
    return encode(generator, method=method, encoding=encoding, out=out)
  File "/usr/lib/python2.7/dist-packages/genshi/output.py", line 57, in encode
    return _encode(''.join(list(iterator)))
  File "/usr/lib/python2.7/dist-packages/genshi/output.py", line 350, in __call__
    for kind, data, pos in stream:
  File "/usr/lib/python2.7/dist-packages/genshi/output.py", line 669, in __call__
    for kind, data, pos in stream:
  File "/usr/lib/python2.7/dist-packages/genshi/output.py", line 786, in __call__
    text = escape(pop_text(), quotes=False)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 188: ordinal not in range(128)


If there is a similarly simple solution this would be really great.


If we are really lucky this will also help in the next annoying
case:

   tasks-py debian-med
Traceback (most recent call last):
  File "./tasks.py", line 181, in <module>
    print >> f, template.generate(**data).render('xhtml')
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe4' in position 1274: ordinal not in range(128)

The problem here is that it is hard to debug the Genshi stuff - at least
I did not yet found a sensible way to track down what part of the input
is causing the problem.


Thanks a lot for your work on this

      Andreas.


-- 
http://fam-tille.de