Bug#963903: 'ftpnew-blends' importer crashing. disabled.

[Andreas Tille <tille@debian.org>]

Control: tags -1 unreproducible

Hi Lucas,

On Sun, Jun 28, 2020 at 06:01:33PM +0200, Lucas Nussbaum wrote:
> Traceback (most recent call last):
>   File "/srv/udd.debian.org/udd//udd.py", line 88, in <module>
>     exec "gatherer.%s()" % command
>   File "<string>", line 1, in <module>
>   File "/srv/udd.debian.org/udd/udd/blends_prospective_gatherer.py", line 407, in run
>     upstream = upstream_reader(ufile, source, self.log, sprosp['blend'])
>   File "/srv/udd.debian.org/udd/udd/upstream_reader.py", line 126, in __init__
>     self.fields = yaml.safe_load(uf.read())
>   File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 93, in safe_load
>     return load(stream, SafeLoader)
>   File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 71, in load
>     return loader.get_single_data()
>   File "/usr/lib/python2.7/dist-packages/yaml/constructor.py", line 37, in get_single_data
>     node = self.get_single_node()
>   File "/usr/lib/python2.7/dist-packages/yaml/composer.py", line 43, in get_single_node
>     event.start_mark)
> yaml.composer.ComposerError: expected a single document in the stream
>   in "<string>", line 1, column 1:
>     Reference:
>     ^
> but found another document
>   in "<string>", line 21, column 1:
>     ---
>     ^

I've tested the importer and can not reproduce this.  May be there is a
broken yaml file included in some just accepted package.  The importer
is catching several of those errors and usually runs smoothly.

Am I understanding you correctly that you deactivated ftpnew gatherer?
If yes, I think it can be activated again and I try to keep a close eye
the next couple of days.  In case you realise such issue in the future
it could be a good idea to keep a copy of
    /srv/udd.debian.org/mirrors/ftpnew
somewhere to have the actual data that really caused the crash.

Kind regards and thanks a lot for caring for UDD

     Andreas.

-- 
http://fam-tille.de