Re: [GSoC] Adding information to UDD and inject the rendering to tasks,py

On Mon, Apr 13, 2015 at 1:58 AM, Akshita Jha <zenith158@gmail.com> wrote:

Hi,

On Mon, Apr 13, 2015 at 12:12 AM, Andreas Tille <andreas@an3as.eu> wrote:
Hi,

On Sun, Apr 12, 2015 at 07:23:40PM +0530, Akshita Jha wrote:
> >
> > Could you please check the files in
> >
> > /srv/udd.debian.org/mirrors/machine-readable
> >
> > It smells as if something would be broken there. I do not run into this
> > error.
> >
>
> I can't seem to get rid of the errors. There are no 0 sized files in "/srv/
> udd.debian.org/mirrors/machine-readable". Do you have any idea how else
> can I verify what the issue is ?

Could you try to add some debug output to check what actual package is
parsed when the error occures.

The 'license' keyerror :

File "/srv/udd.debian.org/udd//udd.py", line 86, in <module>
exec "gatherer.%s()" % command
File "<string>", line 1, in <module>
File "/srv/udd.debian.org/udd/udd/blends_prospective_gatherer.py", line 313, in run
if sprosp['license'] == '':
KeyError: 'license'

occurs in the code below. To solve the error, I used 'in' as suggested by Petter Reinholdtsen (highlighted):

# make sure we get a component field in any case even if section field is missing
sprosp['component'] = ''
for prop in ('homepage', 'priority', 'section', 'uploaders', ):
if src.has_key(prop):
if prop == 'section':
if src['section'].startswith('non-free'):
sprosp['component'] = 'non-free'
(dummy,sprosp['section']) = src['section'].split('/')
if 'license' not in sprosp :
print "SOURCE 1: ",upath, source
sprosp['license'] = 'free'
if sprosp['license'] == '':
sprosp['license'] = 'free'
elif src['section'].startswith('contrib'):
sprosp['component'] = 'contrib'
(dummy,sprosp['section']) = src['section'].split('/')
if 'license' not in sprosp :
print "SOURCE 2: ",upath, source
sprosp['license'] = 'free'
if sprosp['license'] == '':
sprosp['license'] = 'free'
else:
sprosp['component'] = 'main'
sprosp['section'] = src['section']
if 'license' not in sprosp :
print "SOURCE 3: ",upath, source
sprosp['license'] = 'free'
if sprosp['license'] == '':
sprosp['license'] = 'free'
else:
sprosp[prop] = src[prop]
else:
sprosp[prop] = ''
if prop != 'uploaders':
self.log.warning("Control file for source '%s' of %s is lacking %s field" % (source, sprosp['blend'], prop))
else:
self.log.debug("Control file for source '%s' of %s is lacking %s field" % (source, sprosp['blend'], prop))

'license' keyerror arises for the files in /srv/udd.debian.org/mirrors/machine-readable/ folders:
'4', '7', a', 'b', 'c', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p', 'q', 'r', 's', 't', 'v', 'y','z'
PFA the output file containing all the sources having 'license' keyerror.

The 'source' keyerror arises for the first time for:
/srv/udd.debian.org/mirrors/machine-readable/w wineasio

Error while inserting packages 'source'
Traceback (most recent call last):
File "/srv/udd.debian.org/udd//udd.py", line 86, in <module>
exec "gatherer.%s()" % command
File "<string>", line 1, in <module>
File "/srv/udd.debian.org/udd/udd/blends_prospective_gatherer.py", line 411, in run
cur.executemany(pkgquery, pkgs)
KeyError: 'source'

Thanks,
Akshita

Akshita Jha