Bug#944902: ITP: python-protego -- pure-Python robots.txt parser with support for modern conventions

[Andrey Rahmatullin <wrar@debian.org>]

Package: wnpp
Severity: wishlist
Owner: Andrey Rahmatullin <wrar@debian.org>

* Package name    : python-protego
  Version         : 0.1.15
  Upstream Author : Anubhav Patel <anubhavp28@gmail.com> et al.
* URL             : https://github.com/scrapy/protego
* License         : BSD-3
  Programming Lang: Python
  Description     : pure-Python robots.txt parser with support for modern
conventions

This is a Python module that parses robots.txt files.

It is a dependency of python-scrapy 1.8+.