Bug#944902: ITP: python-protego -- pure-Python robots.txt parser with support for modern conventions
Package: wnpp
Severity: wishlist
Owner: Andrey Rahmatullin <wrar@debian.org>
* Package name : python-protego
Version : 0.1.15
Upstream Author : Anubhav Patel <anubhavp28@gmail.com> et al.
* URL : https://github.com/scrapy/protego
* License : BSD-3
Programming Lang: Python
Description : pure-Python robots.txt parser with support for modern
conventions
This is a Python module that parses robots.txt files.
It is a dependency of python-scrapy 1.8+.
Reply to: