Package: wnpp Severity: wishlist Owner: Andrey Rahmatullin <[email protected]>
* Package name : python-protego Version : 0.1.15 Upstream Author : Anubhav Patel <[email protected]> et al. * URL : https://github.com/scrapy/protego * License : BSD-3 Programming Lang: Python Description : pure-Python robots.txt parser with support for modern conventions This is a Python module that parses robots.txt files. It is a dependency of python-scrapy 1.8+.
