euscan-ng/pym/euscan
Corentin Chary 8be69f2350 euscan: show a trace when blocked by robots.txt
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:48 +02:00
..
handlers euscan: robots.txt, timeout, user-agent, ... 2011-09-21 10:09:50 +02:00
__init__.py euscan: add new robots.txt exceptions 2011-10-08 08:33:03 +02:00
helpers.py euscan: show a trace when blocked by robots.txt 2011-10-08 08:33:48 +02:00
scan.py euscan: really skip all dev versions 2011-10-08 08:33:25 +02:00