Corentin Chary 8be69f2350 euscan: show a trace when blocked by robots.txt ...

Signed-off-by: Corentin Chary <corentincj@iksaif.net>

2011-10-08 08:33:48 +02:00

..

handlers

euscan: robots.txt, timeout, user-agent, ...

2011-09-21 10:09:50 +02:00

__init__.py

euscan: add new robots.txt exceptions

2011-10-08 08:33:03 +02:00

helpers.py

euscan: show a trace when blocked by robots.txt

2011-10-08 08:33:48 +02:00

scan.py

euscan: really skip all dev versions

2011-10-08 08:33:25 +02:00