Corentin Chary 9da62b211b euscan: fix some robots.txt issues ...

- disable checks for ftp
- fail silently
- use einfo and not eerror

Signed-off-by: Corentin Chary <corentincj@iksaif.net>

2011-09-10 08:23:46 +02:00

..

handlers

euscan: respect robots.txt

2011-09-06 16:32:29 +02:00

__init__.py

euscan: respect robots.txt

2011-09-06 16:32:29 +02:00

helpers.py

euscan: fix some robots.txt issues

2011-09-10 08:23:46 +02:00

scan.py

euscan: don't mix spaces and tabs

2011-09-06 17:35:17 +02:00