euscan-ng/pym
Corentin Chary 634e06b779 euscan: don't fail if robots.txt can't be read
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 08:41:13 +02:00
..
euscan euscan: don't fail if robots.txt can't be read 2012-07-20 08:41:13 +02:00