Corentin Chary 634e06b779 euscan: don't fail if robots.txt can't be read ... Signed-off-by: Corentin Chary <corentin.chary@gmail.com>		2012-07-20 08:41:13 +02:00
..
euscan	euscan: don't fail if robots.txt can't be read	2012-07-20 08:41:13 +02:00