Commit Graph

562 Commits

Author SHA1 Message Date
Corentin Chary
ff33042f36 euscanwww: add freshness and last versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 18:01:46 +01:00
Corentin Chary
d899ffb849 euscanwww: add a snapshot and some steps when importing snapshots
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 14:27:21 +01:00
Corentin Chary
d6f3b6629c euscanwww: take args from stdin and update INSTALL
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 14:08:28 +01:00
Corentin Chary
329b20fecf euscan/rubygem: better gem detection
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 13:54:23 +01:00
Corentin Chary
b6821903a6 euscanwww/INSTALL: basic intructions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 13:54:00 +01:00
Corentin Chary
df1d778365 euscan: add a quick /_rc/-rc/ hack
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-20 08:21:07 +01:00
Corentin Chary
5bd358968a euscan: re-indent blacklists
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-20 08:20:54 +01:00
Corentin Chary
b0664564f3 euscan: update TODO and euscan-update.sh
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:55:11 +01:00
Corentin Chary
8190779070 euscan: remove a line
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:54:34 +01:00
Corentin Chary
bdd6040c12 euscanwww: remove csrf and add request processor
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:54:05 +01:00
Corentin Chary
9e47ceb311 euscanwww/templates: add some "extras"
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:53:33 +01:00
Corentin Chary
31af7ae416 euscan: add new related tool to TODO
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-01-21 09:32:36 +01:00
Corentin Chary
2d81d0a0be euscan: change download url
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-01-18 08:13:41 +01:00
Corentin Chary
333c535230 euscan: fix man page installation
ref: https://bugs.gentoo.org/show_bug.cgi?id=398873

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-01-16 14:15:50 +01:00
Corentin Chary
72e43ac4fe euscan: tweak error paths
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-01-02 21:31:05 +01:00
Corentin Chary
2bd012ef82 euscanwww: show maintainer name and email
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:34:54 +01:00
Corentin Chary
b78e73038d euscan: add kde handler and fix some regex issues
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:34:39 +01:00
Corentin Chary
d673c00e12 euscan: update TODO list
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:33:27 +01:00
Corentin Chary
fef31c514c euscan: respect --quiet in pypi handler
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-12 15:15:00 +01:00
Corentin Chary
0e6c18b84b euscanwww: clean settings
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-11 14:32:55 +01:00
Corentin Chary
3569f1bb97 euscan: better --quiet mode
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-11 14:32:38 +01:00
Corentin Chary
e71e540d0d euscan: 0.1.0
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-27 22:21:01 +01:00
Corentin Chary
a11bfdc54f euscan: fix a bug with htop versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-27 16:25:44 +01:00
Corentin Chary
7ff26556d1 euscan: add basic overlay support
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-23 18:03:07 +01:00
Corentin Chary
164b427219 euscanwww/api: handle 404 correctly
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:48:47 +01:00
Corentin Chary
0ae3305a64 euscanwww/api: clean and "document" euscan API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:37:59 +01:00
Corentin Chary
204c53b66f euscanwww/api: remove traces
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:11:02 +01:00
Corentin Chary
0d5e1e0901 euscanwww: add basic json/xml API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:06:48 +01:00
Corentin Chary
5b2476c9a0 euscanwww: cleanups, drop stupid API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 17:08:29 +01:00
Corentin Chary
66e20ebc26 euscanwww: enable admin
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:56:20 +01:00
Corentin Chary
a1bdde6a95 euscanwww: import local_settings and add postgres example
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:43:18 +01:00
Corentin Chary
f3363c52f9 euscan: update TODO
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-10 17:46:40 +01:00
Corentin Chary
57ed9251e8 euscan: add README, TODO and some scripts
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-10 14:07:53 +01:00
Corentin Chary
8be69f2350 euscan: show a trace when blocked by robots.txt
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:48 +02:00
Corentin Chary
739358cf7c euscan: really skip all dev versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:25 +02:00
Corentin Chary
277fb4ebe6 euscan: add new robots.txt exceptions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:03 +02:00
Corentin Chary
d7f655cdde euscan: add an optional persistent cache
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-02 10:04:44 +02:00
Corentin Chary
7f56dd4ac4 euscan: fix a stupid bug
finally is always called, so the list was always empty.

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-02 10:03:49 +02:00
Corentin Chary
0ad1eecca7 euscanwww: chmod +x manage.py
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:47 +02:00
Corentin Chary
96775215fa euscanwww/scripts: sync with prod
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:15 +02:00
Corentin Chary
1d8e87482f euscanwww: remove progress stuff
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:10:56 +02:00
Corentin Chary
7fb4e6edff euscan: better output
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:58:41 +02:00
Corentin Chary
a13d593d8d euscanwww: remove unused gchartwrapper
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:48:32 +02:00
Corentin Chary
1bd42f303d euscanwww: add some json
This is not a real API, I will break it !

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:12:01 +02:00
Corentin Chary
14971584af euscan: robots.txt, timeout, user-agent, ...
- Add a blacklist for robots.txt, we *want* to scan sourceforge
- Set a user-agent that doesn't looks like a browser
- Handle timeouts more carefully
- If brute force detect too much versions, avoid infinite loops
- Handle redirections more carefully

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:09:50 +02:00
Corentin Chary
8c40a1795c euscan: blacklist art.gnome.org
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-10 08:25:39 +02:00
Corentin Chary
9da62b211b euscan: fix some robots.txt issues
- disable checks for ftp
- fail silently
- use einfo and not eerror

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-10 08:23:46 +02:00
Corentin Chary
c5af0e1937 euscan: don't mix spaces and tabs
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 17:35:17 +02:00
Corentin Chary
2210b2610d euscan: don't get robots.txt on ftp
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 17:34:50 +02:00
Corentin Chary
a137ef60e3 euscan: respect robots.txt
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 16:32:29 +02:00