Corentin Chary
2bd012ef82
euscanwww: show maintainer name and email
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:34:54 +01:00
Corentin Chary
b78e73038d
euscan: add kde handler and fix some regex issues
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:34:39 +01:00
Corentin Chary
d673c00e12
euscan: update TODO list
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:33:27 +01:00
Corentin Chary
fef31c514c
euscan: respect --quiet in pypi handler
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-12 15:15:00 +01:00
Corentin Chary
0e6c18b84b
euscanwww: clean settings
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-11 14:32:55 +01:00
Corentin Chary
3569f1bb97
euscan: better --quiet mode
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-11 14:32:38 +01:00
Corentin Chary
e71e540d0d
euscan: 0.1.0
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-27 22:21:01 +01:00
Corentin Chary
a11bfdc54f
euscan: fix a bug with htop versions
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-27 16:25:44 +01:00
Corentin Chary
7ff26556d1
euscan: add basic overlay support
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-23 18:03:07 +01:00
Corentin Chary
164b427219
euscanwww/api: handle 404 correctly
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:48:47 +01:00
Corentin Chary
0ae3305a64
euscanwww/api: clean and "document" euscan API
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:37:59 +01:00
Corentin Chary
204c53b66f
euscanwww/api: remove traces
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:11:02 +01:00
Corentin Chary
0d5e1e0901
euscanwww: add basic json/xml API
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:06:48 +01:00
Corentin Chary
5b2476c9a0
euscanwww: cleanups, drop stupid API
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 17:08:29 +01:00
Corentin Chary
66e20ebc26
euscanwww: enable admin
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:56:20 +01:00
Corentin Chary
a1bdde6a95
euscanwww: import local_settings and add postgres example
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:43:18 +01:00
Corentin Chary
f3363c52f9
euscan: update TODO
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-10 17:46:40 +01:00
Corentin Chary
57ed9251e8
euscan: add README, TODO and some scripts
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-10 14:07:53 +01:00
Corentin Chary
8be69f2350
euscan: show a trace when blocked by robots.txt
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:48 +02:00
Corentin Chary
739358cf7c
euscan: really skip all dev versions
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:25 +02:00
Corentin Chary
277fb4ebe6
euscan: add new robots.txt exceptions
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-08 08:33:03 +02:00
Corentin Chary
d7f655cdde
euscan: add an optional persistent cache
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-02 10:04:44 +02:00
Corentin Chary
7f56dd4ac4
euscan: fix a stupid bug
...
finally is always called, so the list was always empty.
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-10-02 10:03:49 +02:00
Corentin Chary
0ad1eecca7
euscanwww: chmod +x manage.py
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:47 +02:00
Corentin Chary
96775215fa
euscanwww/scripts: sync with prod
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:15 +02:00
Corentin Chary
1d8e87482f
euscanwww: remove progress stuff
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:10:56 +02:00
Corentin Chary
7fb4e6edff
euscan: better output
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:58:41 +02:00
Corentin Chary
a13d593d8d
euscanwww: remove unused gchartwrapper
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:48:32 +02:00
Corentin Chary
1bd42f303d
euscanwww: add some json
...
This is not a real API, I will break it !
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:12:01 +02:00
Corentin Chary
14971584af
euscan: robots.txt, timeout, user-agent, ...
...
- Add a blacklist for robots.txt, we *want* to scan sourceforge
- Set a user-agent that doesn't looks like a browser
- Handle timeouts more carefully
- If brute force detect too much versions, avoid infinite loops
- Handle redirections more carefully
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:09:50 +02:00
Corentin Chary
8c40a1795c
euscan: blacklist art.gnome.org
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-10 08:25:39 +02:00
Corentin Chary
9da62b211b
euscan: fix some robots.txt issues
...
- disable checks for ftp
- fail silently
- use einfo and not eerror
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-10 08:23:46 +02:00
Corentin Chary
c5af0e1937
euscan: don't mix spaces and tabs
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 17:35:17 +02:00
Corentin Chary
2210b2610d
euscan: don't get robots.txt on ftp
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 17:34:50 +02:00
Corentin Chary
a137ef60e3
euscan: respect robots.txt
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 16:32:29 +02:00
Corentin Chary
bd75e1af4e
euscan/helpers: use HEAD in tryurl
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 15:47:54 +02:00
Corentin Chary
454d369ced
euscan/handlers: fix resursive brute force in generic handler
...
component was modified by the function since it's a reference,
do an explicit copy to fix that.
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 15:47:00 +02:00
Corentin Chary
1fae084566
euscanwwww: delete packaded versions, not upstream
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 11:31:27 +02:00
Corentin Chary
6a10041300
euscanwww/templates: save datatable state
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 09:18:20 +02:00
Corentin Chary
8dc19b9856
euscan: fix some errors
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 09:17:08 +02:00
Corentin Chary
833f1253a1
euscanwww/templates: add appropriate copyrights
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 09:16:21 +02:00
Corentin Chary
752fb04425
euscan: shake the code
...
- add custom site handlers
- use a custom user agent
- fix some bugs in management commands
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-31 15:38:32 +02:00
Corentin Chary
5634c59944
euscan: better blacklists
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 13:20:40 +02:00
Corentin Chary
a5cf338905
euscanwww/templates: add anchors to versions
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:22:17 +02:00
Corentin Chary
70ac94474e
euscanwww/views: remove old FIXME
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:22:04 +02:00
Corentin Chary
9507d5ac4b
euscanwww: enable caching
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:21:37 +02:00
Corentin Chary
4b25e2744b
euscan: update TODO
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:21:11 +02:00
Corentin Chary
45ca837908
euscanwww/feed: tweak feeds
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 10:45:46 +02:00
Corentin Chary
60bc61275e
euscanwww: fix urls
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-26 13:27:46 +02:00
Corentin Chary
42a2b61f55
templates: fix feed link
...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-25 16:22:20 +02:00