src_prepare/euscan-ng
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
558 Commits 1 Branch 4 Tags 13 MiB
fff319bd8b
Commit Graph

27 Commits

Author SHA1 Message Date
Bernard Cafarelli
b25c66e9ab
Update some blacklists 
Also fix blacklist log message
 2019-12-05 19:03:49 +01:00
Bernard Cafarelli
94c3eeba49
Initial python3 compatibility 2019-12-05 17:46:19 +01:00
Corentin Chary
e42ba7dfd0 djeuscan: rework the scan process, don't use alive anymore 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-12-12 22:54:50 +01:00
volpino
60deecd853 euscan: Adding support for disabling handlers 
Signed-off-by: volpino <fox91@anche.no>
 2012-10-29 13:06:02 +01:00
Corentin Chary
9afb31fc65 euscan: fix #435118 and #435120 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-09-15 23:21:30 +02:00
volpino
2019b245e8 euscan: Adding config file support 
Signed-off-by: volpino <fox91@anche.no>
 2012-09-02 18:58:01 +02:00
Corentin Chary
28b913295a euscan: ignore robots.txt for fedorahosted.org 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-25 17:04:37 +02:00
Corentin Chary
bcda1a7ce3 euscan: add --ebuild-uri to use ${PV}, etc. 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-20 08:41:12 +02:00
volpino
33a06d99fb euscan: added --ignore-pre-release and --ignore-pre-release-if-stable 
options

Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 12:27:22 +02:00
volpino
6407efa14f euscan: naive implementation of --mirror 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-02 17:44:55 +02:00
Corentin Chary
728770088c euscan: don't respect robots.txt for mono download site 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-06-30 15:57:56 +02:00
volpino
0d6376681f euscan: fixed progressbar 
added -p option, now the progressbar is "global" and shows the total
progress

Signed-off-by: volpino <fox91@anche.no>
 2012-06-28 12:20:57 +02:00
volpino
47ec539e1d euscanwww: scan_upstream imports euscan.scan 
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess

Signed-off-by: volpino <fox91@anche.no>
 2012-05-31 18:42:37 +02:00
Corentin Chary
305fdea0c7 euscan: make eend works again 
Simplify einfo/ewarn/eend handling (for now) and make "message" someting
containing only what stdout would contain. We loose some informations, but
I'm really not sure we need more.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-05-25 00:19:17 +02:00
volpino
9989433ad5 euscan: detect version type 
In the formatted output display the version type (beta, alpha, rc, ...)

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 23:08:07 +02:00
volpino
1efeee4134 euscan: added simple support to result confidence 
Confidence values are meaningless at the moment. Need to fix it.

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 16:44:44 +02:00
volpino
a18083bd98 euscan: json format output 
Now "-f json" seems good, it supports the handler type used to retrieve
each version and outputs metadata.

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 16:30:43 +02:00
volpino
8cb19b5a6b euscan: adding json output 
Naive json output implmented, probably needs some further tuning

Signed-off-by: volpino <fox91@anche.no>
 2012-05-21 22:38:38 +02:00
volpino
8c91855a58 Lovely day for PEP8 and pylint! 2012-04-28 18:16:05 +02:00
Corentin Chary
6a57b44d7c euscan: force nodejs.org scan 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2012-04-04 14:34:09 +02:00
Corentin Chary
5bd358968a euscan: re-indent blacklists 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2012-02-20 08:20:54 +01:00
Corentin Chary
277fb4ebe6 euscan: add new robots.txt exceptions 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-10-08 08:33:03 +02:00
Corentin Chary
d7f655cdde euscan: add an optional persistent cache 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-10-02 10:04:44 +02:00
Corentin Chary
14971584af euscan: robots.txt, timeout, user-agent, ... 
- Add a blacklist for robots.txt, we *want* to scan sourceforge
- Set a user-agent that doesn't looks like a browser
- Handle timeouts more carefully
- If brute force detect too much versions, avoid infinite loops
- Handle redirections more carefully

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-09-21 10:09:50 +02:00
Corentin Chary
8c40a1795c euscan: blacklist art.gnome.org 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-09-10 08:25:39 +02:00
Corentin Chary
a137ef60e3 euscan: respect robots.txt 
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-09-06 16:32:29 +02:00
Corentin Chary
752fb04425 euscan: shake the code 
- add custom site handlers
- use a custom user agent
- fix some bugs in management commands

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
 2011-08-31 15:38:32 +02:00