14971584af
- Add a blacklist for robots.txt, we *want* to scan sourceforge - Set a user-agent that doesn't looks like a browser - Handle timeouts more carefully - If brute force detect too much versions, avoid infinite loops - Handle redirections more carefully Signed-off-by: Corentin Chary <corentincj@iksaif.net>
24 lines
571 B
Plaintext
24 lines
571 B
Plaintext
TODO
|
|
====
|
|
|
|
euscan
|
|
------
|
|
|
|
- check other distros (youri)
|
|
|
|
Site Handlers
|
|
-------------
|
|
|
|
- sourceforge: http://sourceforge.net/api/file/index/project-name/vboxgtk/mtime/desc/limit/20/rss http://sourceforge.net/api/release/index/project-id/264534/rss
|
|
- ftp.kde.org: doesn't scan the "unstable" tree
|
|
- mysql: should use http://downloads.mysql.com/archives/
|
|
- mariadb: should use http://downloads.askmonty.org/MariaDB/+releases/
|
|
|
|
euscanwww
|
|
---------
|
|
|
|
- add progress options for each command
|
|
- add last scan in the footer
|
|
- add json/xml for each page
|
|
- rss scan world + post ?
|