Commit Graph

273 Commits

Author SHA1 Message Date
volpino
03cf3b90a4 euscanwww: Upgraded to Celery 3.0 and fixed scan_portage
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe

Signed-off-by: volpino <fox91@anche.no>
2012-07-07 18:09:14 +02:00
volpino
3be52a710c euscanwww: Changing RefreshPackageQuery.query to ForeignKey
Signed-off-by: volpino <fox91@anche.no>
2012-07-07 15:46:35 +02:00
volpino
a6b215cec9 euscanwww: Fixed tasks to work with processing.scan and processing.misc
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE

Signed-off-by: volpino <fox91@anche.no>
2012-07-07 15:13:59 +02:00
volpino
80e8157627 Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-03 11:13:35 +02:00
Corentin Chary
2f0080e544 git: update .gitignore
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-03 10:57:07 +02:00
Corentin Chary
bdff6b7c63 euscanwww/scan_portage: try using gentoopm and fix slots
gentoopm is still slower with portage backend, will try pkgcore
backend later.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-03 10:56:14 +02:00
Corentin Chary
8062fddc23 euscanwww: move processing to scan and misc, enhance update_portage_tree
update_portage_tree() now:
- watch stderr and stdout for each command
- use layman command instead of layman API for sync because
  layman API doesn't work when stdout or stderr is not a real file
  (we could probably work around that with pipes and epoll)
- use egencache instead of emerge to generate cache
- export PORTAGE_CONFIGROOT, ROOT, EIX_CACHEFILE etc.. so they
  are used everywhere

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 18:16:59 +02:00
volpino
5a2f2e9eab Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-02 17:45:31 +02:00
volpino
6407efa14f euscan: naive implementation of --mirror
Signed-off-by: volpino <fox91@anche.no>
2012-07-02 17:44:55 +02:00
Corentin Chary
90702ddee8 euscan: don't import pkg_resources, we don't want all these warnings
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:20:52 +02:00
Corentin Chary
84a764dad5 euscan: allow --progress with --quiet
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:20:18 +02:00
Corentin Chary
ba805536ad euscanwww: add --category to scan_metadata, remove homepage and description
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:19:49 +02:00
Corentin Chary
0e32ccf46e euscanwww: make it work with MySQL
unique indexes length must be <= 255

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:44:00 +02:00
Corentin Chary
093cb4da47 euscanwww/scan_portage: fixes and add --category
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:43:31 +02:00
Corentin Chary
ad5e399096 euscanwww: move start_dev_services.sh to scripts
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 08:09:06 +02:00
volpino
71f71c5b58 euscanwww: fixed commit_on_success
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 19:21:43 +02:00
volpino
09f0f75a42 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-30 18:37:04 +02:00
volpino
f43ab3ae3d euscanwww: fixing merge
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 18:36:45 +02:00
Corentin Chary
728770088c euscan: don't respect robots.txt for mono download site
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 15:57:56 +02:00
volpino
94b814481b euscanwww: adding elem.clear() to prevent memory leaking in xml parsing
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 11:03:24 +02:00
volpino
145388a5e5 euscanwww: scan_upstream_all_task scans in randomized order
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c euscanwww: reverting removed purge_packages in scan_package_task
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:42:26 +02:00
volpino
c184628f48 Merge branch 'master' of https://github.com/iksaif/euscan
Conflicts:
	euscanwww/djeuscan/processing/scan_portage.py

Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:39:18 +02:00
volpino
0c5a0ac36f euscanwww: Using incremental xml parsing for portage scanning
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:28:03 +02:00
Corentin Chary
9e6f885f89 djeuscan/scan_portage: fix purge-packages and purge-versions
purge-packages: purge package that are not found in the tree
purge-versions: purge versions that are not found in the tree

Also, only purge versions of packages specified on the command line
when called without --all.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 10:19:07 +02:00
volpino
a83e4de59d euscanwww: user refresh package should not purge packages
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 09:35:31 +02:00
volpino
91ccdeb4e7 euscanwww: simple script to start services (only for development)
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 09:01:36 +02:00
Corentin Chary
20f796df60 Merge branch 'master' of git://github.com/volpino/euscan
Conflicts:
	euscanwww/djeuscan/management/commands/scan_upstream.py

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 07:38:26 +02:00
Corentin Chary
e660d93398 euscanwww/scan_upstream: remove --feed
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 07:37:04 +02:00
volpino
fc7f929038 euscanwww: Fixed broken tasks
Signed-off-by: volpino <fox91@anche.no>
2012-06-29 17:25:45 +02:00
volpino
e9c03fbded euscanwww: Fixed CSS stylesheet
Added Twitter Bootstrap and tweaked the layout to use the grid layout

Signed-off-by: volpino <fox91@anche.no>
2012-06-29 14:22:01 +02:00
volpino
d7bf130fda euscan: minor fixes
Signed-off-by: volpino <fox91@anche.no>
2012-06-28 12:43:46 +02:00
volpino
0d6376681f euscan: fixed progressbar
added -p option, now the progressbar is "global" and shows the total
progress

Signed-off-by: volpino <fox91@anche.no>
2012-06-28 12:20:57 +02:00
volpino
b06965f386 euscan: plugin system for handlers
Signed-off-by: volpino <fox91@anche.no>
2012-06-28 11:08:05 +02:00
volpino
951624759a euscanwww: Fixing tasks
Fixing minor bugs in tasks.py and little related stuff

Signed-off-by: volpino <fox91@anche.no>
2012-06-27 10:15:30 +02:00
volpino
1ae2dcba50 euscanwww: settable options for _run_in_chunks()
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:31:35 +02:00
volpino
8fdac1014c euscanwww: Adding infos to EuscanResults
Now we store metadata, output from euscan is cleaned from colors
encoding when outputting json

Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:13:28 +02:00
volpino
699bb372a5 euscanwww: Added README for celery
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:17:35 +02:00
volpino
d7e0a4ca16 euscanwww: Tweaked processing.scan_portage to use eix --xml
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:16:02 +02:00
volpino
f9c9a4bfd8 euscanwww: added scan_package task
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:40:40 +02:00
volpino
779ccdf5d3 euscanwww: use logging in djeuscan.processing
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:31:15 +02:00
volpino
9af5548178 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-22 09:34:11 +02:00
volpino
9bfd728d4f euscanwww: Moved business logic to djeuscan.processing
Moved stuff from management commands to djeuscan.processing

Signed-off-by: volpino <fox91@anche.no>
2012-06-22 09:32:39 +02:00
Corentin Chary
94adc751c1 Merge pull request #17 from mgorny/master
github API support, part I
2012-06-14 07:55:31 -07:00
Michał Górny
a3fe7a21e7 github: return the regular download URL instead. 2012-06-14 12:56:45 +02:00
Michał Górny
5af479fea8 Handle exceptions in scanning loop. 2012-06-14 12:38:52 +02:00
Michał Górny
7cbe517a70 Initial support for github downloads.
Right now, it just handles ebuilds using mirror://github.
2012-06-14 12:34:39 +02:00
volpino
6cc892717b Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-14 10:21:37 +02:00
volpino
11c8422c9b euscanwww: Reset password
Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:21:01 +02:00
volpino
34d3bd714d euscanwww: Watched herds/maintainers/categories panel
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects

Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:03:49 +02:00