src_prepare/euscan-ng
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
393 Commits 1 Branch 4 Tags 13 MiB
b03541c97d
Commit Graph

32 Commits

Author SHA1 Message Date
Corentin Chary
b03541c97d euscanwww/tasks: ungroup tasks for now, use immutables tasks 
There is a bug in celery preventing (group | group | task)() chains
to work. Was reported but not yet fixed.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-08-07 08:46:05 +02:00
Corentin Chary
62b1fbba4e euscanwww: fix tasks 
- group_one was broken
- new way of calling  consume refresh queries

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-08-03 21:55:59 +02:00
volpino
6178d66f0d euscanwww: removing unused import and PEP8 cleaning 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-29 10:13:17 +02:00
Corentin Chary
6ce658fa0d euscan: stuff 
(yeah, sorry ..)

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-28 11:39:38 +02:00
volpino
31e3dd66d8 euscanwww: Prevent not deterministic QuerySet order when slicing 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-27 11:37:58 +02:00
Corentin Chary
3d6126cf81 djeuscan: run scan_metadata(packages=None, populate=True) 
Scan only additional stuff, not packages.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-24 08:05:12 +02:00
volpino
609eff60ab euscanwww: Launch scan_portage per category like scan_metadata 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-20 14:11:09 +02:00
volpino
7dc322348d euscanwww: PEP8, Cleaning unused imports and removing useless stuff 
* Removed useless use of chords
* populate in scan_metadata is off by default
* fixed group_one and scan_metadata launch
* removed useless utils.py

Signed-off-by: volpino <fox91@anche.no>
 2012-07-20 14:07:16 +02:00
Corentin Chary
2544af2e32 euscanwww/tasks: simplify tasks 
- strip '_task' end
- remove "launcher" functions, if we want complicated starter
  functions we will put them somewhere else later.
- now, everything is asynchroneous, maybe we could switch from
  group_one()/group_chunks() to .chunks() someday...

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-20 08:42:38 +02:00
volpino
03cf3b90a4 euscanwww: Upgraded to Celery 3.0 and fixed scan_portage 
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 18:09:14 +02:00
volpino
3be52a710c euscanwww: Changing RefreshPackageQuery.query to ForeignKey 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:46:35 +02:00
volpino
a6b215cec9 euscanwww: Fixed tasks to work with processing.scan and processing.misc 
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:13:59 +02:00
volpino
145388a5e5 euscanwww: scan_upstream_all_task scans in randomized order 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c euscanwww: reverting removed purge_packages in scan_package_task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:42:26 +02:00
volpino
a83e4de59d euscanwww: user refresh package should not purge packages 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 09:35:31 +02:00
volpino
fc7f929038 euscanwww: Fixed broken tasks 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-29 17:25:45 +02:00
volpino
951624759a euscanwww: Fixing tasks 
Fixing minor bugs in tasks.py and little related stuff

Signed-off-by: volpino <fox91@anche.no>
 2012-06-27 10:15:30 +02:00
volpino
1ae2dcba50 euscanwww: settable options for _run_in_chunks() 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-26 18:31:35 +02:00
volpino
f9c9a4bfd8 euscanwww: added scan_package task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-22 11:40:40 +02:00
volpino
9bfd728d4f euscanwww: Moved business logic to djeuscan.processing 
Moved stuff from management commands to djeuscan.processing

Signed-off-by: volpino <fox91@anche.no>
 2012-06-22 09:32:39 +02:00
volpino
34d3bd714d euscanwww: Watched herds/maintainers/categories panel 
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects

Signed-off-by: volpino <fox91@anche.no>
 2012-06-14 10:03:49 +02:00
volpino
bd971a7da0 euscanwww: When scanning upstream output object was never cleaned 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 14:55:58 +02:00
volpino
bd9af90ff6 euscanwww: Removed useless purge tasks, some error handling 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 13:05:58 +02:00
volpino
4246c544ad euscanwww: bug found, celery timeouts on join. Commented out 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-09 16:12:17 +02:00
volpino
a94a24eeac euscanwww: Refresh query logic and task queue split in chunks 
Added the needed logic for running refresh queries from the web
interface.

Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)

Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:21:11 +02:00
volpino
33555a9fbe euscanwww: Fixed Layman sync task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 16:44:08 +02:00
volpino
8501805f8e euscanwww: Scan tasks recieve a list of packages 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 13:30:31 +02:00
volpino
8ed74a74df euscanwww: Changed Layman sync task to use Python API 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 12:46:22 +02:00
volpino
60e2019cc3 euscanwww: Added tasks for syncing and updating portage tree 
Added these tasks:
 * emerge_sync
 * layman_sync
 * emerge_regen
 * eix_update

Signed-off-by: volpino <fox91@anche.no>
 2012-06-04 11:06:47 +02:00
volpino
5970b4df37 euscanwww: Admin improved and simple task launcher added 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-03 09:43:49 +02:00
volpino
e8718748b4 euscanwww: Celery fixes and little logging 
Signed-off-by: volpino <fox91@anche.no>
 2012-05-31 09:11:40 +02:00
volpino
56c4d79fb2 euscanwww: starting implementing Celery tasks 
Basic tasks.py module, some fixes in the management commands

Signed-off-by: volpino <fox91@anche.no>
 2012-05-30 22:54:55 +02:00