Commit Graph

289 Commits

Author SHA1 Message Date
volpino
951624759a euscanwww: Fixing tasks
Fixing minor bugs in tasks.py and little related stuff

Signed-off-by: volpino <fox91@anche.no>
2012-06-27 10:15:30 +02:00
volpino
1ae2dcba50 euscanwww: settable options for _run_in_chunks()
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:31:35 +02:00
volpino
8fdac1014c euscanwww: Adding infos to EuscanResults
Now we store metadata, output from euscan is cleaned from colors
encoding when outputting json

Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:13:28 +02:00
volpino
699bb372a5 euscanwww: Added README for celery
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:17:35 +02:00
volpino
d7e0a4ca16 euscanwww: Tweaked processing.scan_portage to use eix --xml
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:16:02 +02:00
volpino
f9c9a4bfd8 euscanwww: added scan_package task
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:40:40 +02:00
volpino
779ccdf5d3 euscanwww: use logging in djeuscan.processing
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:31:15 +02:00
volpino
9af5548178 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-22 09:34:11 +02:00
volpino
9bfd728d4f euscanwww: Moved business logic to djeuscan.processing
Moved stuff from management commands to djeuscan.processing

Signed-off-by: volpino <fox91@anche.no>
2012-06-22 09:32:39 +02:00
Corentin Chary
94adc751c1 Merge pull request #17 from mgorny/master
github API support, part I
2012-06-14 07:55:31 -07:00
Michał Górny
a3fe7a21e7 github: return the regular download URL instead. 2012-06-14 12:56:45 +02:00
Michał Górny
5af479fea8 Handle exceptions in scanning loop. 2012-06-14 12:38:52 +02:00
Michał Górny
7cbe517a70 Initial support for github downloads.
Right now, it just handles ebuilds using mirror://github.
2012-06-14 12:34:39 +02:00
volpino
6cc892717b Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-14 10:21:37 +02:00
volpino
11c8422c9b euscanwww: Reset password
Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:21:01 +02:00
volpino
34d3bd714d euscanwww: Watched herds/maintainers/categories panel
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects

Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:03:49 +02:00
volpino
11c234f7f7 euscanwww: Added account profile page
* Added an account profile page
* Added a button to favourite packages
* Implemented models to favourite categories, herds, maintainers but
  still to implement

Signed-off-by: volpino <fox91@anche.no>
2012-06-12 15:27:28 +02:00
volpino
bd971a7da0 euscanwww: When scanning upstream output object was never cleaned
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 14:55:58 +02:00
volpino
7367596e33 euscanwww: Added LDAP login
Needs testing and the settings must be changed to use the gentoo ldap
server

Signed-off-by: volpino <fox91@anche.no>
2012-06-12 13:39:05 +02:00
volpino
bd9af90ff6 euscanwww: Removed useless purge tasks, some error handling
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 13:05:58 +02:00
Corentin Chary
8f1668b51e Merge pull request #16 from radhermit/bs4
add support for Beautiful Soup 4
2012-06-11 00:03:07 -07:00
volpino
d34a0c4992 euscanwww: included django-registration and tweaked templates
Signed-off-by: volpino <fox91@anche.no>
2012-06-09 17:12:09 +02:00
volpino
4246c544ad euscanwww: bug found, celery timeouts on join. Commented out
Signed-off-by: volpino <fox91@anche.no>
2012-06-09 16:12:17 +02:00
volpino
9cddc82808 Merge branch 'master' of https://github.com/iksaif/euscan
Conflicts:
	euscanwww/djeuscan/models.py

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:46:37 +02:00
volpino
b43bf8fa28 euscanwww: Removing duplicated code
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:43:18 +02:00
volpino
43e996d83d euscanwww: Fixed the upstream task that was completely broken
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:24:17 +02:00
volpino
a6a87260b1 euscanwww: Fixed a minor bug in the task launching interface
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:23:37 +02:00
volpino
a94a24eeac euscanwww: Refresh query logic and task queue split in chunks
Added the needed logic for running refresh queries from the web
interface.

Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:21:11 +02:00
volpino
8913f826de euscanwww: Added RefreshPackageQuery to models
Allows storing queries for refresh requests by users

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:19:20 +02:00
Tim Harder
5df28b028e add support for Beautiful Soup 4 2012-06-08 00:18:59 -07:00
volpino
33555a9fbe euscanwww: Fixed Layman sync task
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 16:44:08 +02:00
volpino
8501805f8e euscanwww: Scan tasks recieve a list of packages
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:30:31 +02:00
volpino
4a9301a215 euscanwww: naive implementation of the refresh button
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww

Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:10:25 +02:00
volpino
8ed74a74df euscanwww: Changed Layman sync task to use Python API
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 12:46:22 +02:00
volpino
c41521d59f euscanwww: Admin interface tweaks
Added some search fields, ordering and filters to the admin panel

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:27:18 +02:00
volpino
60e2019cc3 euscanwww: Added tasks for syncing and updating portage tree
Added these tasks:
 * emerge_sync
 * layman_sync
 * emerge_regen
 * eix_update

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:06:47 +02:00
Corentin Chary
5b1884ead7 djeuscan: fix alive / packaged updates
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-04 10:28:06 +02:00
volpino
2edb220d3e euscanwww: use jQuery each instead of for
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 17:38:51 +02:00
volpino
5970b4df37 euscanwww: Admin improved and simple task launcher added
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 09:43:49 +02:00
volpino
47ec539e1d euscanwww: scan_upstream imports euscan.scan
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess

Signed-off-by: volpino <fox91@anche.no>
2012-05-31 18:42:37 +02:00
volpino
e8718748b4 euscanwww: Celery fixes and little logging
Signed-off-by: volpino <fox91@anche.no>
2012-05-31 09:11:40 +02:00
volpino
56c4d79fb2 euscanwww: starting implementing Celery tasks
Basic tasks.py module, some fixes in the management commands

Signed-off-by: volpino <fox91@anche.no>
2012-05-30 22:54:55 +02:00
Corentin Chary
83f5df4daf euscanwww: fix the scan process
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-29 15:29:03 +02:00
Corentin Chary
f0a3c34ac8 Merge remote branch 'fox/master' 2012-05-29 09:21:44 +02:00
volpino
c36f625a54 euscanwww: fixing colored output
Signed-off-by: volpino <fox91@anche.no>
2012-05-28 23:24:09 +02:00
volpino
fce8ef347b euscanwww: management commands are validators aware
Management commands should create objects that don't raise
ValidationError

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 22:57:33 +02:00
volpino
b46e9acc08 euscan: Refactored all management commands
Management commands are refactored to have the logic moved from the
commands themselves to a separated function in order to make them easily
convertible into Celery tasks

Commands are renamed to be modules importable from other python scripts

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 21:19:53 +02:00
volpino
e535c204b0 euscanwww: fixed homepage and category validation
Accept multiple urls but skip invalid urls, added virtual as accepted
category

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 18:45:14 +02:00
Corentin Chary
3437cf5e4b euscan: cleanups
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-28 07:02:41 +02:00
volpino
a224cb27cb euscan: naive progressbar implementation
Progressbar for formatted output

Signed-off-by: volpino <fox91@anche.no>
2012-05-27 10:23:15 +02:00