Commit Graph

512 Commits

Author SHA1 Message Date
volpino
a94a24eeac euscanwww: Refresh query logic and task queue split in chunks
Added the needed logic for running refresh queries from the web
interface.

Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:21:11 +02:00
volpino
8913f826de euscanwww: Added RefreshPackageQuery to models
Allows storing queries for refresh requests by users

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:19:20 +02:00
Tim Harder
5df28b028e add support for Beautiful Soup 4 2012-06-08 00:18:59 -07:00
volpino
33555a9fbe euscanwww: Fixed Layman sync task
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 16:44:08 +02:00
volpino
8501805f8e euscanwww: Scan tasks recieve a list of packages
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:30:31 +02:00
volpino
4a9301a215 euscanwww: naive implementation of the refresh button
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww

Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:10:25 +02:00
volpino
8ed74a74df euscanwww: Changed Layman sync task to use Python API
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 12:46:22 +02:00
volpino
c41521d59f euscanwww: Admin interface tweaks
Added some search fields, ordering and filters to the admin panel

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:27:18 +02:00
volpino
60e2019cc3 euscanwww: Added tasks for syncing and updating portage tree
Added these tasks:
 * emerge_sync
 * layman_sync
 * emerge_regen
 * eix_update

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:06:47 +02:00
Corentin Chary
5b1884ead7 djeuscan: fix alive / packaged updates
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-04 10:28:06 +02:00
volpino
2edb220d3e euscanwww: use jQuery each instead of for
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 17:38:51 +02:00
volpino
5970b4df37 euscanwww: Admin improved and simple task launcher added
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 09:43:49 +02:00
volpino
47ec539e1d euscanwww: scan_upstream imports euscan.scan
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess

Signed-off-by: volpino <fox91@anche.no>
2012-05-31 18:42:37 +02:00
volpino
e8718748b4 euscanwww: Celery fixes and little logging
Signed-off-by: volpino <fox91@anche.no>
2012-05-31 09:11:40 +02:00
volpino
56c4d79fb2 euscanwww: starting implementing Celery tasks
Basic tasks.py module, some fixes in the management commands

Signed-off-by: volpino <fox91@anche.no>
2012-05-30 22:54:55 +02:00
Corentin Chary
83f5df4daf euscanwww: fix the scan process
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-29 15:29:03 +02:00
Corentin Chary
f0a3c34ac8 Merge remote branch 'fox/master' 2012-05-29 09:21:44 +02:00
volpino
c36f625a54 euscanwww: fixing colored output
Signed-off-by: volpino <fox91@anche.no>
2012-05-28 23:24:09 +02:00
volpino
fce8ef347b euscanwww: management commands are validators aware
Management commands should create objects that don't raise
ValidationError

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 22:57:33 +02:00
volpino
b46e9acc08 euscan: Refactored all management commands
Management commands are refactored to have the logic moved from the
commands themselves to a separated function in order to make them easily
convertible into Celery tasks

Commands are renamed to be modules importable from other python scripts

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 21:19:53 +02:00
volpino
e535c204b0 euscanwww: fixed homepage and category validation
Accept multiple urls but skip invalid urls, added virtual as accepted
category

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 18:45:14 +02:00
Corentin Chary
3437cf5e4b euscan: cleanups
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-28 07:02:41 +02:00
volpino
a224cb27cb euscan: naive progressbar implementation
Progressbar for formatted output

Signed-off-by: volpino <fox91@anche.no>
2012-05-27 10:23:15 +02:00
volpino
31bd4dc55e euscan: adjusted code to be PEP8 compliant
Signed-off-by: volpino <fox91@anche.no>
2012-05-25 10:23:33 +02:00
Corentin Chary
305fdea0c7 euscan: make eend works again
Simplify einfo/ewarn/eend handling (for now) and make "message" someting
containing only what stdout would contain. We loose some informations, but
I'm really not sure we need more.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-25 00:19:17 +02:00
Corentin Chary
687851ffcb Merge git://github.com/volpino/euscan
Conflicts:
	pym/euscan/scan.py
2012-05-24 23:47:55 +02:00
Corentin Chary
177d77842f euscan: allow to use .ebuild files in any directory
Even outside PORTDIR_OVERLAY !

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-24 23:44:05 +02:00
volpino
4d606ae1cf euscan: added scan time to formatted output
scan_time in metadata dictionary

Signed-off-by: volpino <fox91@anche.no>
2012-05-24 20:27:18 +02:00
volpino
9989433ad5 euscan: detect version type
In the formatted output display the version type (beta, alpha, rc, ...)

Signed-off-by: volpino <fox91@anche.no>
2012-05-23 23:08:07 +02:00
volpino
1efeee4134 euscan: added simple support to result confidence
Confidence values are meaningless at the moment. Need to fix it.

Signed-off-by: volpino <fox91@anche.no>
2012-05-23 16:44:44 +02:00
volpino
a18083bd98 euscan: json format output
Now "-f json" seems good, it supports the handler type used to retrieve
each version and outputs metadata.

Signed-off-by: volpino <fox91@anche.no>
2012-05-23 16:30:43 +02:00
volpino
8cb19b5a6b euscan: adding json output
Naive json output implmented, probably needs some further tuning

Signed-off-by: volpino <fox91@anche.no>
2012-05-21 22:38:38 +02:00
volpino
373fba6e01 euscan: fixed patched versions issue
The old code extracted version 0.8.6.1 from buildbot-0.8.6p1 instead of
0.8.6_p1

Signed-off-by: volpino <fox91@anche.no>
2012-05-21 12:03:14 +02:00
Corentin Chary
7f8fb05c23 htdocs: add static symlink
(don't remember why exactly)

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-20 11:14:50 +02:00
volpino
777b6909a3 added long_description to setup.py 2012-05-19 14:23:24 +02:00
volpino
8563785746 model validators 2012-05-19 14:11:06 +02:00
volpino
de0ad4b210 issue #13 fixed 2012-05-13 16:42:29 +02:00
volpino
61a24fefb7 minor fix in runtests 2012-05-13 14:10:57 +02:00
volpino
c85de09947 some more cleaning, removing relative imports 2012-05-13 14:09:22 +02:00
volpino
b339efe012 tests for managers 2012-05-13 11:37:05 +02:00
volpino
2ec8cba794 feeds tests 2012-05-12 17:29:09 +02:00
volpino
c790618a51 more tests 2012-05-12 16:07:49 +02:00
volpino
d3676250ab tests refactoring and some fixes 2012-05-09 16:50:17 +02:00
volpino
9a39328e3b more and more tests 2012-05-07 14:27:54 +02:00
volpino
04d54f4689 add db journal to gitignore 2012-05-07 13:44:11 +02:00
volpino
46489c84a4 charts test 2012-05-07 10:56:54 +02:00
volpino
cb3dcaf713 test test test! 2012-05-07 10:20:33 +02:00
volpino
23f43e869a urls from future in templates 2012-05-06 20:27:14 +02:00
volpino
948c5b8c39 some tests, urls now have a name 2012-05-06 20:03:49 +02:00
volpino
0ece4c04b2 removed some code minimizations for readability 2012-05-05 16:59:34 +02:00