src_prepare/euscan-ng
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
303 Commits 1 Branch 4 Tags
7dc322348d390386401677233cd7dba67b558344
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
volpino 7dc322348d euscanwww: PEP8, Cleaning unused imports and removing useless stuff 
* Removed useless use of chords
* populate in scan_metadata is off by default
* fixed group_one and scan_metadata launch
* removed useless utils.py

Signed-off-by: volpino <fox91@anche.no>
 2012-07-20 14:07:16 +02:00
volpino 3d8ea27ecc Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-20 11:58:07 +02:00
volpino 2245698326 euscanwww: scan_metadata populates db from herds.xml 
* Every herd has a m2m relation with maintainers
* New method populate_herds_and_maintainers to fill data in from herds.xml

Signed-off-by: volpino <fox91@anche.no>
 2012-07-20 11:50:16 +02:00
volpino c483ac41f1 euscanwww: using djcelery.schedulers.DatabaseScheduler for periodic tasks 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 17:16:31 +02:00
volpino 339ae58445 euscan: Added first implementation of the script to scrape debian watch 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 14:02:26 +02:00
volpino 58532b2136 euscan: #!/usr/bin/python -> #!/usr/bin/env python 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 10:48:14 +02:00
volpino 8268e634f0 euscanwww: Report problems is hided and can be shown with a click 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 19:05:26 +02:00
volpino d70e4cb617 euscanwww: Adding unstable to legenda 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:53:28 +02:00
volpino 748fa12462 euscanwww: Display unstable versions in package table list 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:51:38 +02:00
volpino b052f2e8b8 euscanwww: scan_portage get paths using eix and PORTDB 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:34:33 +02:00
volpino be146163f6 euscanwww: Displaying unstable versions in package view 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 13:18:44 +02:00
volpino a85f7e71c1 euscanwww: Version.version_type -> Version.vtype 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 12:30:55 +02:00
volpino 33a06d99fb euscan: added --ignore-pre-release and --ignore-pre-release-if-stable 
options

Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 12:27:22 +02:00
volpino c4577c5279 euscanwww: Store ebuild and metadata path in Version 
Uses getRepositoryPath, change if possible

Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 11:36:59 +02:00
volpino b7d772dfc3 euscanwww: Tests unwatch too 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 16:43:12 +02:00
volpino 66db910583 euscanwww: Tests for watch packages/categories/maintainers/herds 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 16:22:02 +02:00
volpino c0aefdef29 euscanwww: Started writing tests for favourite stuff but login fails 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 15:29:42 +02:00
volpino bd2af29ff7 euscanwww: Basic user dashboard 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 13:56:21 +02:00
volpino aa09812f6f euscanwww: Migration for handling ebuild and metadata paths 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 13:55:56 +02:00
volpino a9265ec5d1 euscan: Performance improvement moving imports 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 18:14:41 +02:00
volpino 3f0cef09e0 euscan: Fixed typo in out.py. euscan output was broken 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 17:41:24 +02:00
volpino fab19a6bfc euscanwww: Watch/unwatch packages, categories, maintainers, overlays 
Added a button for watch/unwatch and a dashboard with user selected
stuff only

Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 16:15:06 +02:00
volpino 02be58024a euscanwww: Minor fixes 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-09 18:15:34 +02:00
volpino 379a6d2942 euscanwww: Adding a problem reporting form in package page 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-09 14:29:42 +02:00
volpino 03cf3b90a4 euscanwww: Upgraded to Celery 3.0 and fixed scan_portage 
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 18:09:14 +02:00
volpino 3be52a710c euscanwww: Changing RefreshPackageQuery.query to ForeignKey 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:46:35 +02:00
volpino a6b215cec9 euscanwww: Fixed tasks to work with processing.scan and processing.misc 
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:13:59 +02:00
volpino 80e8157627 Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-03 11:13:35 +02:00
volpino 5a2f2e9eab Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-02 17:45:31 +02:00
volpino 6407efa14f euscan: naive implementation of --mirror 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-02 17:44:55 +02:00
volpino 71f71c5b58 euscanwww: fixed commit_on_success 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 19:21:43 +02:00
volpino 09f0f75a42 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-30 18:37:04 +02:00
volpino f43ab3ae3d euscanwww: fixing merge 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 18:36:45 +02:00
volpino 94b814481b euscanwww: adding elem.clear() to prevent memory leaking in xml parsing 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 11:03:24 +02:00
volpino 145388a5e5 euscanwww: scan_upstream_all_task scans in randomized order 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:50:17 +02:00
volpino c6f5fb0b7c euscanwww: reverting removed purge_packages in scan_package_task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:42:26 +02:00
volpino c184628f48 Merge branch 'master' of https://github.com/iksaif/euscan 
Conflicts:
	euscanwww/djeuscan/processing/scan_portage.py

Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:39:18 +02:00
volpino 0c5a0ac36f euscanwww: Using incremental xml parsing for portage scanning 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:28:03 +02:00
volpino a83e4de59d euscanwww: user refresh package should not purge packages 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 09:35:31 +02:00
volpino 91ccdeb4e7 euscanwww: simple script to start services (only for development) 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 09:01:36 +02:00
volpino fc7f929038 euscanwww: Fixed broken tasks 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-29 17:25:45 +02:00
volpino e9c03fbded euscanwww: Fixed CSS stylesheet 
Added Twitter Bootstrap and tweaked the layout to use the grid layout

Signed-off-by: volpino <fox91@anche.no>
 2012-06-29 14:22:01 +02:00
volpino d7bf130fda euscan: minor fixes 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-28 12:43:46 +02:00
volpino 0d6376681f euscan: fixed progressbar 
added -p option, now the progressbar is "global" and shows the total
progress

Signed-off-by: volpino <fox91@anche.no>
 2012-06-28 12:20:57 +02:00
volpino b06965f386 euscan: plugin system for handlers 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-28 11:08:05 +02:00
volpino 951624759a euscanwww: Fixing tasks 
Fixing minor bugs in tasks.py and little related stuff

Signed-off-by: volpino <fox91@anche.no>
 2012-06-27 10:15:30 +02:00
volpino 1ae2dcba50 euscanwww: settable options for _run_in_chunks() 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-26 18:31:35 +02:00
volpino 8fdac1014c euscanwww: Adding infos to EuscanResults 
Now we store metadata, output from euscan is cleaned from colors
encoding when outputting json

Signed-off-by: volpino <fox91@anche.no>
 2012-06-26 18:13:28 +02:00
volpino 699bb372a5 euscanwww: Added README for celery 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-26 17:17:35 +02:00
volpino d7e0a4ca16 euscanwww: Tweaked processing.scan_portage to use eix --xml 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-26 17:16:02 +02:00
volpino f9c9a4bfd8 euscanwww: added scan_package task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-22 11:40:40 +02:00
volpino 779ccdf5d3 euscanwww: use logging in djeuscan.processing 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-22 11:31:15 +02:00
volpino 9af5548178 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-22 09:34:11 +02:00
volpino 9bfd728d4f euscanwww: Moved business logic to djeuscan.processing 
Moved stuff from management commands to djeuscan.processing

Signed-off-by: volpino <fox91@anche.no>
 2012-06-22 09:32:39 +02:00
volpino 6cc892717b Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-14 10:21:37 +02:00
volpino 11c8422c9b euscanwww: Reset password 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-14 10:21:01 +02:00
volpino 34d3bd714d euscanwww: Watched herds/maintainers/categories panel 
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects

Signed-off-by: volpino <fox91@anche.no>
 2012-06-14 10:03:49 +02:00
volpino 11c234f7f7 euscanwww: Added account profile page 
* Added an account profile page
* Added a button to favourite packages
* Implemented models to favourite categories, herds, maintainers but
  still to implement

Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 15:27:28 +02:00
volpino bd971a7da0 euscanwww: When scanning upstream output object was never cleaned 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 14:55:58 +02:00
volpino 7367596e33 euscanwww: Added LDAP login 
Needs testing and the settings must be changed to use the gentoo ldap
server

Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 13:39:05 +02:00
volpino bd9af90ff6 euscanwww: Removed useless purge tasks, some error handling 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-12 13:05:58 +02:00
volpino d34a0c4992 euscanwww: included django-registration and tweaked templates 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-09 17:12:09 +02:00
volpino 4246c544ad euscanwww: bug found, celery timeouts on join. Commented out 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-09 16:12:17 +02:00
volpino 9cddc82808 Merge branch 'master' of https://github.com/iksaif/euscan 
Conflicts:
	euscanwww/djeuscan/models.py

Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:46:37 +02:00
volpino b43bf8fa28 euscanwww: Removing duplicated code 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:43:18 +02:00
volpino 43e996d83d euscanwww: Fixed the upstream task that was completely broken 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:24:17 +02:00
volpino a6a87260b1 euscanwww: Fixed a minor bug in the task launching interface 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:23:37 +02:00
volpino a94a24eeac euscanwww: Refresh query logic and task queue split in chunks 
Added the needed logic for running refresh queries from the web
interface.

Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)

Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:21:11 +02:00
volpino 8913f826de euscanwww: Added RefreshPackageQuery to models 
Allows storing queries for refresh requests by users

Signed-off-by: volpino <fox91@anche.no>
 2012-06-08 14:19:20 +02:00
volpino 33555a9fbe euscanwww: Fixed Layman sync task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 16:44:08 +02:00
volpino 8501805f8e euscanwww: Scan tasks recieve a list of packages 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 13:30:31 +02:00
volpino 4a9301a215 euscanwww: naive implementation of the refresh button 
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww

Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 13:10:25 +02:00
volpino 8ed74a74df euscanwww: Changed Layman sync task to use Python API 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-05 12:46:22 +02:00
volpino c41521d59f euscanwww: Admin interface tweaks 
Added some search fields, ordering and filters to the admin panel

Signed-off-by: volpino <fox91@anche.no>
 2012-06-04 11:27:18 +02:00
volpino 60e2019cc3 euscanwww: Added tasks for syncing and updating portage tree 
Added these tasks:
 * emerge_sync
 * layman_sync
 * emerge_regen
 * eix_update

Signed-off-by: volpino <fox91@anche.no>
 2012-06-04 11:06:47 +02:00
volpino 2edb220d3e euscanwww: use jQuery each instead of for 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-03 17:38:51 +02:00
volpino 5970b4df37 euscanwww: Admin improved and simple task launcher added 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-03 09:43:49 +02:00
volpino 47ec539e1d euscanwww: scan_upstream imports euscan.scan 
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess

Signed-off-by: volpino <fox91@anche.no>
 2012-05-31 18:42:37 +02:00
volpino e8718748b4 euscanwww: Celery fixes and little logging 
Signed-off-by: volpino <fox91@anche.no>
 2012-05-31 09:11:40 +02:00
volpino 56c4d79fb2 euscanwww: starting implementing Celery tasks 
Basic tasks.py module, some fixes in the management commands

Signed-off-by: volpino <fox91@anche.no>
 2012-05-30 22:54:55 +02:00
volpino c36f625a54 euscanwww: fixing colored output 
Signed-off-by: volpino <fox91@anche.no>
 2012-05-28 23:24:09 +02:00
volpino fce8ef347b euscanwww: management commands are validators aware 
Management commands should create objects that don't raise
ValidationError

Signed-off-by: volpino <fox91@anche.no>
 2012-05-28 22:57:33 +02:00
volpino b46e9acc08 euscan: Refactored all management commands 
Management commands are refactored to have the logic moved from the
commands themselves to a separated function in order to make them easily
convertible into Celery tasks

Commands are renamed to be modules importable from other python scripts

Signed-off-by: volpino <fox91@anche.no>
 2012-05-28 21:19:53 +02:00
volpino e535c204b0 euscanwww: fixed homepage and category validation 
Accept multiple urls but skip invalid urls, added virtual as accepted
category

Signed-off-by: volpino <fox91@anche.no>
 2012-05-28 18:45:14 +02:00
volpino a224cb27cb euscan: naive progressbar implementation 
Progressbar for formatted output

Signed-off-by: volpino <fox91@anche.no>
 2012-05-27 10:23:15 +02:00
volpino 31bd4dc55e euscan: adjusted code to be PEP8 compliant 
Signed-off-by: volpino <fox91@anche.no>
 2012-05-25 10:23:33 +02:00
volpino 4d606ae1cf euscan: added scan time to formatted output 
scan_time in metadata dictionary

Signed-off-by: volpino <fox91@anche.no>
 2012-05-24 20:27:18 +02:00
volpino 9989433ad5 euscan: detect version type 
In the formatted output display the version type (beta, alpha, rc, ...)

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 23:08:07 +02:00
volpino 1efeee4134 euscan: added simple support to result confidence 
Confidence values are meaningless at the moment. Need to fix it.

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 16:44:44 +02:00
volpino a18083bd98 euscan: json format output 
Now "-f json" seems good, it supports the handler type used to retrieve
each version and outputs metadata.

Signed-off-by: volpino <fox91@anche.no>
 2012-05-23 16:30:43 +02:00
volpino 8cb19b5a6b euscan: adding json output 
Naive json output implmented, probably needs some further tuning

Signed-off-by: volpino <fox91@anche.no>
 2012-05-21 22:38:38 +02:00
volpino 373fba6e01 euscan: fixed patched versions issue 
The old code extracted version 0.8.6.1 from buildbot-0.8.6p1 instead of
0.8.6_p1

Signed-off-by: volpino <fox91@anche.no>
 2012-05-21 12:03:14 +02:00
volpino 777b6909a3 added long_description to setup.py 2012-05-19 14:23:24 +02:00
volpino 8563785746 model validators 2012-05-19 14:11:06 +02:00
volpino de0ad4b210 issue #13 fixed 2012-05-13 16:42:29 +02:00
volpino 61a24fefb7 minor fix in runtests 2012-05-13 14:10:57 +02:00
volpino c85de09947 some more cleaning, removing relative imports 2012-05-13 14:09:22 +02:00
volpino b339efe012 tests for managers 2012-05-13 11:37:05 +02:00
volpino 2ec8cba794 feeds tests 2012-05-12 17:29:09 +02:00
volpino c790618a51 more tests 2012-05-12 16:07:49 +02:00