volpino and Corentin Chary
83cc025170
euscan: euscan_patch_metadata --diff option
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-25 16:53:16 +02:00
volpino
edf549bc40
euscanwww: added fixture for periodic tasks
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-21 10:00:12 +02:00
volpino
f7340bee43
euscan: patch_metadata now handles debian diff files
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-21 09:22:26 +02:00
volpino
0d4e8283ae
euscanwww: added alert on refresh request, added missing pull-right
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 17:20:18 +02:00
volpino
10cb482294
euscanwww: Icons for watching and refreshing, a user can refresh only once
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 17:10:12 +02:00
volpino
c6f2baa0e6
euscanwww: color code fix for json hilighting
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 16:30:37 +02:00
volpino
0885e89cc1
euscanwww: uscan watch handle options
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 16:10:53 +02:00
volpino
ad02fd4b81
euscanwww: Added ansi to html helper
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 15:12:44 +02:00
volpino
1aaee90ab7
euscanwww: take herds.xml path as an argument
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 14:15:28 +02:00
volpino
609eff60ab
euscanwww: Launch scan_portage per category like scan_metadata
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 14:11:09 +02:00
volpino
7dc322348d
euscanwww: PEP8, Cleaning unused imports and removing useless stuff
...
* Removed useless use of chords
* populate in scan_metadata is off by default
* fixed group_one and scan_metadata launch
* removed useless utils.py
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 14:07:16 +02:00
volpino
3d8ea27ecc
Merge branch 'master' of https://github.com/iksaif/euscan
2012-07-20 11:58:07 +02:00
volpino
2245698326
euscanwww: scan_metadata populates db from herds.xml
...
* Every herd has a m2m relation with maintainers
* New method populate_herds_and_maintainers to fill data in from herds.xml
Signed-off-by: volpino <fox91@anche.no >
2012-07-20 11:50:16 +02:00
volpino
c483ac41f1
euscanwww: using djcelery.schedulers.DatabaseScheduler for periodic tasks
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-18 17:16:31 +02:00
volpino
339ae58445
euscan: Added first implementation of the script to scrape debian watch
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-18 14:02:26 +02:00
volpino
58532b2136
euscan: #!/usr/bin/python -> #!/usr/bin/env python
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-18 10:48:14 +02:00
volpino
8268e634f0
euscanwww: Report problems is hided and can be shown with a click
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 19:05:26 +02:00
volpino
d70e4cb617
euscanwww: Adding unstable to legenda
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 16:53:28 +02:00
volpino
748fa12462
euscanwww: Display unstable versions in package table list
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 16:51:38 +02:00
volpino
b052f2e8b8
euscanwww: scan_portage get paths using eix and PORTDB
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 16:34:33 +02:00
volpino
be146163f6
euscanwww: Displaying unstable versions in package view
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 13:18:44 +02:00
volpino
a85f7e71c1
euscanwww: Version.version_type -> Version.vtype
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 12:30:55 +02:00
volpino
33a06d99fb
euscan: added --ignore-pre-release and --ignore-pre-release-if-stable
...
options
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 12:27:22 +02:00
volpino
c4577c5279
euscanwww: Store ebuild and metadata path in Version
...
Uses getRepositoryPath, change if possible
Signed-off-by: volpino <fox91@anche.no >
2012-07-17 11:36:59 +02:00
volpino
b7d772dfc3
euscanwww: Tests unwatch too
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-14 16:43:12 +02:00
volpino
66db910583
euscanwww: Tests for watch packages/categories/maintainers/herds
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-14 16:22:02 +02:00
volpino
c0aefdef29
euscanwww: Started writing tests for favourite stuff but login fails
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-14 15:29:42 +02:00
volpino
bd2af29ff7
euscanwww: Basic user dashboard
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-14 13:56:21 +02:00
volpino
aa09812f6f
euscanwww: Migration for handling ebuild and metadata paths
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-14 13:55:56 +02:00
volpino
a9265ec5d1
euscan: Performance improvement moving imports
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-10 18:14:41 +02:00
volpino
3f0cef09e0
euscan: Fixed typo in out.py. euscan output was broken
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-10 17:41:24 +02:00
volpino
fab19a6bfc
euscanwww: Watch/unwatch packages, categories, maintainers, overlays
...
Added a button for watch/unwatch and a dashboard with user selected
stuff only
Signed-off-by: volpino <fox91@anche.no >
2012-07-10 16:15:06 +02:00
volpino
02be58024a
euscanwww: Minor fixes
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-09 18:15:34 +02:00
volpino
379a6d2942
euscanwww: Adding a problem reporting form in package page
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-09 14:29:42 +02:00
volpino
03cf3b90a4
euscanwww: Upgraded to Celery 3.0 and fixed scan_portage
...
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe
Signed-off-by: volpino <fox91@anche.no >
2012-07-07 18:09:14 +02:00
volpino
3be52a710c
euscanwww: Changing RefreshPackageQuery.query to ForeignKey
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-07 15:46:35 +02:00
volpino
a6b215cec9
euscanwww: Fixed tasks to work with processing.scan and processing.misc
...
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE
Signed-off-by: volpino <fox91@anche.no >
2012-07-07 15:13:59 +02:00
volpino
80e8157627
Merge branch 'master' of https://github.com/iksaif/euscan
2012-07-03 11:13:35 +02:00
volpino
5a2f2e9eab
Merge branch 'master' of https://github.com/iksaif/euscan
2012-07-02 17:45:31 +02:00
volpino
6407efa14f
euscan: naive implementation of --mirror
...
Signed-off-by: volpino <fox91@anche.no >
2012-07-02 17:44:55 +02:00
volpino
71f71c5b58
euscanwww: fixed commit_on_success
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 19:21:43 +02:00
volpino
09f0f75a42
Merge branch 'master' of https://github.com/iksaif/euscan
2012-06-30 18:37:04 +02:00
volpino
f43ab3ae3d
euscanwww: fixing merge
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 18:36:45 +02:00
volpino
94b814481b
euscanwww: adding elem.clear() to prevent memory leaking in xml parsing
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 11:03:24 +02:00
volpino
145388a5e5
euscanwww: scan_upstream_all_task scans in randomized order
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c
euscanwww: reverting removed purge_packages in scan_package_task
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 10:42:26 +02:00
volpino
c184628f48
Merge branch 'master' of https://github.com/iksaif/euscan
...
Conflicts:
euscanwww/djeuscan/processing/scan_portage.py
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 10:39:18 +02:00
volpino
0c5a0ac36f
euscanwww: Using incremental xml parsing for portage scanning
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 10:28:03 +02:00
volpino
a83e4de59d
euscanwww: user refresh package should not purge packages
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 09:35:31 +02:00
volpino
91ccdeb4e7
euscanwww: simple script to start services (only for development)
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-30 09:01:36 +02:00
volpino
fc7f929038
euscanwww: Fixed broken tasks
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-29 17:25:45 +02:00
volpino
e9c03fbded
euscanwww: Fixed CSS stylesheet
...
Added Twitter Bootstrap and tweaked the layout to use the grid layout
Signed-off-by: volpino <fox91@anche.no >
2012-06-29 14:22:01 +02:00
volpino
d7bf130fda
euscan: minor fixes
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-28 12:43:46 +02:00
volpino
0d6376681f
euscan: fixed progressbar
...
added -p option, now the progressbar is "global" and shows the total
progress
Signed-off-by: volpino <fox91@anche.no >
2012-06-28 12:20:57 +02:00
volpino
b06965f386
euscan: plugin system for handlers
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-28 11:08:05 +02:00
volpino
951624759a
euscanwww: Fixing tasks
...
Fixing minor bugs in tasks.py and little related stuff
Signed-off-by: volpino <fox91@anche.no >
2012-06-27 10:15:30 +02:00
volpino
1ae2dcba50
euscanwww: settable options for _run_in_chunks()
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-26 18:31:35 +02:00
volpino
8fdac1014c
euscanwww: Adding infos to EuscanResults
...
Now we store metadata, output from euscan is cleaned from colors
encoding when outputting json
Signed-off-by: volpino <fox91@anche.no >
2012-06-26 18:13:28 +02:00
volpino
699bb372a5
euscanwww: Added README for celery
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-26 17:17:35 +02:00
volpino
d7e0a4ca16
euscanwww: Tweaked processing.scan_portage to use eix --xml
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-26 17:16:02 +02:00
volpino
f9c9a4bfd8
euscanwww: added scan_package task
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-22 11:40:40 +02:00
volpino
779ccdf5d3
euscanwww: use logging in djeuscan.processing
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-22 11:31:15 +02:00
volpino
9af5548178
Merge branch 'master' of https://github.com/iksaif/euscan
2012-06-22 09:34:11 +02:00
volpino
9bfd728d4f
euscanwww: Moved business logic to djeuscan.processing
...
Moved stuff from management commands to djeuscan.processing
Signed-off-by: volpino <fox91@anche.no >
2012-06-22 09:32:39 +02:00
volpino
6cc892717b
Merge branch 'master' of https://github.com/iksaif/euscan
2012-06-14 10:21:37 +02:00
volpino
11c8422c9b
euscanwww: Reset password
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-14 10:21:01 +02:00
volpino
34d3bd714d
euscanwww: Watched herds/maintainers/categories panel
...
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects
Signed-off-by: volpino <fox91@anche.no >
2012-06-14 10:03:49 +02:00
volpino
11c234f7f7
euscanwww: Added account profile page
...
* Added an account profile page
* Added a button to favourite packages
* Implemented models to favourite categories, herds, maintainers but
still to implement
Signed-off-by: volpino <fox91@anche.no >
2012-06-12 15:27:28 +02:00
volpino
bd971a7da0
euscanwww: When scanning upstream output object was never cleaned
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-12 14:55:58 +02:00
volpino
7367596e33
euscanwww: Added LDAP login
...
Needs testing and the settings must be changed to use the gentoo ldap
server
Signed-off-by: volpino <fox91@anche.no >
2012-06-12 13:39:05 +02:00
volpino
bd9af90ff6
euscanwww: Removed useless purge tasks, some error handling
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-12 13:05:58 +02:00
volpino
d34a0c4992
euscanwww: included django-registration and tweaked templates
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-09 17:12:09 +02:00
volpino
4246c544ad
euscanwww: bug found, celery timeouts on join. Commented out
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-09 16:12:17 +02:00
volpino
9cddc82808
Merge branch 'master' of https://github.com/iksaif/euscan
...
Conflicts:
euscanwww/djeuscan/models.py
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:46:37 +02:00
volpino
b43bf8fa28
euscanwww: Removing duplicated code
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:43:18 +02:00
volpino
43e996d83d
euscanwww: Fixed the upstream task that was completely broken
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:24:17 +02:00
volpino
a6a87260b1
euscanwww: Fixed a minor bug in the task launching interface
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:23:37 +02:00
volpino
a94a24eeac
euscanwww: Refresh query logic and task queue split in chunks
...
Added the needed logic for running refresh queries from the web
interface.
Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:21:11 +02:00
volpino
8913f826de
euscanwww: Added RefreshPackageQuery to models
...
Allows storing queries for refresh requests by users
Signed-off-by: volpino <fox91@anche.no >
2012-06-08 14:19:20 +02:00
volpino
33555a9fbe
euscanwww: Fixed Layman sync task
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-05 16:44:08 +02:00
volpino
8501805f8e
euscanwww: Scan tasks recieve a list of packages
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-05 13:30:31 +02:00
volpino
4a9301a215
euscanwww: naive implementation of the refresh button
...
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww
Signed-off-by: volpino <fox91@anche.no >
2012-06-05 13:10:25 +02:00
volpino
8ed74a74df
euscanwww: Changed Layman sync task to use Python API
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-05 12:46:22 +02:00
volpino
c41521d59f
euscanwww: Admin interface tweaks
...
Added some search fields, ordering and filters to the admin panel
Signed-off-by: volpino <fox91@anche.no >
2012-06-04 11:27:18 +02:00
volpino
60e2019cc3
euscanwww: Added tasks for syncing and updating portage tree
...
Added these tasks:
* emerge_sync
* layman_sync
* emerge_regen
* eix_update
Signed-off-by: volpino <fox91@anche.no >
2012-06-04 11:06:47 +02:00
volpino
2edb220d3e
euscanwww: use jQuery each instead of for
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-03 17:38:51 +02:00
volpino
5970b4df37
euscanwww: Admin improved and simple task launcher added
...
Signed-off-by: volpino <fox91@anche.no >
2012-06-03 09:43:49 +02:00
volpino
47ec539e1d
euscanwww: scan_upstream imports euscan.scan
...
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess
Signed-off-by: volpino <fox91@anche.no >
2012-05-31 18:42:37 +02:00
volpino
e8718748b4
euscanwww: Celery fixes and little logging
...
Signed-off-by: volpino <fox91@anche.no >
2012-05-31 09:11:40 +02:00
volpino
56c4d79fb2
euscanwww: starting implementing Celery tasks
...
Basic tasks.py module, some fixes in the management commands
Signed-off-by: volpino <fox91@anche.no >
2012-05-30 22:54:55 +02:00
volpino
c36f625a54
euscanwww: fixing colored output
...
Signed-off-by: volpino <fox91@anche.no >
2012-05-28 23:24:09 +02:00
volpino
fce8ef347b
euscanwww: management commands are validators aware
...
Management commands should create objects that don't raise
ValidationError
Signed-off-by: volpino <fox91@anche.no >
2012-05-28 22:57:33 +02:00
volpino
b46e9acc08
euscan: Refactored all management commands
...
Management commands are refactored to have the logic moved from the
commands themselves to a separated function in order to make them easily
convertible into Celery tasks
Commands are renamed to be modules importable from other python scripts
Signed-off-by: volpino <fox91@anche.no >
2012-05-28 21:19:53 +02:00
volpino
e535c204b0
euscanwww: fixed homepage and category validation
...
Accept multiple urls but skip invalid urls, added virtual as accepted
category
Signed-off-by: volpino <fox91@anche.no >
2012-05-28 18:45:14 +02:00
volpino
a224cb27cb
euscan: naive progressbar implementation
...
Progressbar for formatted output
Signed-off-by: volpino <fox91@anche.no >
2012-05-27 10:23:15 +02:00
volpino
31bd4dc55e
euscan: adjusted code to be PEP8 compliant
...
Signed-off-by: volpino <fox91@anche.no >
2012-05-25 10:23:33 +02:00
volpino
4d606ae1cf
euscan: added scan time to formatted output
...
scan_time in metadata dictionary
Signed-off-by: volpino <fox91@anche.no >
2012-05-24 20:27:18 +02:00
volpino
9989433ad5
euscan: detect version type
...
In the formatted output display the version type (beta, alpha, rc, ...)
Signed-off-by: volpino <fox91@anche.no >
2012-05-23 23:08:07 +02:00
volpino
1efeee4134
euscan: added simple support to result confidence
...
Confidence values are meaningless at the moment. Need to fix it.
Signed-off-by: volpino <fox91@anche.no >
2012-05-23 16:44:44 +02:00
volpino
a18083bd98
euscan: json format output
...
Now "-f json" seems good, it supports the handler type used to retrieve
each version and outputs metadata.
Signed-off-by: volpino <fox91@anche.no >
2012-05-23 16:30:43 +02:00