Corentin Chary
8062fddc23
euscanwww: move processing to scan and misc, enhance update_portage_tree
...
update_portage_tree() now:
- watch stderr and stdout for each command
- use layman command instead of layman API for sync because
layman API doesn't work when stdout or stderr is not a real file
(we could probably work around that with pipes and epoll)
- use egencache instead of emerge to generate cache
- export PORTAGE_CONFIGROOT, ROOT, EIX_CACHEFILE etc.. so they
are used everywhere
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 18:16:59 +02:00
Corentin Chary
ba805536ad
euscanwww: add --category to scan_metadata, remove homepage and description
...
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:19:49 +02:00
Corentin Chary
0e32ccf46e
euscanwww: make it work with MySQL
...
unique indexes length must be <= 255
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:44:00 +02:00
Corentin Chary
093cb4da47
euscanwww/scan_portage: fixes and add --category
...
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:43:31 +02:00
Corentin Chary
ad5e399096
euscanwww: move start_dev_services.sh to scripts
...
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 08:09:06 +02:00
volpino
71f71c5b58
euscanwww: fixed commit_on_success
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 19:21:43 +02:00
volpino
f43ab3ae3d
euscanwww: fixing merge
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 18:36:45 +02:00
volpino
94b814481b
euscanwww: adding elem.clear() to prevent memory leaking in xml parsing
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 11:03:24 +02:00
volpino
145388a5e5
euscanwww: scan_upstream_all_task scans in randomized order
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c
euscanwww: reverting removed purge_packages in scan_package_task
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:42:26 +02:00
volpino
c184628f48
Merge branch 'master' of https://github.com/iksaif/euscan
...
Conflicts:
euscanwww/djeuscan/processing/scan_portage.py
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:39:18 +02:00
volpino
0c5a0ac36f
euscanwww: Using incremental xml parsing for portage scanning
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:28:03 +02:00
Corentin Chary
9e6f885f89
djeuscan/scan_portage: fix purge-packages and purge-versions
...
purge-packages: purge package that are not found in the tree
purge-versions: purge versions that are not found in the tree
Also, only purge versions of packages specified on the command line
when called without --all.
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 10:19:07 +02:00
volpino
a83e4de59d
euscanwww: user refresh package should not purge packages
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 09:35:31 +02:00
volpino
91ccdeb4e7
euscanwww: simple script to start services (only for development)
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 09:01:36 +02:00
volpino
fc7f929038
euscanwww: Fixed broken tasks
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-29 17:25:45 +02:00
volpino
e9c03fbded
euscanwww: Fixed CSS stylesheet
...
Added Twitter Bootstrap and tweaked the layout to use the grid layout
Signed-off-by: volpino <fox91@anche.no>
2012-06-29 14:22:01 +02:00
volpino
951624759a
euscanwww: Fixing tasks
...
Fixing minor bugs in tasks.py and little related stuff
Signed-off-by: volpino <fox91@anche.no>
2012-06-27 10:15:30 +02:00
volpino
1ae2dcba50
euscanwww: settable options for _run_in_chunks()
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:31:35 +02:00
volpino
8fdac1014c
euscanwww: Adding infos to EuscanResults
...
Now we store metadata, output from euscan is cleaned from colors
encoding when outputting json
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 18:13:28 +02:00
volpino
699bb372a5
euscanwww: Added README for celery
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:17:35 +02:00
volpino
d7e0a4ca16
euscanwww: Tweaked processing.scan_portage to use eix --xml
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-26 17:16:02 +02:00
volpino
f9c9a4bfd8
euscanwww: added scan_package task
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:40:40 +02:00
volpino
779ccdf5d3
euscanwww: use logging in djeuscan.processing
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 11:31:15 +02:00
volpino
9bfd728d4f
euscanwww: Moved business logic to djeuscan.processing
...
Moved stuff from management commands to djeuscan.processing
Signed-off-by: volpino <fox91@anche.no>
2012-06-22 09:32:39 +02:00
volpino
6cc892717b
Merge branch 'master' of https://github.com/iksaif/euscan
2012-06-14 10:21:37 +02:00
volpino
11c8422c9b
euscanwww: Reset password
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:21:01 +02:00
volpino
34d3bd714d
euscanwww: Watched herds/maintainers/categories panel
...
* Refactored templates and templatetags
* Added unfavourite views
* Added button to favourite/unfavourite package
* Panel for showing favourited objects
Signed-off-by: volpino <fox91@anche.no>
2012-06-14 10:03:49 +02:00
volpino
11c234f7f7
euscanwww: Added account profile page
...
* Added an account profile page
* Added a button to favourite packages
* Implemented models to favourite categories, herds, maintainers but
still to implement
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 15:27:28 +02:00
volpino
bd971a7da0
euscanwww: When scanning upstream output object was never cleaned
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 14:55:58 +02:00
volpino
7367596e33
euscanwww: Added LDAP login
...
Needs testing and the settings must be changed to use the gentoo ldap
server
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 13:39:05 +02:00
volpino
bd9af90ff6
euscanwww: Removed useless purge tasks, some error handling
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-12 13:05:58 +02:00
volpino
d34a0c4992
euscanwww: included django-registration and tweaked templates
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-09 17:12:09 +02:00
volpino
4246c544ad
euscanwww: bug found, celery timeouts on join. Commented out
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-09 16:12:17 +02:00
volpino
9cddc82808
Merge branch 'master' of https://github.com/iksaif/euscan
...
Conflicts:
euscanwww/djeuscan/models.py
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:46:37 +02:00
volpino
b43bf8fa28
euscanwww: Removing duplicated code
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:43:18 +02:00
volpino
43e996d83d
euscanwww: Fixed the upstream task that was completely broken
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:24:17 +02:00
volpino
a6a87260b1
euscanwww: Fixed a minor bug in the task launching interface
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:23:37 +02:00
volpino
a94a24eeac
euscanwww: Refresh query logic and task queue split in chunks
...
Added the needed logic for running refresh queries from the web
interface.
Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:21:11 +02:00
volpino
8913f826de
euscanwww: Added RefreshPackageQuery to models
...
Allows storing queries for refresh requests by users
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:19:20 +02:00
Tim Harder
5df28b028e
add support for Beautiful Soup 4
2012-06-08 00:18:59 -07:00
volpino
33555a9fbe
euscanwww: Fixed Layman sync task
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 16:44:08 +02:00
volpino
8501805f8e
euscanwww: Scan tasks recieve a list of packages
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:30:31 +02:00
volpino
4a9301a215
euscanwww: naive implementation of the refresh button
...
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:10:25 +02:00
volpino
8ed74a74df
euscanwww: Changed Layman sync task to use Python API
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 12:46:22 +02:00
volpino
c41521d59f
euscanwww: Admin interface tweaks
...
Added some search fields, ordering and filters to the admin panel
Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:27:18 +02:00
volpino
60e2019cc3
euscanwww: Added tasks for syncing and updating portage tree
...
Added these tasks:
* emerge_sync
* layman_sync
* emerge_regen
* eix_update
Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:06:47 +02:00
Corentin Chary
5b1884ead7
djeuscan: fix alive / packaged updates
...
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-04 10:28:06 +02:00
volpino
2edb220d3e
euscanwww: use jQuery each instead of for
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 17:38:51 +02:00
volpino
5970b4df37
euscanwww: Admin improved and simple task launcher added
...
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 09:43:49 +02:00