src_prepare/euscan-ng
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
297 Commits 1 Branch 4 Tags 13 MiB
2544af2e32
Commit Graph

297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Corentin Chary
2544af2e32 euscanwww/tasks: simplify tasks 
- strip '_task' end
- remove "launcher" functions, if we want complicated starter
  functions we will put them somewhere else later.
- now, everything is asynchroneous, maybe we could switch from
  group_one()/group_chunks() to .chunks() someday...

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-20 08:42:38 +02:00
Corentin Chary
634e06b779 euscan: don't fail if robots.txt can't be read 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-20 08:41:13 +02:00
Corentin Chary
bcda1a7ce3 euscan: add --ebuild-uri to use ${PV}, etc. 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-20 08:41:12 +02:00
volpino
c483ac41f1 euscanwww: using djcelery.schedulers.DatabaseScheduler for periodic tasks 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 17:16:31 +02:00
volpino
339ae58445 euscan: Added first implementation of the script to scrape debian watch 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 14:02:26 +02:00
volpino
58532b2136 euscan: #!/usr/bin/python -> #!/usr/bin/env python 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-18 10:48:14 +02:00
volpino
8268e634f0 euscanwww: Report problems is hided and can be shown with a click 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 19:05:26 +02:00
volpino
d70e4cb617 euscanwww: Adding unstable to legenda 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:53:28 +02:00
volpino
748fa12462 euscanwww: Display unstable versions in package table list 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:51:38 +02:00
volpino
b052f2e8b8 euscanwww: scan_portage get paths using eix and PORTDB 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 16:34:33 +02:00
volpino
be146163f6 euscanwww: Displaying unstable versions in package view 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 13:18:44 +02:00
volpino
a85f7e71c1 euscanwww: Version.version_type -> Version.vtype 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 12:30:55 +02:00
volpino
33a06d99fb euscan: added --ignore-pre-release and --ignore-pre-release-if-stable 
options

Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 12:27:22 +02:00
volpino
c4577c5279 euscanwww: Store ebuild and metadata path in Version 
Uses getRepositoryPath, change if possible

Signed-off-by: volpino <fox91@anche.no>
 2012-07-17 11:36:59 +02:00
volpino
b7d772dfc3 euscanwww: Tests unwatch too 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 16:43:12 +02:00
volpino
66db910583 euscanwww: Tests for watch packages/categories/maintainers/herds 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 16:22:02 +02:00
volpino
c0aefdef29 euscanwww: Started writing tests for favourite stuff but login fails 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 15:29:42 +02:00
volpino
bd2af29ff7 euscanwww: Basic user dashboard 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 13:56:21 +02:00
volpino
aa09812f6f euscanwww: Migration for handling ebuild and metadata paths 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-14 13:55:56 +02:00
volpino
a9265ec5d1 euscan: Performance improvement moving imports 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 18:14:41 +02:00
volpino
3f0cef09e0 euscan: Fixed typo in out.py. euscan output was broken 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 17:41:24 +02:00
volpino
fab19a6bfc euscanwww: Watch/unwatch packages, categories, maintainers, overlays 
Added a button for watch/unwatch and a dashboard with user selected
stuff only

Signed-off-by: volpino <fox91@anche.no>
 2012-07-10 16:15:06 +02:00
volpino
02be58024a euscanwww: Minor fixes 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-09 18:15:34 +02:00
volpino
379a6d2942 euscanwww: Adding a problem reporting form in package page 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-09 14:29:42 +02:00
volpino
03cf3b90a4 euscanwww: Upgraded to Celery 3.0 and fixed scan_portage 
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 18:09:14 +02:00
volpino
3be52a710c euscanwww: Changing RefreshPackageQuery.query to ForeignKey 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:46:35 +02:00
volpino
a6b215cec9 euscanwww: Fixed tasks to work with processing.scan and processing.misc 
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE

Signed-off-by: volpino <fox91@anche.no>
 2012-07-07 15:13:59 +02:00
volpino
80e8157627 Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-03 11:13:35 +02:00
Corentin Chary
2f0080e544 git: update .gitignore 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-03 10:57:07 +02:00
Corentin Chary
bdff6b7c63 euscanwww/scan_portage: try using gentoopm and fix slots 
gentoopm is still slower with portage backend, will try pkgcore
backend later.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-03 10:56:14 +02:00
Corentin Chary
8062fddc23 euscanwww: move processing to scan and misc, enhance update_portage_tree 
update_portage_tree() now:
- watch stderr and stdout for each command
- use layman command instead of layman API for sync because
  layman API doesn't work when stdout or stderr is not a real file
  (we could probably work around that with pipes and epoll)
- use egencache instead of emerge to generate cache
- export PORTAGE_CONFIGROOT, ROOT, EIX_CACHEFILE etc.. so they
  are used everywhere

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 18:16:59 +02:00
volpino
5a2f2e9eab Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-02 17:45:31 +02:00
volpino
6407efa14f euscan: naive implementation of --mirror 
Signed-off-by: volpino <fox91@anche.no>
 2012-07-02 17:44:55 +02:00
Corentin Chary
90702ddee8 euscan: don't import pkg_resources, we don't want all these warnings 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 11:20:52 +02:00
Corentin Chary
84a764dad5 euscan: allow --progress with --quiet 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 11:20:18 +02:00
Corentin Chary
ba805536ad euscanwww: add --category to scan_metadata, remove homepage and description 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 11:19:49 +02:00
Corentin Chary
0e32ccf46e euscanwww: make it work with MySQL 
unique indexes length must be <= 255

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 09:44:00 +02:00
Corentin Chary
093cb4da47 euscanwww/scan_portage: fixes and add --category 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 09:43:31 +02:00
Corentin Chary
ad5e399096 euscanwww: move start_dev_services.sh to scripts 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-07-02 08:09:06 +02:00
volpino
71f71c5b58 euscanwww: fixed commit_on_success 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 19:21:43 +02:00
volpino
09f0f75a42 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-30 18:37:04 +02:00
volpino
f43ab3ae3d euscanwww: fixing merge 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 18:36:45 +02:00
Corentin Chary
728770088c euscan: don't respect robots.txt for mono download site 
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-06-30 15:57:56 +02:00
volpino
94b814481b euscanwww: adding elem.clear() to prevent memory leaking in xml parsing 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 11:03:24 +02:00
volpino
145388a5e5 euscanwww: scan_upstream_all_task scans in randomized order 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c euscanwww: reverting removed purge_packages in scan_package_task 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:42:26 +02:00
volpino
c184628f48 Merge branch 'master' of https://github.com/iksaif/euscan 
Conflicts:
	euscanwww/djeuscan/processing/scan_portage.py

Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:39:18 +02:00
volpino
0c5a0ac36f euscanwww: Using incremental xml parsing for portage scanning 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 10:28:03 +02:00
Corentin Chary
9e6f885f89 djeuscan/scan_portage: fix purge-packages and purge-versions 
purge-packages: purge package that are not found in the tree
purge-versions: purge versions that are not found in the tree

Also, only purge versions of packages specified on the command line
when called without --all.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
 2012-06-30 10:19:07 +02:00
volpino
a83e4de59d euscanwww: user refresh package should not purge packages 
Signed-off-by: volpino <fox91@anche.no>
 2012-06-30 09:35:31 +02:00