Commit Graph

601 Commits

Author SHA1 Message Date
volpino
2245698326 euscanwww: scan_metadata populates db from herds.xml
* Every herd has a m2m relation with maintainers
* New method populate_herds_and_maintainers to fill data in from herds.xml

Signed-off-by: volpino <fox91@anche.no>
2012-07-20 11:50:16 +02:00
Corentin Chary
5fb076b304 euscan: remove trailing comma
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 09:06:22 +02:00
Corentin Chary
8743e9d1e1 euscan: move version type helpers to euscan.version
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 09:04:15 +02:00
Corentin Chary
6f9e575bbc euscanwww: add missing file
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 08:42:38 +02:00
Corentin Chary
2544af2e32 euscanwww/tasks: simplify tasks
- strip '_task' end
- remove "launcher" functions, if we want complicated starter
  functions we will put them somewhere else later.
- now, everything is asynchroneous, maybe we could switch from
  group_one()/group_chunks() to .chunks() someday...

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 08:42:38 +02:00
Corentin Chary
634e06b779 euscan: don't fail if robots.txt can't be read
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 08:41:13 +02:00
Corentin Chary
bcda1a7ce3 euscan: add --ebuild-uri to use ${PV}, etc.
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-20 08:41:12 +02:00
volpino
c483ac41f1 euscanwww: using djcelery.schedulers.DatabaseScheduler for periodic tasks
Signed-off-by: volpino <fox91@anche.no>
2012-07-18 17:16:31 +02:00
volpino
339ae58445 euscan: Added first implementation of the script to scrape debian watch
Signed-off-by: volpino <fox91@anche.no>
2012-07-18 14:02:26 +02:00
volpino
58532b2136 euscan: #!/usr/bin/python -> #!/usr/bin/env python
Signed-off-by: volpino <fox91@anche.no>
2012-07-18 10:48:14 +02:00
volpino
8268e634f0 euscanwww: Report problems is hided and can be shown with a click
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 19:05:26 +02:00
volpino
d70e4cb617 euscanwww: Adding unstable to legenda
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 16:53:28 +02:00
volpino
748fa12462 euscanwww: Display unstable versions in package table list
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 16:51:38 +02:00
volpino
b052f2e8b8 euscanwww: scan_portage get paths using eix and PORTDB
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 16:34:33 +02:00
volpino
be146163f6 euscanwww: Displaying unstable versions in package view
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 13:18:44 +02:00
volpino
a85f7e71c1 euscanwww: Version.version_type -> Version.vtype
Signed-off-by: volpino <fox91@anche.no>
2012-07-17 12:30:55 +02:00
volpino
33a06d99fb euscan: added --ignore-pre-release and --ignore-pre-release-if-stable
options

Signed-off-by: volpino <fox91@anche.no>
2012-07-17 12:27:22 +02:00
volpino
c4577c5279 euscanwww: Store ebuild and metadata path in Version
Uses getRepositoryPath, change if possible

Signed-off-by: volpino <fox91@anche.no>
2012-07-17 11:36:59 +02:00
volpino
b7d772dfc3 euscanwww: Tests unwatch too
Signed-off-by: volpino <fox91@anche.no>
2012-07-14 16:43:12 +02:00
volpino
66db910583 euscanwww: Tests for watch packages/categories/maintainers/herds
Signed-off-by: volpino <fox91@anche.no>
2012-07-14 16:22:02 +02:00
volpino
c0aefdef29 euscanwww: Started writing tests for favourite stuff but login fails
Signed-off-by: volpino <fox91@anche.no>
2012-07-14 15:29:42 +02:00
volpino
bd2af29ff7 euscanwww: Basic user dashboard
Signed-off-by: volpino <fox91@anche.no>
2012-07-14 13:56:21 +02:00
volpino
aa09812f6f euscanwww: Migration for handling ebuild and metadata paths
Signed-off-by: volpino <fox91@anche.no>
2012-07-14 13:55:56 +02:00
volpino
a9265ec5d1 euscan: Performance improvement moving imports
Signed-off-by: volpino <fox91@anche.no>
2012-07-10 18:14:41 +02:00
volpino
3f0cef09e0 euscan: Fixed typo in out.py. euscan output was broken
Signed-off-by: volpino <fox91@anche.no>
2012-07-10 17:41:24 +02:00
volpino
fab19a6bfc euscanwww: Watch/unwatch packages, categories, maintainers, overlays
Added a button for watch/unwatch and a dashboard with user selected
stuff only

Signed-off-by: volpino <fox91@anche.no>
2012-07-10 16:15:06 +02:00
volpino
02be58024a euscanwww: Minor fixes
Signed-off-by: volpino <fox91@anche.no>
2012-07-09 18:15:34 +02:00
volpino
379a6d2942 euscanwww: Adding a problem reporting form in package page
Signed-off-by: volpino <fox91@anche.no>
2012-07-09 14:29:42 +02:00
volpino
03cf3b90a4 euscanwww: Upgraded to Celery 3.0 and fixed scan_portage
Fixed TaskSet calls and synchronous stuff. Everything should be
deadlock safe

Signed-off-by: volpino <fox91@anche.no>
2012-07-07 18:09:14 +02:00
volpino
3be52a710c euscanwww: Changing RefreshPackageQuery.query to ForeignKey
Signed-off-by: volpino <fox91@anche.no>
2012-07-07 15:46:35 +02:00
volpino
a6b215cec9 euscanwww: Fixed tasks to work with processing.scan and processing.misc
Fixed tasks to work with processing.* changes.
Moved periodic tasks config to settings.py using CELERYBEAT_SCHEDULE

Signed-off-by: volpino <fox91@anche.no>
2012-07-07 15:13:59 +02:00
volpino
80e8157627 Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-03 11:13:35 +02:00
Corentin Chary
2f0080e544 git: update .gitignore
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-03 10:57:07 +02:00
Corentin Chary
bdff6b7c63 euscanwww/scan_portage: try using gentoopm and fix slots
gentoopm is still slower with portage backend, will try pkgcore
backend later.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-03 10:56:14 +02:00
Corentin Chary
8062fddc23 euscanwww: move processing to scan and misc, enhance update_portage_tree
update_portage_tree() now:
- watch stderr and stdout for each command
- use layman command instead of layman API for sync because
  layman API doesn't work when stdout or stderr is not a real file
  (we could probably work around that with pipes and epoll)
- use egencache instead of emerge to generate cache
- export PORTAGE_CONFIGROOT, ROOT, EIX_CACHEFILE etc.. so they
  are used everywhere

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 18:16:59 +02:00
volpino
5a2f2e9eab Merge branch 'master' of https://github.com/iksaif/euscan 2012-07-02 17:45:31 +02:00
volpino
6407efa14f euscan: naive implementation of --mirror
Signed-off-by: volpino <fox91@anche.no>
2012-07-02 17:44:55 +02:00
Corentin Chary
90702ddee8 euscan: don't import pkg_resources, we don't want all these warnings
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:20:52 +02:00
Corentin Chary
84a764dad5 euscan: allow --progress with --quiet
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:20:18 +02:00
Corentin Chary
ba805536ad euscanwww: add --category to scan_metadata, remove homepage and description
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 11:19:49 +02:00
Corentin Chary
0e32ccf46e euscanwww: make it work with MySQL
unique indexes length must be <= 255

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:44:00 +02:00
Corentin Chary
093cb4da47 euscanwww/scan_portage: fixes and add --category
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 09:43:31 +02:00
Corentin Chary
ad5e399096 euscanwww: move start_dev_services.sh to scripts
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-07-02 08:09:06 +02:00
volpino
71f71c5b58 euscanwww: fixed commit_on_success
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 19:21:43 +02:00
volpino
09f0f75a42 Merge branch 'master' of https://github.com/iksaif/euscan 2012-06-30 18:37:04 +02:00
volpino
f43ab3ae3d euscanwww: fixing merge
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 18:36:45 +02:00
Corentin Chary
728770088c euscan: don't respect robots.txt for mono download site
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-30 15:57:56 +02:00
volpino
94b814481b euscanwww: adding elem.clear() to prevent memory leaking in xml parsing
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 11:03:24 +02:00
volpino
145388a5e5 euscanwww: scan_upstream_all_task scans in randomized order
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:50:17 +02:00
volpino
c6f5fb0b7c euscanwww: reverting removed purge_packages in scan_package_task
Signed-off-by: volpino <fox91@anche.no>
2012-06-30 10:42:26 +02:00