Commit Graph

236 Commits

Author SHA1 Message Date
volpino
4246c544ad euscanwww: bug found, celery timeouts on join. Commented out
Signed-off-by: volpino <fox91@anche.no>
2012-06-09 16:12:17 +02:00
volpino
9cddc82808 Merge branch 'master' of https://github.com/iksaif/euscan
Conflicts:
	euscanwww/djeuscan/models.py

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:46:37 +02:00
volpino
b43bf8fa28 euscanwww: Removing duplicated code
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:43:18 +02:00
volpino
43e996d83d euscanwww: Fixed the upstream task that was completely broken
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:24:17 +02:00
volpino
a6a87260b1 euscanwww: Fixed a minor bug in the task launching interface
Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:23:37 +02:00
volpino
a94a24eeac euscanwww: Refresh query logic and task queue split in chunks
Added the needed logic for running refresh queries from the web
interface.

Added a simple function to tasks.py that takes an iterable of arguments
and a task and launches many subtasks formed by 32 tasks each (for not
having a huge amount of tasks launched at the same time)

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:21:11 +02:00
volpino
8913f826de euscanwww: Added RefreshPackageQuery to models
Allows storing queries for refresh requests by users

Signed-off-by: volpino <fox91@anche.no>
2012-06-08 14:19:20 +02:00
Tim Harder
5df28b028e add support for Beautiful Soup 4 2012-06-08 00:18:59 -07:00
volpino
33555a9fbe euscanwww: Fixed Layman sync task
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 16:44:08 +02:00
volpino
8501805f8e euscanwww: Scan tasks recieve a list of packages
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:30:31 +02:00
volpino
4a9301a215 euscanwww: naive implementation of the refresh button
A refresh button lets launching a scan_upstream task for a package while
navigating into euscanwww

Signed-off-by: volpino <fox91@anche.no>
2012-06-05 13:10:25 +02:00
volpino
8ed74a74df euscanwww: Changed Layman sync task to use Python API
Signed-off-by: volpino <fox91@anche.no>
2012-06-05 12:46:22 +02:00
volpino
c41521d59f euscanwww: Admin interface tweaks
Added some search fields, ordering and filters to the admin panel

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:27:18 +02:00
volpino
60e2019cc3 euscanwww: Added tasks for syncing and updating portage tree
Added these tasks:
 * emerge_sync
 * layman_sync
 * emerge_regen
 * eix_update

Signed-off-by: volpino <fox91@anche.no>
2012-06-04 11:06:47 +02:00
Corentin Chary
5b1884ead7 djeuscan: fix alive / packaged updates
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-06-04 10:28:06 +02:00
volpino
2edb220d3e euscanwww: use jQuery each instead of for
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 17:38:51 +02:00
volpino
5970b4df37 euscanwww: Admin improved and simple task launcher added
Signed-off-by: volpino <fox91@anche.no>
2012-06-03 09:43:49 +02:00
volpino
47ec539e1d euscanwww: scan_upstream imports euscan.scan
scan_upstream command imports euscan.scan and simply calls a function,
it doesn't call a subprocess

Signed-off-by: volpino <fox91@anche.no>
2012-05-31 18:42:37 +02:00
volpino
e8718748b4 euscanwww: Celery fixes and little logging
Signed-off-by: volpino <fox91@anche.no>
2012-05-31 09:11:40 +02:00
volpino
56c4d79fb2 euscanwww: starting implementing Celery tasks
Basic tasks.py module, some fixes in the management commands

Signed-off-by: volpino <fox91@anche.no>
2012-05-30 22:54:55 +02:00
Corentin Chary
83f5df4daf euscanwww: fix the scan process
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-29 15:29:03 +02:00
volpino
c36f625a54 euscanwww: fixing colored output
Signed-off-by: volpino <fox91@anche.no>
2012-05-28 23:24:09 +02:00
volpino
fce8ef347b euscanwww: management commands are validators aware
Management commands should create objects that don't raise
ValidationError

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 22:57:33 +02:00
volpino
b46e9acc08 euscan: Refactored all management commands
Management commands are refactored to have the logic moved from the
commands themselves to a separated function in order to make them easily
convertible into Celery tasks

Commands are renamed to be modules importable from other python scripts

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 21:19:53 +02:00
volpino
e535c204b0 euscanwww: fixed homepage and category validation
Accept multiple urls but skip invalid urls, added virtual as accepted
category

Signed-off-by: volpino <fox91@anche.no>
2012-05-28 18:45:14 +02:00
Corentin Chary
7f8fb05c23 htdocs: add static symlink
(don't remember why exactly)

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
2012-05-20 11:14:50 +02:00
volpino
8563785746 model validators 2012-05-19 14:11:06 +02:00
volpino
de0ad4b210 issue #13 fixed 2012-05-13 16:42:29 +02:00
volpino
61a24fefb7 minor fix in runtests 2012-05-13 14:10:57 +02:00
volpino
c85de09947 some more cleaning, removing relative imports 2012-05-13 14:09:22 +02:00
volpino
b339efe012 tests for managers 2012-05-13 11:37:05 +02:00
volpino
2ec8cba794 feeds tests 2012-05-12 17:29:09 +02:00
volpino
c790618a51 more tests 2012-05-12 16:07:49 +02:00
volpino
d3676250ab tests refactoring and some fixes 2012-05-09 16:50:17 +02:00
volpino
9a39328e3b more and more tests 2012-05-07 14:27:54 +02:00
volpino
04d54f4689 add db journal to gitignore 2012-05-07 13:44:11 +02:00
volpino
46489c84a4 charts test 2012-05-07 10:56:54 +02:00
volpino
cb3dcaf713 test test test! 2012-05-07 10:20:33 +02:00
volpino
23f43e869a urls from future in templates 2012-05-06 20:27:14 +02:00
volpino
948c5b8c39 some tests, urls now have a name 2012-05-06 20:03:49 +02:00
volpino
0ece4c04b2 removed some code minimizations for readability 2012-05-05 16:59:34 +02:00
volpino
e0bb80f905 some cleaning 2012-05-05 16:55:59 +02:00
Federico Scrinzi
37a623a97a Merge pull request #1 from bacher09/master
Code refactoring
2012-05-05 07:43:15 -07:00
volpino
1f18782007 test reorganized, launch them with setup.py test 2012-05-05 16:09:04 +02:00
Slava Bacherikov
22ac8c4e2e Merge branch 'master' of git://github.com/volpino/euscan 2012-05-05 16:51:15 +03:00
Slava Bacherikov
3a56aa4391 Rewrote some for_ methods in PackageMixin class 2012-05-05 18:50:13 +03:00
Slava Bacherikov
b4162313f2 Change in PackageMixin, create ANNOTATE_DICT 2012-05-05 18:28:41 +03:00
Slava Bacherikov
0efba89342 Change in PackageMixin 2012-05-05 17:41:09 +03:00
volpino
52fc4a5df4 VersionLog manager 2012-05-05 11:48:12 +02:00
volpino
050c210f40 charts fix, bug introduced while refactoring 2012-05-05 11:04:44 +02:00
volpino
22bcf20c7c select_related prefetch refactored 2012-05-05 10:54:04 +02:00
volpino
5c0dbe11f2 feeds use manager 2012-05-05 10:38:51 +02:00
volpino
7ad08128cd apis now use manager 2012-05-05 10:22:59 +02:00
volpino
6464187342 changing charts.py to use manager 2012-05-05 10:09:27 +02:00
volpino
84b2a1917a PackageManager allows chaining 2012-05-05 10:03:02 +02:00
volpino
a145d8a4f6 fixing circular import 2012-05-05 10:02:17 +02:00
volpino
ab6ea22ed3 moved more stuff from views to helpers or managers 2012-05-01 21:15:55 +02:00
volpino
48de5022ba one more function moved to manager, some docs 2012-05-01 17:08:49 +02:00
volpino
8e37f6249c some refactoring, added Package manager for removing code duplicates, added helpers module, basic tests layout 2012-05-01 16:56:09 +02:00
volpino
e17e0de19a README in rst 2012-05-01 13:50:53 +02:00
volpino
ff14477f60 removing tabs and spaces mix in templates 2012-04-28 18:29:21 +02:00
volpino
8c91855a58 Lovely day for PEP8 and pylint! 2012-04-28 18:16:05 +02:00
Corentin Chary
9e1ff8adb7 euscanwww: use tz aware datetimes
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-04-23 17:05:46 +02:00
Corentin Chary
da269b0711 euscanwww: euscan -> djeuscan
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-04-04 17:31:54 +02:00
Corentin Chary
9f1cdae45e euscanwww: django 1.4 port
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-04-04 14:33:40 +02:00
Corentin Chary
d5a9b31b3c euscanwww/feeds: remove duplicate descriptions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-28 09:10:24 +02:00
Corentin Chary
37a9a742c3 euscan: cleanups
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-28 09:09:08 +02:00
Corentin Chary
697fbf06ab euscanwww/templates: add icons
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-28 09:09:08 +02:00
volpino
ac6c57cb57 adding django-annoying to requirements and deleting it from the codebase 2012-03-27 18:48:31 +02:00
Corentin Chary
5062f29e3c euscanwww: don't delete packages when deleting related versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-14 14:07:28 +01:00
Corentin Chary
2effd34b01 euscanwww: optimize commands
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-14 14:07:06 +01:00
Corentin Chary
043197a3be euscanwww: update style, prefetch related, ...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-05 14:46:34 +01:00
Corentin Chary
1d65ee1984 euscanwww: add charts bellow menu on herd/category/maintainer
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-05 11:27:53 +01:00
Corentin Chary
ff33042f36 euscanwww: add freshness and last versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 18:01:46 +01:00
Corentin Chary
d899ffb849 euscanwww: add a snapshot and some steps when importing snapshots
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 14:27:21 +01:00
Corentin Chary
d6f3b6629c euscanwww: take args from stdin and update INSTALL
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 14:08:28 +01:00
Corentin Chary
b6821903a6 euscanwww/INSTALL: basic intructions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-03-02 13:54:00 +01:00
Corentin Chary
b0664564f3 euscan: update TODO and euscan-update.sh
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:55:11 +01:00
Corentin Chary
bdd6040c12 euscanwww: remove csrf and add request processor
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:54:05 +01:00
Corentin Chary
9e47ceb311 euscanwww/templates: add some "extras"
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2012-02-14 14:53:33 +01:00
Corentin Chary
2bd012ef82 euscanwww: show maintainer name and email
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-30 11:34:54 +01:00
Corentin Chary
0e6c18b84b euscanwww: clean settings
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-12-11 14:32:55 +01:00
Corentin Chary
7ff26556d1 euscan: add basic overlay support
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-23 18:03:07 +01:00
Corentin Chary
164b427219 euscanwww/api: handle 404 correctly
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:48:47 +01:00
Corentin Chary
0ae3305a64 euscanwww/api: clean and "document" euscan API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 14:37:59 +01:00
Corentin Chary
204c53b66f euscanwww/api: remove traces
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:11:02 +01:00
Corentin Chary
0d5e1e0901 euscanwww: add basic json/xml API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-17 12:06:48 +01:00
Corentin Chary
5b2476c9a0 euscanwww: cleanups, drop stupid API
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 17:08:29 +01:00
Corentin Chary
66e20ebc26 euscanwww: enable admin
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:56:20 +01:00
Corentin Chary
a1bdde6a95 euscanwww: import local_settings and add postgres example
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-15 16:43:18 +01:00
Corentin Chary
57ed9251e8 euscan: add README, TODO and some scripts
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-11-10 14:07:53 +01:00
Corentin Chary
0ad1eecca7 euscanwww: chmod +x manage.py
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:47 +02:00
Corentin Chary
96775215fa euscanwww/scripts: sync with prod
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:13:15 +02:00
Corentin Chary
1d8e87482f euscanwww: remove progress stuff
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-30 09:10:56 +02:00
Corentin Chary
a13d593d8d euscanwww: remove unused gchartwrapper
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:48:32 +02:00
Corentin Chary
1bd42f303d euscanwww: add some json
This is not a real API, I will break it !

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-21 10:12:01 +02:00
Corentin Chary
1fae084566 euscanwwww: delete packaded versions, not upstream
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 11:31:27 +02:00
Corentin Chary
6a10041300 euscanwww/templates: save datatable state
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 09:18:20 +02:00
Corentin Chary
833f1253a1 euscanwww/templates: add appropriate copyrights
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-09-06 09:16:21 +02:00
Corentin Chary
752fb04425 euscan: shake the code
- add custom site handlers
- use a custom user agent
- fix some bugs in management commands

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-31 15:38:32 +02:00
Corentin Chary
a5cf338905 euscanwww/templates: add anchors to versions
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:22:17 +02:00
Corentin Chary
70ac94474e euscanwww/views: remove old FIXME
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:22:04 +02:00
Corentin Chary
9507d5ac4b euscanwww: enable caching
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 11:21:37 +02:00
Corentin Chary
45ca837908 euscanwww/feed: tweak feeds
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-28 10:45:46 +02:00
Corentin Chary
60bc61275e euscanwww: fix urls
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-26 13:27:46 +02:00
Corentin Chary
42a2b61f55 templates: fix feed link
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-25 16:22:20 +02:00
Corentin Chary
ac4cdcf036 media: add missing feed icon 2011-08-25 16:17:33 +02:00
Corentin Chary
d0fa19bc1d euscanwww: try to keep trace of versions change
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-25 15:39:54 +02:00
Corentin Chary
c9f9331aaf euscanwww/commands: don't keep all logs
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-22 10:46:56 +02:00
Corentin Chary
142cfe0924 euscanwww/css: change the layout
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-03 10:55:33 +02:00
Corentin Chary
2d224279f8 euscanwww/charts: add a transparent background
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-08-03 10:55:13 +02:00
Corentin Chary
421dbefdcf euscanwww: datetime is not indexed, id is
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-07-21 15:01:14 +02:00
Corentin Chary
91e928371d euscanwww: update theme
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-07-21 15:00:59 +02:00
Corentin Chary
1a482acde1 euscanwww: add weekly charts
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-05-14 23:09:00 +02:00
Corentin Chary
917a290e3a euscanwww: finish charts
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-05-05 18:10:47 +02:00
Corentin Chary
54f7771b43 euscanwww: add new charts
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-05-03 08:19:01 +02:00
Corentin Chary
120ae425af euscanwww: add --purge to scan-portage
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-29 09:24:47 +02:00
Corentin Chary
244e7d64fd scritps: handle local trees
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-27 10:14:09 +02:00
Corentin Chary
0aba96f66f euscanwww: charts, about, etc...
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-25 22:27:32 +02:00
Corentin Chary
a247472568 euscanwww: it's better with a valid syntax
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-19 11:54:53 +02:00
Corentin Chary
7808fd22b7 euscanwww: clean settings.py
(no, the password wasn't the real password)

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-19 11:52:47 +02:00
Corentin Chary
9786444a46 euscanwww: display multiple homepages correctly
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-19 11:33:28 +02:00
Corentin Chary
3f9d2e5599 euscanwww: better index
Thanks to George Prowse for the idea.

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-19 11:32:48 +02:00
Corentin Chary
46eb0e9e2a euscanwww: fix 'world' and add the last log on the package view
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-18 21:49:27 +02:00
Corentin Chary
9c13c22c5e euscanwww/media: remove .odd and .even
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-18 21:49:14 +02:00
Corentin Chary
60a12b4938 euscan: fix update script
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-18 21:21:23 +02:00
Corentin Chary
e5278e0e0f euscanwww/media: strip css
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-17 22:20:43 +02:00
Corentin Chary
1d391e6389 euscanwww: add example euscan-update script
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-17 22:19:57 +02:00
Corentin Chary
10e491f972 euscanwww: finish ``world'' feature
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-16 11:44:57 +02:00
Corentin Chary
c8d0e5a789 euscanwww: big ugly commit, sorry
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-15 19:28:37 +02:00
Corentin Chary
2dee08dfb7 euscanwww: category, categories and package views
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-15 00:24:45 +02:00
Corentin Chary
25964491dd euscanwww: big commit
- fix commands
- import DataTables
- initial category view

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-14 19:28:38 +02:00
Corentin Chary
a2cd1f48bc euscanwww: implement scan-upstream, fix other commands
Also break migrations :).

Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-14 08:52:26 +02:00
Corentin Chary
2a61dfa982 euscanwwww: implement scan-portage and scan-metadata
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-13 19:00:31 +02:00
Corentin Chary
482e54cfce euscanwww: import new website
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-13 08:50:24 +02:00
Corentin Chary
2bbd20279c euscanwww: initial structure
Signed-off-by: Corentin Chary <corentincj@iksaif.net>
2011-04-12 16:09:17 +02:00