Commit Graph

623 Commits

Author SHA1 Message Date
Alfred Wingate
5b9d44fee1
TODO: weird docs handling
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
d8d1767766
TODO: debian remote-id exists
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
fbd7a4e139
handlers/github: remove
* Mirror removed and api has very strict ratelimits making impractical
  to use.
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=f119d00dab0c3bd087faab36f1a44734772a9d75

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
a7ff66ae04
handlers/pypi: stop using mirrors
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
5da26b0719
handlers/rubygems: stop using mirrors
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=65850a10f84e1b7a2cdf55392fa1d1f0717193c1

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
656f8e155e
handlers/google_code: dead
* https://bugs.gentoo.org/544092

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate
294dcc2a9c
handlers/freecode: never shouldve been used in ebuilds
* https://bugs.gentoo.org/637970

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate
c628edc26b
handlers/berlios: obselete
* mirror removed in https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=2b72b0462bea5b34bbe4d767ccc44866df81515e
* Rest of the berlios urls use sourceforge now.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 19:36:20 +02:00
Alfred Wingate
61cbb8e3f9
pre-commit: autoupdate versions
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 19:11:43 +02:00
Alfred Wingate
b2cd013b09
Workaround hard to parse $'' strings
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
e9fd94e1a5
Blacklist urls that don't make sense to scan
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
e13a62af84
Remove encoding keyword from json()
* Removed in Python 3.9

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
d93c3154ac
Update GNOME_URL_SOURCE
* It gets redirected eitherway.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
9809d9a805
Add Gitea(+ Forgejo) handler
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:36 +02:00
Alfred Wingate
d217c839a9
Add GitLab handler
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 22:13:44 +02:00
Alfred Wingate
aad99f71fe
Use JSON api for PyPi
* "The XML-RPC API will be deprecated in the future. Use of this API is
  not recommended, and existing consumers of the API should migrate to
  the RSS and/or JSON APIs instead."
* "As a result, this API has a very restrictive rate limit and it may be
  necessary to pause between successive requests." As such this also
  gets around this issue for euscan.

https://warehouse.pypa.io/api-reference/xml-rpc.html

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 16:18:34 +02:00
Alfred Wingate
9465c14342
Remove more euscanwww stragglers from TODO
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 07:12:53 +02:00
Alfred Wingate
22915bade5
Fix kde handler
* It appears it was broken in the midst of 8d912379, no apparent
  rationale for it being changed there.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 07:07:11 +02:00
Alfred Wingate
443b5f62fd
Enable flake8-bugbear linting and fix raised issues
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:25:40 +02:00
Alfred Wingate
49f1fbbad1
Remove Python2'isms from classes
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:18:19 +02:00
Alfred Wingate
a03b420c75
Use OSError instead of alias IOError
https://docs.astral.sh/ruff/rules/os-error-alias/

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:15:48 +02:00
Alfred Wingate
6c0b816e73
Use f-strings or .format() over percent style
https://docs.astral.sh/ruff/rules/printf-string-formatting/

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:56:40 +02:00
Alfred Wingate
21fe4eafec
Enable pyupgrade linting
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:21:49 +02:00
Alfred Wingate
377ba2f727
N806
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:19:02 +02:00
Alfred Wingate
9f7ba6c9cd
Address N818
https://peps.python.org/pep-0008/#exception-names

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:17:14 +02:00
Alfred Wingate
764bcf9ce8
Enable PEP8 linting in ruff
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:16:25 +02:00
Alfred Wingate
c0be0e0b67
Fix invalid backslash characters
* https://docs.python.org/3/whatsnew/3.6.html#deprecated-python-behavior

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:10:40 +02:00
Alfred Wingate
d48699e5fd
Enable all pycodestyle checks in ruff
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:02:30 +02:00
Alfred Wingate
eedf3c5939
Remove euscanwww leftovers from TODO
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:51:30 +02:00
Alfred Wingate
7ac854dc61
Add changelog to python metadata
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:43:44 +02:00
Alfred Wingate
0551629a9a
Update MANIFEST.in
* Missed in previous changes

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:39:25 +02:00
Alfred Wingate
17c4e19bc5
Filter XMLParsedAsHTMLWarnings
* Parsing xhtml sites would trigger it.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:27:57 +02:00
Alfred Wingate
c489b404d1
Temporarily remove README.rst from METADATA
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 01:56:00 +02:00
Alfred Wingate
7b4951977b
Update changelog (at least the 1.0.1 changes)
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 01:41:53 +02:00
Alfred Wingate
86c88e8d30
Change default user-agent
* Better to have it be more meaningful.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 01:14:05 +02:00
Parona
f6bdd66f5f Merge branch 'revamp' into 'master'
Upgrade to PEP517 buildsystem, fix broken gentoolkit usage. Pretty up

See merge request src_prepare/euscan-ng!1
2023-11-15 22:36:44 +00:00
Alfred Wingate
3222f348d8
Use a cleaned up copy of the license
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
b4749fad3e
Fix inconsistency in --version in regards to copyright headers
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
9efcd3a842
Update copyright
* Cleanup inconsistencies in the headers while at it

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
c40d65a79e
Remove man page
* Will look into alternatives that either most likely create a final man
  page during sdist creation.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
c6e6e25862
Add publishing capability to CI
* Not yet enabled automatically due to gentoolkit

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
6c90268712
.git-blame-ignore-revs: Ignore mass formatting commits
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
a8f35aee25
Fix issues pointed out by ruff
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:07 +02:00
Alfred Wingate
70f88ed37d
Run isort on project
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
d860708ec9
Run black on project
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
a91775919c
Add pre-commit config
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
02fd3a9e79
Add gitlab CI
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
65e77ac533
Configure linting and formatting tools
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate
dfa0bb7424
Add python3.12 compatability
* imp and find_loader got removed in py3.12

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate
50a23b71dd
Get version from git with setuptools_scm
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00