Alfred Wingate
fbd7a4e139
handlers/github: remove
...
* Mirror removed and api has very strict ratelimits making impractical
to use.
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=f119d00dab0c3bd087faab36f1a44734772a9d75
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
a7ff66ae04
handlers/pypi: stop using mirrors
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
5da26b0719
handlers/rubygems: stop using mirrors
...
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=65850a10f84e1b7a2cdf55392fa1d1f0717193c1
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate
656f8e155e
handlers/google_code: dead
...
* https://bugs.gentoo.org/544092
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate
294dcc2a9c
handlers/freecode: never shouldve been used in ebuilds
...
* https://bugs.gentoo.org/637970
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate
c628edc26b
handlers/berlios: obselete
...
* mirror removed in https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=2b72b0462bea5b34bbe4d767ccc44866df81515e
* Rest of the berlios urls use sourceforge now.
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 19:36:20 +02:00
Alfred Wingate
b2cd013b09
Workaround hard to parse $'' strings
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
e9fd94e1a5
Blacklist urls that don't make sense to scan
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
e13a62af84
Remove encoding keyword from json()
...
* Removed in Python 3.9
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
d93c3154ac
Update GNOME_URL_SOURCE
...
* It gets redirected eitherway.
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate
9809d9a805
Add Gitea(+ Forgejo) handler
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:36 +02:00
Alfred Wingate
d217c839a9
Add GitLab handler
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 22:13:44 +02:00
Alfred Wingate
aad99f71fe
Use JSON api for PyPi
...
* "The XML-RPC API will be deprecated in the future. Use of this API is
not recommended, and existing consumers of the API should migrate to
the RSS and/or JSON APIs instead."
* "As a result, this API has a very restrictive rate limit and it may be
necessary to pause between successive requests." As such this also
gets around this issue for euscan.
https://warehouse.pypa.io/api-reference/xml-rpc.html
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 16:18:34 +02:00
Alfred Wingate
22915bade5
Fix kde handler
...
* It appears it was broken in the midst of 8d912379
2023-11-16 07:07:11 +02:00
Alfred Wingate
443b5f62fd
Enable flake8-bugbear linting and fix raised issues
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:25:40 +02:00
Alfred Wingate
49f1fbbad1
Remove Python2'isms from classes
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:18:19 +02:00
Alfred Wingate
a03b420c75
Use OSError instead of alias IOError
...
https://docs.astral.sh/ruff/rules/os-error-alias/
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:15:48 +02:00
Alfred Wingate
6c0b816e73
Use f-strings or .format() over percent style
...
https://docs.astral.sh/ruff/rules/printf-string-formatting/
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:56:40 +02:00
Alfred Wingate
377ba2f727
N806
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:19:02 +02:00
Alfred Wingate
c0be0e0b67
Fix invalid backslash characters
...
* https://docs.python.org/3/whatsnew/3.6.html#deprecated-python-behavior
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:10:40 +02:00
Alfred Wingate
17c4e19bc5
Filter XMLParsedAsHTMLWarnings
...
* Parsing xhtml sites would trigger it.
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:27:57 +02:00
Alfred Wingate
86c88e8d30
Change default user-agent
...
* Better to have it be more meaningful.
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 01:14:05 +02:00
Alfred Wingate
9efcd3a842
Update copyright
...
* Cleanup inconsistencies in the headers while at it
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate
a8f35aee25
Fix issues pointed out by ruff
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:07 +02:00
Alfred Wingate
70f88ed37d
Run isort on project
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
d860708ec9
Run black on project
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate
dfa0bb7424
Add python3.12 compatability
...
* imp and find_loader got removed in py3.12
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate
50a23b71dd
Get version from git with setuptools_scm
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate
bae87b0877
Fix euscan by using portage MetadataXML over gentoolkit Metadata
...
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate
c873e1520d
Change source layout
...
* In preparation for PEP517 transition.
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
