Commit Graph

30 Commits

Author SHA1 Message Date
Alfred Wingate fbd7a4e139
handlers/github: remove
* Mirror removed and api has very strict ratelimits making impractical
  to use.
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=f119d00dab0c3bd087faab36f1a44734772a9d75

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate a7ff66ae04
handlers/pypi: stop using mirrors
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate 5da26b0719
handlers/rubygems: stop using mirrors
* https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=65850a10f84e1b7a2cdf55392fa1d1f0717193c1

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:58 +02:00
Alfred Wingate 656f8e155e
handlers/google_code: dead
* https://bugs.gentoo.org/544092

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate 294dcc2a9c
handlers/freecode: never shouldve been used in ebuilds
* https://bugs.gentoo.org/637970

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 20:58:57 +02:00
Alfred Wingate c628edc26b
handlers/berlios: obselete
* mirror removed in https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=2b72b0462bea5b34bbe4d767ccc44866df81515e
* Rest of the berlios urls use sourceforge now.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 19:36:20 +02:00
Alfred Wingate b2cd013b09
Workaround hard to parse $'' strings
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate e9fd94e1a5
Blacklist urls that don't make sense to scan
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate e13a62af84
Remove encoding keyword from json()
* Removed in Python 3.9

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate d93c3154ac
Update GNOME_URL_SOURCE
* It gets redirected eitherway.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:41 +02:00
Alfred Wingate 9809d9a805
Add Gitea(+ Forgejo) handler
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-03 00:56:36 +02:00
Alfred Wingate d217c839a9
Add GitLab handler
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 22:13:44 +02:00
Alfred Wingate aad99f71fe
Use JSON api for PyPi
* "The XML-RPC API will be deprecated in the future. Use of this API is
  not recommended, and existing consumers of the API should migrate to
  the RSS and/or JSON APIs instead."
* "As a result, this API has a very restrictive rate limit and it may be
  necessary to pause between successive requests." As such this also
  gets around this issue for euscan.

https://warehouse.pypa.io/api-reference/xml-rpc.html

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2024-03-02 16:18:34 +02:00
Alfred Wingate 22915bade5
Fix kde handler
* It appears it was broken in the midst of 8d912379, no apparent
  rationale for it being changed there.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 07:07:11 +02:00
Alfred Wingate 443b5f62fd
Enable flake8-bugbear linting and fix raised issues
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:25:40 +02:00
Alfred Wingate 49f1fbbad1
Remove Python2'isms from classes
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:18:19 +02:00
Alfred Wingate a03b420c75
Use OSError instead of alias IOError
https://docs.astral.sh/ruff/rules/os-error-alias/

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 06:15:48 +02:00
Alfred Wingate 6c0b816e73
Use f-strings or .format() over percent style
https://docs.astral.sh/ruff/rules/printf-string-formatting/

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:56:40 +02:00
Alfred Wingate 377ba2f727
N806
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:19:02 +02:00
Alfred Wingate c0be0e0b67
Fix invalid backslash characters
* https://docs.python.org/3/whatsnew/3.6.html#deprecated-python-behavior

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 05:10:40 +02:00
Alfred Wingate 17c4e19bc5
Filter XMLParsedAsHTMLWarnings
* Parsing xhtml sites would trigger it.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 04:27:57 +02:00
Alfred Wingate 86c88e8d30
Change default user-agent
* Better to have it be more meaningful.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 01:14:05 +02:00
Alfred Wingate 9efcd3a842
Update copyright
* Cleanup inconsistencies in the headers while at it

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:19 +02:00
Alfred Wingate a8f35aee25
Fix issues pointed out by ruff
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-16 00:16:07 +02:00
Alfred Wingate 70f88ed37d
Run isort on project
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate d860708ec9
Run black on project
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:40 +02:00
Alfred Wingate dfa0bb7424
Add python3.12 compatability
* imp and find_loader got removed in py3.12

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate 50a23b71dd
Get version from git with setuptools_scm
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate bae87b0877
Fix euscan by using portage MetadataXML over gentoolkit Metadata
Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00
Alfred Wingate c873e1520d
Change source layout
* In preparation for PEP517 transition.

Signed-off-by: Alfred Wingate <parona@protonmail.com>
2023-11-15 23:30:39 +02:00