1
0
Fork 0
mirror of synced 2024-10-01 17:47:46 +13:00
Commit graph

275 commits

Author SHA1 Message Date
OMEGARAZER
192ea38ea1
Oauth2 updates
Change to allow use of client id without secret.
2023-06-16 16:00:05 -04:00
OMEGARAZER
912311ee3d
Flickr update
Adds coverage for videos.
2023-06-12 23:24:20 -04:00
OMEGARAZER
42264f0872
Add Flickr 2023-06-12 17:59:37 -04:00
OMEGARAZER
62fe08db13
B311 2023-06-05 22:06:54 -04:00
OMEGARAZER
a8c757072b
B607/603 coverage 2023-06-05 22:06:53 -04:00
Serene
9ae17b7ae2
Merge pull request #792 from OMEGARAZER/Bandit 2023-05-29 14:47:33 +10:00
Serene
dd6f12345e
Merge pull request #818 from OMEGARAZER/Annotations 2023-05-29 13:04:10 +10:00
Serene
bb41e4a1e6
Merge pull request #853 from OMEGARAZER/downvoted 2023-05-29 12:45:55 +10:00
Serene
9f32492cb8
Merge pull request #861 from OMEGARAZER/imgchest 2023-05-29 12:44:04 +10:00
OMEGA_RAZER
85ab2590a9
Merge branch 'development' into imgur 2023-05-25 18:17:30 -04:00
OMEGARAZER
b081f5cc37
Refactor Imgur
Refactor Imgur to be able to test getting ID and mark downloads as slow as they are currently rate limited through Github.

Also removed hash tests for nsfw links as they are being removed by Imgur.
2023-05-25 18:14:35 -04:00
OMEGARAZER
ceecb4d6ac
Add imgchest downloader
Adds downloader for imgchest albums
2023-05-25 13:32:38 -04:00
OMEGARAZER
a05ece3013
Add option for downvoted posts 2023-05-04 22:03:02 -04:00
Soulsuck24
8d6101112b
Redgif coverage
better coverage for thumbs subdomains and direct links to images.
2023-04-29 14:08:08 -04:00
OMEGARAZER
38bef1d1e0
Add Catbox downloader
Adds downloader for catbox.moe collections.
2023-04-27 16:14:17 -04:00
OMEGARAZER
3b69d83892
ANN001
ANN001 fixes
2023-03-10 15:29:07 -05:00
OMEGARAZER
c27fcb08d7
ANN205
ANN205 fixes
2023-03-10 15:29:06 -05:00
OMEGARAZER
0c4cfd8b44
ANN202
ANN202 fixes
2023-03-10 15:28:22 -05:00
OMEGARAZER
a5f5df7ab3
ANN201
ANN201 fixes
2023-03-10 15:28:22 -05:00
OMEGARAZER
caa4421c78
ANN204
ANN204 fixes
2023-03-10 15:28:22 -05:00
OMEGARAZER
1705884dce
Use proper user agent string 2023-03-05 17:22:44 -05:00
Soulsuck24
dd283130e3
Imgur fixes
Update regex for links styled as direct and album
2023-02-27 15:53:47 -05:00
OMEGARAZER
005454a5c2
Don't create directory if not needed
Moves creation of parent directories after dupe check so directories are not made if not needed.
2023-02-26 16:52:39 -05:00
OMEGARAZER
47fb5d38ad
Bandit fixes
Fixes S101 in connector
Noqa S104 in oauth2
2023-02-24 14:48:33 -05:00
Soulsuck24
80c66c8c78
Erome fixes
Fixes searched class to not include thumbnails of other albums.
2023-02-18 23:59:32 -05:00
Serene
911410608a
Merge pull request #780 from OMEGARAZER/Quote-cleanup 2023-02-19 10:39:15 +10:00
OMEGARAZER
8f9bed0874
Harden requests
Moves bare requests out of site downloaders into the base_downloader and add timeout exception handling now that there is a default timeout.
2023-02-18 17:36:00 -05:00
OMEGARAZER
98aa3d7cb6
Quote cleanup
cleanup of some strings to prioritize outer double quotes when both are present or switch to double quotes when only single is present.
2023-02-18 16:06:32 -05:00
OMEGARAZER
5c57de7c7d
B907 Cleanup/updates
Cleanup some double quoted locations based on bugbear B907 and add same formatting to some other locations the emphasis may be helpful.
2023-02-18 15:58:05 -05:00
Serene
0051877e01
Merge pull request #769 from OMEGARAZER/gfycat-api 2023-02-12 11:45:25 +10:00
Serene
e5b184ef9a
Merge pull request #762 from OMEGARAZER/pyupgrade-lint 2023-02-12 11:45:00 +10:00
OMEGARAZER
55384cd0f0
UP032 2023-02-11 15:30:54 -05:00
OMEGARAZER
0e28c7ed7c
Gfycat API
Moves Gfycat to use API via site access key.

Adds cachetools as dependency to reuse API keys for Gfycat/Redgifs at 95% of their TTL. Include tests to verify caching.

Updates versions of requests/yt-dlp/black/isort/pytest.

Added default timeout to requests calls.

Adds validate-pyproject and blacken-docs to pre-commit as well as updates versions.
2023-02-11 15:23:08 -05:00
OMEGARAZER
0bf44e5d82
UP012 2023-02-11 15:07:26 -05:00
OMEGARAZER
4a91ff6293
Version logged
Adds to end log message to include type of run and version of BDFR

REF: https://github.com/aliparlakci/bulk-downloader-for-reddit/issues/764#issuecomment-1414552069_
2023-02-03 23:39:25 -05:00
Serene
7676ff06a3
Merge pull request #766 from bunny-foofoo/development 2023-02-03 13:20:40 +10:00
OMEGARAZER
a535fee574
Black update
Black version 23.1.0 updates
2023-02-02 11:50:47 -05:00
Bunny
07e38a7709 fix #753 2023-02-01 19:26:16 -08:00
Soulsuck24
0e23dcb8ad
Gfycat/Redgifs coverage
Coverage for direct gfycat links that redirect to redgifs. The redirect through the sites themselves are broken but this fixes that.

Coverage for o.imgur links and incorrect capitalisation of domains in download_factory.

Changed tests for direct as gfycat is handled by the gfycat downloader.

fix pornhub test as the previous video was removed.
2023-01-30 14:52:08 -05:00
OMEGARAZER
95c8c72271
UP008 2023-01-28 23:58:36 -05:00
OMEGARAZER
247ea5ddd0
UP009 2023-01-28 23:56:23 -05:00
OMEGARAZER
63b0607f58
bugbear B007 2023-01-28 02:04:06 -05:00
OMEGARAZER
cf5f7bfd16
pep585 and pathlib updates 2023-01-25 22:23:59 -05:00
Serene
e96b167b71
Merge pull request #748 from Soulsuck24/development 2023-01-25 20:25:21 +10:00
Soulsuck24
105ceaf386
More Redgifs coverage 2023-01-25 04:43:06 -05:00
OMEGARAZER
5fbe64dc71
Move Imgur to API
Moves Imgur to use API with public Client-ID.
2023-01-21 17:49:31 -05:00
OMEGARAZER
8e60a12517
Imgur thumbnail coverage
Coverage for links posted to thumbnail variations.
2023-01-09 20:53:53 -05:00
OMEGARAZER
0f94c98733
Account for new gallery url
Coverage for gallery urls
2023-01-09 12:48:24 -05:00
Serene-Arc
8f17bcf43b Modify code to accept pluggable logging handlers 2023-01-08 15:21:57 +10:00
Soulsuck24
579c5ab8eb
Add new Redgifs subdomain
Seems there's a v3 subdomain now (looks like it's mostly for mobile)
2023-01-06 11:56:54 -05:00