1
0
Fork 0
mirror of synced 2024-10-01 17:47:46 +13:00
Commit graph

197 commits

Author SHA1 Message Date
Serene
5b23f6688a Filter non-submissions (#212) 2021-04-18 16:44:51 +03:00
Serene-Arc
c13f2806fa Fix case where Gfycat fails after redirect 2021-04-18 16:44:51 +03:00
Serene-Arc
0d78e16b2d Make sure to log all exceptions to file 2021-04-18 16:44:51 +03:00
Serene-Arc
faa3c20713 Fix bug where folder is created too late 2021-04-18 16:44:51 +03:00
Serene-Arc
3ca2df067f Fix bs4 warning by specifying parser 2021-04-18 16:44:51 +03:00
Serene-Arc
1215bc69de Refactor Imgur class to be hardier 2021-04-18 16:44:51 +03:00
Serene-Arc
ba2ab25c2c Rename options 2021-04-18 16:44:34 +03:00
Serene-Arc
2b885451e7 Add ability to make hard links for duplicates 2021-04-18 16:44:34 +03:00
Serene-Arc
902f796178 Refactor Erome class 2021-04-18 16:44:34 +03:00
Serene-Arc
6a1e652628 Refactor redgifs 2021-04-18 16:44:34 +03:00
Serene-Arc
03c8d524a4 Refactor Gfycat class 2021-04-18 16:44:34 +03:00
Serene-Arc
540b237da6 Fix Erome downloader 2021-04-18 16:44:34 +03:00
Serene-Arc
0929469bef Fix Gallery 2021-04-18 16:44:34 +03:00
Serene-Arc
a9028434c4 Generalise test 2021-04-18 16:44:34 +03:00
Serene-Arc
f13e029e47 Refactor downloader 2021-04-18 16:44:34 +03:00
Serene-Arc
a54a1c6dfa Update GifDeliveryNetwork tests 2021-04-18 16:44:34 +03:00
Serene-Arc
423155a846 Add some more Gallery tests 2021-04-18 16:44:34 +03:00
Serene-Arc
ed26907e0d Refactor Gallery downloader 2021-04-18 16:44:34 +03:00
Serene-Arc
3e9a846e2e Refactor Reddit Gallery tests 2021-04-18 16:44:34 +03:00
Serene-Arc
bc7ccc0964 Refactor Erome downloader 2021-04-18 16:44:34 +03:00
Serene-Arc
29441e7244 Change Erome tests to valid links 2021-04-18 16:44:34 +03:00
Serene-Arc
8eddaeaff4 Change logging message 2021-04-18 16:44:34 +03:00
Serene-Arc
9941215643 Fix index being added to single resources 2021-04-18 16:44:34 +03:00
Serene-Arc
3a093d0844 Add shortcut in download for certain errors 2021-04-18 16:44:34 +03:00
Serene-Arc
6aab009204 Update RedditDownloader tests 2021-04-18 16:44:34 +03:00
Serene-Arc
28b7deb6d3 Rename function 2021-04-18 16:44:34 +03:00
Serene-Arc
e042d985b5 Load default config from package directory 2021-04-18 16:44:34 +03:00
Serene-Arc
06261cc5cd Add some more integration tests 2021-04-18 16:44:34 +03:00
Serene-Arc
447855cb74 Fix config directory name 2021-04-18 16:44:20 +03:00
Serene-Arc
b08c31a1db Add integration tests for archiver 2021-04-18 16:44:20 +03:00
Serene-Arc
c2d3cfd50f Add more tests for file name formatter 2021-04-18 16:44:20 +03:00
Serene-Arc
1bf1db707c Add XML and YAML to archiver 2021-04-18 16:44:20 +03:00
Serene-Arc
959b55a939 Add beginning of archiver 2021-04-18 16:44:20 +03:00
Serene-Arc
a93813ca45 Fix some wrong pytest marks 2021-04-18 16:44:20 +03:00
Serene-Arc
1b191e7a0e Add logging entry 2021-04-18 16:44:06 +03:00
Serene-Arc
b8faffaf1f Add a couple more integration tests 2021-04-18 16:44:06 +03:00
Serene-Arc
56966ea6b4 Fix bug where user is deleted 2021-04-18 16:44:06 +03:00
Serene-Arc
36b6aafbc1 Limit name byte length 2021-04-18 16:44:06 +03:00
Serene-Arc
f9809caa42 Fix typo 2021-04-18 16:44:06 +03:00
Serene-Arc
d977595bde Add error catch for youtube and site downloaders 2021-04-18 16:44:06 +03:00
Serene-Arc
9417e0cc04 Remove bad encapsulating try-except 2021-04-18 16:44:06 +03:00
Serene-Arc
4d91cf7c0f Shorten filenames that are too long 2021-04-18 16:44:06 +03:00
Serene-Arc
ba6cf42096 Add shortened Youtube links to downloader factory 2021-04-18 16:44:06 +03:00
Serene-Arc
ae0269e13b Add option to search for files pre-emptively 2021-04-18 16:44:06 +03:00
Serene-Arc
285d422c0e Add some more integration tests 2021-04-18 16:44:06 +03:00
Serene-Arc
af348a05dd Add some integration tests 2021-04-18 16:44:06 +03:00
Serene-Arc
2b9dc1b96c Allow subreddits and multireddits to fail individually 2021-04-18 16:44:06 +03:00
Serene-Arc
fc6e5872b2 Add log entry at end of program 2021-04-18 16:44:06 +03:00
Serene-Arc
6657f0803d Fix bug with users in un-authenticated sessions 2021-04-18 16:44:06 +03:00
Serene-Arc
3e18997652 Move logfiles into configuration directory on OS 2021-04-18 16:44:06 +03:00
Serene-Arc
6d6327a396 Add function to calculate all existing file hashes if wanted 2021-04-18 16:44:06 +03:00
Serene-Arc
f941161014 Add much more logging 2021-04-18 16:44:06 +03:00
Serene-Arc
312769cb66 Remove unused file 2021-04-18 16:44:06 +03:00
Serene-Arc
f7989ca518 Add method to sanitise subreddit inputs 2021-04-18 16:44:06 +03:00
Serene-Arc
d3c8897f6a Fix bug where file extension is never specified for text posts 2021-04-18 16:44:05 +03:00
Serene-Arc
945116063f Allow for ID or URL to be provided for submissions 2021-04-18 16:44:05 +03:00
Serene-Arc
3703d2b9b9 Load config from arguments first 2021-04-18 16:44:05 +03:00
Serene-Arc
50531c7b3e Switch from argparse to click 2021-04-18 16:44:05 +03:00
Serene-Arc
dd522c18d4 Add missing options to Configuration 2021-04-18 16:44:05 +03:00
Serene-Arc
f8347e2d31 Add function to process click contexts for config 2021-04-18 16:44:05 +03:00
Serene-Arc
271c0b989d Abstract configuration into class 2021-04-18 16:44:05 +03:00
Serene-Arc
92386000d8 Implement missed test 2021-04-18 16:44:05 +03:00
Serene-Arc
48233fad36 Update tests with new valid links 2021-04-18 16:44:05 +03:00
Serene-Arc
1046bcdf69 Add last few tests for RedditDownloader 2021-04-18 16:44:05 +03:00
Serene-Arc
d78c4ca78e Add indexing for multiple resources from one submission 2021-04-18 16:44:05 +03:00
Serene-Arc
eca5da7f46 Add test for resource 2021-04-18 16:44:05 +03:00
Serene-Arc
25f70463f3 Allow for single root folder 2021-04-18 16:44:05 +03:00
Serene-Arc
839b6f50a9 Update regex for finding extension 2021-04-18 16:44:05 +03:00
Serene-Arc
a471629287 Convert some strings to f-strings 2021-04-18 16:44:05 +03:00
Serene-Arc
09e42ff5f9 Add some more tests for downloader 2021-04-18 16:44:05 +03:00
Serene-Arc
d2cc3e8b6a Add authenticated Reddit instance fixture 2021-04-18 16:44:05 +03:00
Serene-Arc
14b63487bc Immediately write token to disk in case it is unused 2021-04-18 16:44:05 +03:00
Serene-Arc
cfd92a8d14 Add some logging output 2021-04-18 16:44:05 +03:00
Serene-Arc
1f62a7ccd6 Fix function return 2021-04-18 16:44:05 +03:00
Serene-Arc
d8a767e8da Fix option default 2021-04-18 16:44:05 +03:00
Serene-Arc
933be21392 Update tests 2021-04-18 16:44:05 +03:00
Serene-Arc
afe618916b Make sure refresh token is always written to file 2021-04-18 16:44:05 +03:00
Serene-Arc
db6c64d0ab Fix some tests 2021-04-18 16:44:05 +03:00
Serene-Arc
7d30af3559 Add empty authenticator 2021-04-18 16:44:05 +03:00
Serene-Arc
735833503f Fix wrong if condition 2021-04-18 16:44:05 +03:00
Serene-Arc
862121cac6 Fix OAuth2 2021-04-18 16:44:05 +03:00
Serene-Arc
36f516e3f0 Re-implement OAuth2 2021-04-18 16:44:05 +03:00
Serene-Arc
95876b3400 Fix typing 2021-04-18 16:44:05 +03:00
Serene-Arc
7c2b7b0e83 Move scope regex parsing 2021-04-18 16:44:05 +03:00
Serene-Arc
dd1831b0ea Remove unimplemented test 2021-04-18 16:44:05 +03:00
Serene-Arc
cf1029de80 Fix error with verbose argument settings 2021-04-18 16:44:05 +03:00
Serene-Arc
1422591bf4 Change quotes 2021-04-18 16:44:05 +03:00
Serene-Arc
5a2e045c77 Add OAuth2 class 2021-04-18 16:44:05 +03:00
Serene-Arc
aeb9afdc66 Rename file with custom exceptions 2021-04-18 16:44:05 +03:00
Serene-Arc
b705c31630 Add some more tests for RedditDownloader 2021-04-18 16:44:05 +03:00
Serene-Arc
6f86dbd552 Add error 2021-04-18 16:44:05 +03:00
Serene-Arc
5e914b5234 Re-add missing argument 2021-04-18 16:44:05 +03:00
Serene-Arc
ac08a639ba Tighten exception block 2021-04-18 16:44:05 +03:00
Serene-Arc
9e6ec9f1ca Add some tests for RedditDownloader 2021-04-18 16:44:05 +03:00
Serene-Arc
ea42471932 Add function to validate formatting strings 2021-04-18 16:44:05 +03:00
Serene-Arc
c01fc39671 Update arguments 2021-04-18 16:44:05 +03:00
Serene-Arc
7b33ec07fd Add test for Vreddit 2021-04-18 16:44:05 +03:00
Serene-Arc
2dce3108a1 Base Vreddit class on Youtube downloader 2021-04-18 16:44:05 +03:00
Serene-Arc
ad3aeece07 Refactor Youtube downloader 2021-04-18 16:44:05 +03:00
Serene-Arc
62d99a9cad Add rest of tests for DownloadFactory 2021-04-18 16:44:05 +03:00