Serene
6dcef83666
Add ability to disable modules ( #434 )
...
* Fix test name to match standard
* Rename file
* Add ability to disable modules
* Update README
* Fix missing comma
* Fix more missing commas. sigh...
Co-authored-by: Ali Parlakçı <parlakciali@gmail.com>
2021-06-06 13:47:56 +03:00
Serene
434aeb8feb
Add a combined command for the archiver and downloader: clone ( #433 )
...
* Simplify downloader function
* Add basic scraper class
* Add "scrape" command
* Rename "scrape" command to "clone"
* Add integration tests for clone command
* Update README
* Fix failing test
2021-06-06 13:29:09 +03:00
Ali Parlakçı
a2f010c40d
Merge pull request #432 from Serene-Arc/enhancement_429
...
Allow --user to be specified multiple times
2021-06-06 13:25:00 +03:00
Ali Parlakçı
6839c65bd6
Merge pull request #396 from Serene-Arc/bug_fix_385
...
Add path limit check
2021-06-06 13:24:22 +03:00
Serene-Arc
79fba4ac4a
Fix indent
2021-05-31 13:42:41 +10:00
Serene-Arc
6caa02adb1
Update failing test
2021-05-27 15:58:40 +10:00
Serene-Arc
12a508c898
Update failing test
2021-05-27 15:29:43 +10:00
Serene-Arc
bf50618590
Add macOS value to test
2021-05-27 15:27:02 +10:00
Serene-Arc
c89de29f72
Update test condition
2021-05-27 15:27:02 +10:00
Serene-Arc
9a1e1ebea1
Add path limit fix
2021-05-27 15:27:02 +10:00
Serene-Arc
be00bfb1bb
Update README
2021-05-27 15:24:18 +10:00
Serene-Arc
6b78a23484
Allow --user to be specified multiple times
2021-05-27 15:22:58 +10:00
Ali Parlakçı
80bb4a8b5e
Update bug_report.md
2021-05-25 13:58:30 +03:00
Ali Parlakçı
346df4726d
Merge pull request #427 from Serene-Arc/bug_fix_386
...
Add a file blacklist to the direct downloader
2021-05-25 13:54:41 +03:00
Serene-Arc
fef2fc864b
Update blacklist
2021-05-25 19:33:32 +10:00
Serene-Arc
87959028e5
Add blacklist for web filetypes
2021-05-25 19:20:51 +10:00
Serene-Arc
f47688812d
Rename function
2021-05-25 18:51:24 +10:00
Serene-Arc
b74e93d2b7
Fix typo in test name
2021-05-25 18:51:00 +10:00
Serene
0b5f18430f
Merge pull request #425 from Serene-Arc/bug_fix_424
...
Fix download retries logic
2021-05-25 10:02:04 +10:00
Serene-Arc
323b2d2b03
Fix download retries logic
2021-05-25 09:56:22 +10:00
Serene-Arc
4c42469c0c
Update failing tests
2021-05-24 12:19:15 +10:00
Serene
a511c706c7
Merge pull request #419 from Serene-Arc/bug_fix_407
2021-05-23 12:30:20 +10:00
Serene-Arc
1b23e38ce4
Update script to include new message
2021-05-23 12:25:04 +10:00
Serene-Arc
e2582ecb3e
Catch error with MacOS writing per issue #407
2021-05-23 12:17:14 +10:00
Serene-Arc
47a4951279
Rename variable
2021-05-23 12:13:44 +10:00
Serene-Arc
5aae6b3df8
Add another message type
2021-05-22 11:53:44 +10:00
Serene-Arc
527a8af7b7
Update script to extract IDs
2021-05-22 11:53:44 +10:00
Serene-Arc
4395dd4646
Update logging messages to include submission IDs
2021-05-22 11:53:44 +10:00
Serene-Arc
da72d8ac2d
Remove unneeded backslashes
2021-05-22 11:53:44 +10:00
Serene-Arc
a104a154fc
Simplify method structure
2021-05-22 11:53:44 +10:00
Ali Parlakci
da8c64ec51
Read files in chunks instead when hashing ( #416 )
2021-05-22 08:46:39 +10:00
Ali Parlakçı
6e34493bb1
Merge pull request #415 from aliparlakci/revert-breaking-change
...
Revert `--skip-id` to `--exclude-id`
2021-05-21 11:37:42 +03:00
Ali Parlakci
cf6905db28
Reverts #384
2021-05-21 00:22:44 +03:00
Ali Parlakçı
bfa6e4da5a
Merge pull request #409 from Ailothaen/master
...
Adding info to threads and comments: distinguished, spoiler, pinned, locked
2021-05-21 00:04:53 +03:00
Ailothaen
f4c1adaa9a
Added tests for new data in threads/comments (2/2)
2021-05-20 22:47:33 +02:00
Ailothaen
9d6e54148b
Added tests for new data in threads/comments
2021-05-20 22:41:02 +02:00
Ailothaen
827f1ab80e
Adding some more info in threads and comments: distinguished, spoiler, locked, sticky
2021-05-20 18:26:50 +02:00
Ali Parlakci
32b29f5413
Ignore IDE files
2021-05-19 21:59:38 +03:00
Ali Parlakçı
8fb5103d09
Adds download count badge
2021-05-19 13:58:53 +03:00
Serene-Arc
830e4f2830
Catch additional error
2021-05-19 10:09:46 +10:00
Serene-Arc
3b28ad24b3
Fix bug with some Imgur extensions
2021-05-19 09:57:27 +10:00
Serene-Arc
32f72c35ec
Update script to catch more failed IDs
2021-05-18 18:26:28 +10:00
Serene-Arc
122aa2839b
Remove bad test case
2021-05-18 12:06:10 +10:00
Ali Parlakci
a75cc0dee9
Add file modified date test
2021-05-17 22:05:33 +10:00
Ali Parlakci
b9c0edaebc
Merge branch 'Serene-Arc-reddit_connector_refactor' into development
2021-05-17 13:54:04 +03:00
Ali Parlakci
7c401b1461
Merge branch 'reddit_connector_refactor' of https://github.com/Serene-Arc/bulk-downloader-for-reddit into Serene-Arc-reddit_connector_refactor
2021-05-17 13:53:48 +03:00
Serene
c581bef790
Set file creation times to the post creation time ( #391 )
2021-05-17 13:49:35 +03:00
Serene-Arc
fa04d61eb8
Refactor archiver tests
2021-05-17 11:50:17 +10:00
Serene-Arc
7016603763
Refactor out super class RedditConnector
2021-05-17 11:50:17 +10:00
Serene-Arc
71da1556e5
Change out of date test case
2021-05-17 11:15:50 +10:00
