1
0
Fork 0
mirror of synced 2024-07-05 06:20:37 +12:00
Commit graph

10 commits

Author SHA1 Message Date
Tim Schuster ba8307c27e Quick Fix for Wrong Argument Splitting on wget
When setting the user agent, the resulting CLI arguments for wget where `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '-', '-', 'u', 's', 'e', 'r', '-', 'a', 'g', 'e', 'n', 't', '=', '"', 'L', 'y', 'n', 'x', '"', 'https://example.org']`, with this fix it turns into `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '--user-agent="Lynx"', '', 'https://example.org']`
2017-07-08 15:19:43 +02:00
Nick Sweeting acf59faa06 add custom WGET_USER_AGENT override option 2017-07-06 16:51:41 -05:00
Nick Sweeting 648223fc6c wonky exception 2017-07-05 17:30:00 -05:00
Nick Sweeting 5122fa0738 better format wget output 2017-07-05 17:28:09 -05:00
Nick Sweeting 02f711b8cb fix CHROME_BINARY and TIMEOUT configs not being used 2017-07-05 17:26:36 -05:00
Nick Sweeting b894e0ff92 properly handle Archive.org denied by robots.txt 2017-07-05 16:57:19 -05:00
Nick Sweeting a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting 60ffe0b2b4 hardcode more encodings 2017-07-04 06:26:46 -05:00
Nick Sweeting 881de8adbe minor url fixes and refactoring 2017-07-04 06:24:03 -05:00
Nick Sweeting fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00