1
0
Fork 0
mirror of synced 2024-06-26 18:10:24 +12:00
Commit graph

42 commits

Author SHA1 Message Date
Nick Sweeting eb47155a12 major refactor + ability to handle http downloads 2017-10-18 17:39:09 -05:00
Marco Rossi 17d07239f0 Add custom archive directory as configuration option. 2017-08-20 17:37:49 +02:00
Nick Sweeting 6bb91fbb45 dont hide real exceptions 2017-07-05 17:15:39 -05:00
Nick Sweeting a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00
Nick Sweeting f33330ebbf fix pdf and screenshot links 2017-07-04 04:28:38 -05:00
Nick Sweeting 59dbf725a6 syntax error 2017-07-04 04:09:42 -05:00
Nick Sweeting f0c7a6f558 fix archive url calculation for urls ending in slash 2017-07-04 04:09:00 -05:00
Nick Sweeting d59bdbc86a fix archive urls not pointing to .html wget versions!! 2017-07-04 04:03:09 -05:00
Nick Sweeting e0f702bccd always show cmd that failed for error messages 2017-07-04 04:02:47 -05:00
Nick Sweeting 432d5c2dbc default to fetching requisites 2017-07-04 03:29:42 -05:00
Nick Sweeting e09c704d50 disable wget --mirror in favor of timestamping 2017-07-04 03:21:47 -05:00
Nick Sweeting 0551e5b9e0 fix archive.org chmod and wget error msg 2017-07-04 03:15:17 -05:00
Nick Sweeting 72d6eb9e1e add TIMEOUT and FETCH_WGET_IMAGES options, fix chmod dir 2017-07-04 03:09:47 -05:00
Nick Sweeting 555583b20b refactor chmod into function 2017-07-04 03:02:01 -05:00
Nick Sweeting fa8a7bde80 more granular errors 2017-07-04 02:50:24 -05:00
Nick Sweeting 263f71862a wget images too, print stderr on fail 2017-07-04 02:42:57 -05:00
Brian Hardisty 71159bdcaa
Fix Pinboard JSON duplicate timestamps error
If the JSON exported by Pinboard contains duplicate timestamps, Python
returns a TypeError exception:

`TypeError: argument of type 'float' is not iterable`

This is because `time.mktime()` returns a floating point number.
Encasing `time.mktime()` in `str()` fixes the data type not being
iterable.

`time.mktime()` has also been encased in `int()` to remove the
unnecessary decimal value (`.0`) that gets returned for each time value,
and to keep the script consistent with the other export functions.
2017-07-01 03:53:19 -07:00
Nick Sweeting 5f0ad792a7 add help message and docstrings 2017-06-30 03:23:45 -05:00
Nick Sweeting 9e816c6b71 whitespace 2017-06-30 02:47:19 -05:00
hannah98 b157bbd492 Override program variables with environment variables 2017-06-21 14:42:24 -05:00
Nick Sweeting b00498dc42 handle failing screenshots and PDFs better 2017-06-15 19:12:56 -05:00
Nick Sweeting 5593c58a28 fix out dir permissions 2017-06-15 18:51:42 -05:00
Nick Sweeting 2d8364a7c7 fix permissions, output html, and timeouts 2017-06-15 18:49:16 -05:00
Nick Sweeting 35ee1f90cd make service argument optional 2017-06-15 18:35:04 -05:00
Nick Sweeting 5de6b3adc1 de-duplicate timstamps if using url 2017-06-15 17:33:51 -05:00
Nick Sweeting 8ac6096b39 print timestamps and show number of links in index 2017-06-15 17:33:51 -05:00
Nick Sweeting 7a81a9f143 submit full url with scheme to archive.org 2017-06-15 17:33:51 -05:00
Nick Sweeting c292b377be add exception details 2017-06-15 17:33:51 -05:00
Nick Sweeting fa79768f1e fix unecessary re-wgetting of websites 2017-06-15 17:33:51 -05:00
Nick Sweeting 15f051f8f7 minor tweaks 2017-06-15 00:45:40 -05:00
Arcady Chumachenko 666760fe06 Removed BeautifulSoup from dependencies 2017-06-11 19:45:22 +01:00
Arcady Chumachenko 8488c57026 #18 - Parse browser bookmarks 2017-06-08 21:52:39 +01:00
Nick Sweeting 0d6e9e6341 increase chmod timeout for large folders 2017-05-31 14:31:16 -05:00
Nick Sweeting 99d5150b6e add archive.org submitting support, better parsing 2017-05-29 13:00:46 -05:00
Nick Sweeting 92f7b399ca readability url and title fixes 2017-05-22 10:40:16 -05:00
Nicolas Simon ab3fc13dec Fix default parameters parsing 2017-05-06 14:23:49 +02:00
Nicolas Simon f6149af5a9 Fix name typo in debug when no links found 2017-05-06 14:22:48 +02:00
Sconeyard 6211c0800c Add pinboard support
renaming a few variable names to be more neutral towards new services
2017-05-06 01:36:46 +02:00
Nick Sweeting 1508c6a37d add sample input comment 2017-05-05 10:54:18 -04:00
Nick Sweeting 9bce8f4c8b minor refactoring 2017-05-05 07:27:10 -04:00
Nick Sweeting 206b5fc57f initial commiit 2017-05-05 05:00:30 -04:00