1
0
Fork 0
mirror of synced 2024-06-16 17:35:15 +12:00
Commit graph

105 commits

Author SHA1 Message Date
Nick Sweeting 76abc58135 switch to strict type hints with NamedTuples instead of dicts 2019-03-26 05:33:34 -04:00
Nick Sweeting 4f8c99011a fix terminal resizing making progress bar go crazy 2019-03-26 05:30:23 -04:00
Nick Sweeting 63abc8980c add mypy type hints 2019-03-26 03:20:41 -04:00
Nick Sweeting f7a0568a6c better chrome options loading 2019-03-22 23:00:53 -04:00
Nick Sweeting 4c499d77b6 move dependency checking into config file 2019-03-22 22:05:45 -04:00
Nick Sweeting d06775923b move latest to derived data using history 2019-03-22 21:38:08 -04:00
Nick Sweeting 69f837bbf6 simplify chrome_user_data_dir default 2019-03-22 21:37:02 -04:00
Nick Sweeting 8f73fdbe09 fix chrome profile precedence order to be equal 2019-03-22 21:31:55 -04:00
Nick Sweeting bd9f3e313f better logging during long output 2019-03-22 15:09:39 -04:00
Nick Sweeting d798117081 better separation of archive method checking and running logic 2019-03-21 05:35:41 -04:00
Nick Sweeting e6bd1f8ca8 major codebase-wide code cleanups 2019-03-21 01:28:12 -04:00
Nick Sweeting 5ee1c39720 remove flawed link_type concept in favor of simpler staticfile detection 2019-03-20 21:11:29 -04:00
Nick Sweeting ac56023bfd fix wget_output_path relative location building 2019-03-20 02:37:27 -04:00
Nick Sweeting f9a7c530b9 fix pinboard RSS parser 2019-03-19 18:44:22 -04:00
Nick Sweeting 61ec4971e9 fix nested archive index page and improve wget output finding 2019-03-19 18:10:11 -04:00
Nick Sweeting eb5cc8078a better UX before titles have been fetched during archiving progress 2019-03-19 18:10:11 -04:00
Nick Sweeting 914750c453 better title regex to match titles surrounded by newlines 2019-03-19 18:10:11 -04:00
Nick Sweeting 2e10f57f6e fix relative links from index files 2019-03-08 17:46:14 -05:00
Nick Sweeting 450b4534ad actually fix path 2019-03-08 17:10:18 -05:00
Nick Sweeting 5c401007d3 fix output path 2019-03-08 17:05:53 -05:00
Nick Sweeting c7fc9e1878 remove dead code and cleanup utils file 2019-03-08 17:01:15 -05:00
Nick Sweeting 354ea142e7 fix double path in archive_url 2019-03-08 16:31:25 -05:00
Nick Sweeting b2ccb7dbcb refactor error hint printing to be DRYer 2019-03-08 16:25:42 -05:00
Nick Sweeting 14e66a6909 use derived_link_info more consistently in index generation 2019-03-03 14:10:18 -05:00
Nick Sweeting b4dc80b0a7 when checking link invariants, check for regex match as well 2019-02-27 04:50:29 -05:00
Nick Sweeting fa6f53f2af used derived info for all derivable info 2019-02-27 04:50:29 -05:00
Nick Sweeting ef4c446c8b new compiled URL regex with better markdown support 2019-02-27 04:50:29 -05:00
Nick Sweeting 09d79e55a0 remove derivable link info from links 2019-02-27 04:50:29 -05:00
Nick Sweeting eb003f6a26 better function naming 2019-02-27 04:50:29 -05:00
Nick Sweeting 328a59749b better remote file downloading cli output messages 2019-02-27 04:50:29 -05:00
Nick Sweeting b03e9fade8 better link corruption guards, remove title prefetching, save index after run 2019-02-21 17:45:28 -05:00
Nick Sweeting d689264365 add new config and dependency options 2019-02-21 15:47:15 -05:00
Nick Sweeting 34cfde0c4e dont fetch titles when FETCH_TITLE=False 2019-02-21 12:58:51 -05:00
Nick Sweeting 935dcac0c7 fix title showing up as None in some UI spots 2019-02-19 02:40:02 -05:00
Nick Sweeting 2c9aad559d use urllib for url parsing instead of hand written string commands 2019-02-19 01:45:19 -05:00
Nick Sweeting 5a7d00a639 fetch page title during archiving process 2019-02-19 01:44:54 -05:00
Nick Sweeting 56d382235f better progress output 2019-02-06 22:06:36 -08:00
Nick Sweeting 1ca27a60b2 show dots as progress bar for titles fetching 2019-02-04 22:07:59 -08:00
Nick Sweeting ca8f57ef5c add dedicated shaarli rss parser 2019-02-04 21:18:42 -08:00
root fb00f1f336 fix flickering progress bars 2019-02-05 04:45:36 +00:00
Nick Sweeting bc6de29a5a recreate chunks on each new progress bar 2019-02-04 20:41:35 -08:00
Nick Sweeting 3ac0efb619 dont parse quotes as part of urls 2019-02-04 18:54:02 -08:00
Nick Sweeting c37941efd1 dont match closing tags in full text 2019-01-31 19:46:34 -08:00
Nick Sweeting 2c30cd9468 better closure 2019-01-23 01:08:23 -05:00
Nick Sweeting db0461ec4e add timeout to title fetching 2019-01-23 01:08:23 -05:00
Nick Sweeting ce07a6c738 patch subprocess.run to have better timeout handling 2019-01-20 14:08:33 -05:00
Nick Sweeting e620722bb9 fix timeouts hanging the progressbar 2019-01-20 14:08:33 -05:00
Nick Sweeting 7ea36c4adb bump timeouts and improve curl archive method 2019-01-20 14:08:33 -05:00
Nick Sweeting 39f5e12364 allow passing import list via stdin 2019-01-14 18:11:48 -05:00
Nick Sweeting 6189b1a8af fix invalid old config vars 2019-01-12 03:13:55 -05:00
Nick Sweeting d35c6cf8b5 fix fetch page title default 2019-01-11 05:19:22 -05:00
Nick Sweeting 67d103a293 dont float round timestamps 2019-01-11 05:19:07 -05:00
Nick Sweeting cf9d1875c7 add plain text link parsing 2019-01-11 04:09:39 -05:00
Nick Sweeting 0e72addcda remove requests dependency 2019-01-09 04:05:34 -05:00
Nick Sweeting 57d42339a4 rename pip dir archive to archivebox 2018-12-31 20:53:01 -05:00
Renamed from archiver/util.py (Browse further)