1
0
Fork 0
mirror of synced 2024-07-03 05:20:52 +12:00
Commit graph

341 commits

Author SHA1 Message Date
Nick Sweeting 1edb14b229 wip config reset command 2019-04-26 14:43:23 -04:00
Nick Sweeting 2b4244bb52 allow setting config via aliases and show side effect changes in stderr 2019-04-26 14:43:13 -04:00
Nick Sweeting 4d6ad7a65d add archivebox config command and move config into sections 2019-04-25 19:03:38 -04:00
Nick Sweeting 583d77bc31 use exit status 2 for errors to avoid confusion with no results status 2019-04-25 19:02:44 -04:00
Nick Sweeting ce33a46866 make index_only option skip archive updating 2019-04-25 19:01:58 -04:00
Nick Sweeting d2a51f68c0 fix bug in archivebox info using exausted generator 2019-04-25 19:01:22 -04:00
Nick Sweeting df4307c4ff move config loading into function for easier runtime reloading 2019-04-25 19:00:25 -04:00
Nick Sweeting d248684839 add index-only option to archivebox add and update 2019-04-25 18:59:41 -04:00
Nick Sweeting 95a7d3d1de add space in human readable sizes 2019-04-24 11:45:04 -04:00
Nick Sweeting 56d0b2c088 new methods for detecting valid/invalid data dirs on init 2019-04-24 11:40:10 -04:00
Nick Sweeting ae782a1a0c allow filtering for specific files when getting dir size 2019-04-24 11:39:34 -04:00
Nick Sweeting 168d253c17 show human readable filesize in version info 2019-04-24 11:39:02 -04:00
Nick Sweeting b0ace38273 warn user that no admins exist when starting runserver 2019-04-24 11:38:37 -04:00
Nick Sweeting 03470699d3 ignore json parsing errors when loading link jsons 2019-04-24 11:38:13 -04:00
Nick Sweeting e91cdfbc88 add rudimentary method to parse back html index into urls 2019-04-24 11:37:51 -04:00
Nick Sweeting 3825ddc095 add method to get admins list 2019-04-24 11:37:30 -04:00
Nick Sweeting 327da95928 add classes to make it easier to parse html links index 2019-04-24 11:37:08 -04:00
Nick Sweeting 8f63f24002 better Link string and is_archived methods 2019-04-24 11:36:47 -04:00
Nick Sweeting 11fd436305 use new mypy TypedDict to manage config typing 2019-04-24 11:36:14 -04:00
Nick Sweeting 461a8b0d71 use new config vars for html index writing 2019-04-24 04:10:02 -04:00
Nick Sweeting 6235d859dc seamless archive init and migration process across versions 2019-04-24 04:09:50 -04:00
Nick Sweeting 5ef5415f3f rename archive toggles from FETCH_ to SAVE_ for clarity 2019-04-24 04:09:25 -04:00
Nick Sweeting 0f2497a2a6 add functions to parse link details jsons and list+apply migrations 2019-04-24 04:07:46 -04:00
Nick Sweeting 0b27f33d2e fix sql link parsing and writing 2019-04-24 04:06:54 -04:00
Nick Sweeting 735db84022 add some missing defaults to Archivebox.conf.default 2019-04-23 22:36:43 -04:00
Nick Sweeting ba7144f6f3 customize django admin ui chrome 2019-04-22 21:40:42 -04:00
Nick Sweeting b44281919d add todo comment for mlazana 2019-04-22 19:10:22 -04:00
Nick Sweeting 71402c3d09 add manage command and shell welcome message 2019-04-22 19:08:01 -04:00
Nick Sweeting 834aaa1591 better template staticfile management with themes dir 2019-04-22 19:07:39 -04:00
Nick Sweeting f0f516e853 check for data folder when running most subcommands 2019-04-22 19:06:48 -04:00
Nick Sweeting 2f0dbeebc1 update docstrings and comments 2019-04-22 14:42:04 -04:00
Nick Sweeting ab68819332 add archivebox info command to scan data dir 2019-04-22 14:34:30 -04:00
Nick Sweeting 50b947f41d add md5 hashes to dependencies dict 2019-04-22 14:34:12 -04:00
Nick Sweeting 29ced7b5c8 allow running archivebox core commands from manage.py 2019-04-22 13:36:27 -04:00
Nick Sweeting 168e578ea4 fix bad default in scheduler 2019-04-22 13:21:08 -04:00
Nick Sweeting 354895aef1 django admin to view links now working 2019-04-22 13:20:19 -04:00
Nick Sweeting f489dd96a9 fix archivebox remove rejecting stdin patterns 2019-04-22 13:19:47 -04:00
Drewry Pope 332a32f4f9
Resolve 3 typos in util.py 2019-04-20 02:59:44 -05:00
Nick Sweeting 39a0ab3013 add pipenv, schedule cmd, logs dir, and lots more 2019-04-18 21:10:00 -04:00
Nick Sweeting 4f869f235f add package headers 2019-04-17 22:00:54 -04:00
Nick Sweeting 920898e160 working archivebox-server command 2019-04-17 05:42:35 -04:00
Nick Sweeting 669bd6bee4 first views for archivebox server 2019-04-17 05:42:21 -04:00
Nick Sweeting 289a6ea30f fix database file location and init process 2019-04-17 05:42:09 -04:00
Nick Sweeting 88a37bc552 fix json list output 2019-04-17 05:41:41 -04:00
Nick Sweeting 35aa8c8902 clearer sql parsing and dumping 2019-04-17 03:50:41 -04:00
Nick Sweeting cdb70c73df first working django model with archivebox-shell command and sql exporting 2019-04-17 03:49:18 -04:00
Nick Sweeting ecf95d398a cleanup after test output 2019-04-17 02:27:38 -04:00
Nick Sweeting 8101ce7f23 add tests 2019-04-17 02:25:39 -04:00
Nick Sweeting 9ce47431da better loading and saving storage mechanism 2019-04-17 02:25:28 -04:00
Nick Sweeting c95f893b61 use out_dir instead of link_dir 2019-04-17 02:23:45 -04:00
Nick Sweeting 8b4b13b667 accept multiple pattern args for removal 2019-04-17 02:22:29 -04:00
Nick Sweeting 21174da014 better data folder checking on startup 2019-04-17 02:22:19 -04:00
Nick Sweeting 22bea7a4f6 use atomic writes inside to_json helper func 2019-04-16 23:22:24 -04:00
Nick Sweeting 717e390ef6 remove derived link info in favor of derived Link properties 2019-04-16 23:21:24 -04:00
Nick Sweeting 50d368b1bc log matching links in a more logical place 2019-04-16 23:20:31 -04:00
Nick Sweeting 1e759084f3 dedupe urls using exact url instead of fuzzy url 2019-04-16 23:19:44 -04:00
Nick Sweeting 6e5a77e1ad check data folder on startup 2019-04-16 23:19:21 -04:00
Nick Sweeting fafdef1e6d prevent running as root 2019-04-16 23:18:42 -04:00
Nick Sweeting 3fb10dbf35 working better removal ux 2019-04-11 08:11:32 -04:00
Nick Sweeting 525f8beb55 better no links found message 2019-04-11 07:00:34 -04:00
Nick Sweeting d8d8f7c2cc working consistent list and remove with filtering 2019-04-11 07:00:26 -04:00
Nick Sweeting 4ca9a0beac colorized and better command sorting in help msg 2019-04-11 06:59:30 -04:00
Nick Sweeting 718e25c973 better dependency checking system and guards 2019-04-11 03:42:35 -04:00
Nick Sweeting fafe6e75c5 fix version in footer linking to git sha instead of release tag 2019-04-11 03:42:12 -04:00
Nick Sweeting d08978d66c always hide progress bar even when exceptions are thrown 2019-04-11 03:41:50 -04:00
Nick Sweeting 0272c9b8c0 deduplicate method history when merging links 2019-04-11 03:41:25 -04:00
Nick Sweeting 0d2f7eb58e expand user tildes in paths 2019-04-11 03:41:05 -04:00
Nick Sweeting bcfe17bc87 define database file in config.py 2019-04-11 03:40:37 -04:00
Nick Sweeting b69f26297b restrict wget filenames to windows-fs compatible characters 2019-04-11 03:40:16 -04:00
Nick Sweeting 4f599c0b0b
escape all non-windows-friendly filenames 2019-04-10 22:46:20 -04:00
Nick Sweeting eb2b6978c3 comment out uninmplemented args 2019-04-03 03:52:56 -04:00
Nick Sweeting fd80275856 print import instructions on first run 2019-04-03 01:54:15 -04:00
Nick Sweeting 749f06fe5b simplify bin shortcut 2019-04-03 00:29:58 -04:00
Nick Sweeting 51ae634ec9 working argparse based CLI with most commands implemented 2019-04-03 00:27:37 -04:00
Nick Sweeting 68b4c01c6b working archivebox command inside django legacy folder 2019-04-02 18:53:21 -04:00
Nick Sweeting 27708152d2 wip initial django setup 2019-04-02 16:36:41 -04:00
luoliyan 924de7f68c Update purge script to match codebase cleanup 2019-04-02 13:13:07 +09:30
Nick Sweeting 03f300d050 always patch all links 2019-03-30 23:47:56 -04:00
Nick Sweeting f1075f2c7d fix links index 2019-03-30 23:43:53 -04:00
Nick Sweeting 97249a1861 handle urls with special characters properly 2019-03-30 22:25:10 -04:00
Nick Sweeting 6a8f6f52af 0 mypy errors 2019-03-30 21:29:16 -04:00
Nick Sweeting f4e018ba0c fix a bunch of mypy errors 2019-03-30 20:49:45 -04:00
Nick Sweeting eef8ca29f0 hide compression detection failure during config setup 2019-03-30 20:31:28 -04:00
Nick Sweeting ac9fed06fd whitespace 2019-03-30 17:59:56 -04:00
Nick Sweeting 880b425df6 add note about saving timestamp strings independently 2019-03-30 17:57:39 -04:00
Nick Sweeting 6d92784dbb add docstring about timestamp parsing 2019-03-30 17:51:23 -04:00
Nick Sweeting 8283b353f4 fix wget_auto_compression check prining stderr to console 2019-03-30 17:43:44 -04:00
Nick Sweeting fffeb21ad4 remove progress dots in title fetching 2019-03-30 15:50:32 -04:00
Nick Sweeting 1e45b02684 add flake8 config 2019-03-30 15:41:26 -04:00
Nick Sweeting 03a388300f fix link parsing 2019-03-30 15:38:28 -04:00
Nick Sweeting b58afcf974 fix broken import 2019-03-30 15:37:36 -04:00
Nick Sweeting 5d0185b6dd Merge branch 'master' into dev 2019-03-30 15:36:54 -04:00
Nick Sweeting 1191cf1df1 fix importerror of scheme 2019-03-30 15:04:43 -04:00
Nick Sweeting 73f46b0b29 add proper typechecked json parsing and dumping 2019-03-30 15:03:46 -04:00
Nick Sweeting 35c05c321f minor bin version checking changes 2019-03-30 15:03:31 -04:00
Nick Sweeting 529a0f8bb2
fix broken function name 2019-03-30 15:00:21 -04:00
Nick Sweeting 066b36b6a9
make URL_BLACKLIST empty by default 2019-03-30 14:56:19 -04:00
Nick Sweeting 9cdceecda8 final link rewrite on ctrl+c 2019-03-27 20:49:09 -04:00
Nick Sweeting 4c8e45b8d7 save all imports to sources dir 2019-03-27 20:48:41 -04:00
Nick Sweeting cc3d1e9cc9 limit length of stringified arg_vals in exceptions 2019-03-27 18:26:22 -04:00