1
0
Fork 0
mirror of synced 2024-09-21 11:51:20 +12:00
Commit graph

311 commits

Author SHA1 Message Date
Nick Sweeting
b44281919d add todo comment for mlazana 2019-04-22 19:10:22 -04:00
Nick Sweeting
71402c3d09 add manage command and shell welcome message 2019-04-22 19:08:01 -04:00
Nick Sweeting
834aaa1591 better template staticfile management with themes dir 2019-04-22 19:07:39 -04:00
Nick Sweeting
f0f516e853 check for data folder when running most subcommands 2019-04-22 19:06:48 -04:00
Nick Sweeting
2f0dbeebc1 update docstrings and comments 2019-04-22 14:42:04 -04:00
Nick Sweeting
ab68819332 add archivebox info command to scan data dir 2019-04-22 14:34:30 -04:00
Nick Sweeting
50b947f41d add md5 hashes to dependencies dict 2019-04-22 14:34:12 -04:00
Nick Sweeting
29ced7b5c8 allow running archivebox core commands from manage.py 2019-04-22 13:36:27 -04:00
Nick Sweeting
168e578ea4 fix bad default in scheduler 2019-04-22 13:21:08 -04:00
Nick Sweeting
354895aef1 django admin to view links now working 2019-04-22 13:20:19 -04:00
Nick Sweeting
f489dd96a9 fix archivebox remove rejecting stdin patterns 2019-04-22 13:19:47 -04:00
Nick Sweeting
39a0ab3013 add pipenv, schedule cmd, logs dir, and lots more 2019-04-18 21:10:00 -04:00
Nick Sweeting
4f869f235f add package headers 2019-04-17 22:00:54 -04:00
Nick Sweeting
920898e160 working archivebox-server command 2019-04-17 05:42:35 -04:00
Nick Sweeting
669bd6bee4 first views for archivebox server 2019-04-17 05:42:21 -04:00
Nick Sweeting
289a6ea30f fix database file location and init process 2019-04-17 05:42:09 -04:00
Nick Sweeting
88a37bc552 fix json list output 2019-04-17 05:41:41 -04:00
Nick Sweeting
35aa8c8902 clearer sql parsing and dumping 2019-04-17 03:50:41 -04:00
Nick Sweeting
cdb70c73df first working django model with archivebox-shell command and sql exporting 2019-04-17 03:49:18 -04:00
Nick Sweeting
ecf95d398a cleanup after test output 2019-04-17 02:27:38 -04:00
Nick Sweeting
8101ce7f23 add tests 2019-04-17 02:25:39 -04:00
Nick Sweeting
9ce47431da better loading and saving storage mechanism 2019-04-17 02:25:28 -04:00
Nick Sweeting
c95f893b61 use out_dir instead of link_dir 2019-04-17 02:23:45 -04:00
Nick Sweeting
8b4b13b667 accept multiple pattern args for removal 2019-04-17 02:22:29 -04:00
Nick Sweeting
21174da014 better data folder checking on startup 2019-04-17 02:22:19 -04:00
Nick Sweeting
22bea7a4f6 use atomic writes inside to_json helper func 2019-04-16 23:22:24 -04:00
Nick Sweeting
717e390ef6 remove derived link info in favor of derived Link properties 2019-04-16 23:21:24 -04:00
Nick Sweeting
50d368b1bc log matching links in a more logical place 2019-04-16 23:20:31 -04:00
Nick Sweeting
1e759084f3 dedupe urls using exact url instead of fuzzy url 2019-04-16 23:19:44 -04:00
Nick Sweeting
6e5a77e1ad check data folder on startup 2019-04-16 23:19:21 -04:00
Nick Sweeting
fafdef1e6d prevent running as root 2019-04-16 23:18:42 -04:00
Nick Sweeting
3fb10dbf35 working better removal ux 2019-04-11 08:11:32 -04:00
Nick Sweeting
525f8beb55 better no links found message 2019-04-11 07:00:34 -04:00
Nick Sweeting
d8d8f7c2cc working consistent list and remove with filtering 2019-04-11 07:00:26 -04:00
Nick Sweeting
4ca9a0beac colorized and better command sorting in help msg 2019-04-11 06:59:30 -04:00
Nick Sweeting
718e25c973 better dependency checking system and guards 2019-04-11 03:42:35 -04:00
Nick Sweeting
fafe6e75c5 fix version in footer linking to git sha instead of release tag 2019-04-11 03:42:12 -04:00
Nick Sweeting
d08978d66c always hide progress bar even when exceptions are thrown 2019-04-11 03:41:50 -04:00
Nick Sweeting
0272c9b8c0 deduplicate method history when merging links 2019-04-11 03:41:25 -04:00
Nick Sweeting
0d2f7eb58e expand user tildes in paths 2019-04-11 03:41:05 -04:00
Nick Sweeting
bcfe17bc87 define database file in config.py 2019-04-11 03:40:37 -04:00
Nick Sweeting
b69f26297b restrict wget filenames to windows-fs compatible characters 2019-04-11 03:40:16 -04:00
Nick Sweeting
eb2b6978c3 comment out uninmplemented args 2019-04-03 03:52:56 -04:00
Nick Sweeting
fd80275856 print import instructions on first run 2019-04-03 01:54:15 -04:00
Nick Sweeting
749f06fe5b simplify bin shortcut 2019-04-03 00:29:58 -04:00
Nick Sweeting
51ae634ec9 working argparse based CLI with most commands implemented 2019-04-03 00:27:37 -04:00
Nick Sweeting
68b4c01c6b working archivebox command inside django legacy folder 2019-04-02 18:53:21 -04:00
Nick Sweeting
27708152d2 wip initial django setup 2019-04-02 16:36:41 -04:00
Nick Sweeting
03f300d050 always patch all links 2019-03-30 23:47:56 -04:00
Nick Sweeting
f1075f2c7d fix links index 2019-03-30 23:43:53 -04:00
Nick Sweeting
97249a1861 handle urls with special characters properly 2019-03-30 22:25:10 -04:00
Nick Sweeting
6a8f6f52af 0 mypy errors 2019-03-30 21:29:16 -04:00
Nick Sweeting
f4e018ba0c fix a bunch of mypy errors 2019-03-30 20:49:45 -04:00
Nick Sweeting
ac9fed06fd whitespace 2019-03-30 17:59:56 -04:00
Nick Sweeting
880b425df6 add note about saving timestamp strings independently 2019-03-30 17:57:39 -04:00
Nick Sweeting
6d92784dbb add docstring about timestamp parsing 2019-03-30 17:51:23 -04:00
Nick Sweeting
8283b353f4 fix wget_auto_compression check prining stderr to console 2019-03-30 17:43:44 -04:00
Nick Sweeting
fffeb21ad4 remove progress dots in title fetching 2019-03-30 15:50:32 -04:00
Nick Sweeting
1e45b02684 add flake8 config 2019-03-30 15:41:26 -04:00
Nick Sweeting
03a388300f fix link parsing 2019-03-30 15:38:28 -04:00
Nick Sweeting
b58afcf974 fix broken import 2019-03-30 15:37:36 -04:00
Nick Sweeting
5d0185b6dd Merge branch 'master' into dev 2019-03-30 15:36:54 -04:00
Nick Sweeting
1191cf1df1 fix importerror of scheme 2019-03-30 15:04:43 -04:00
Nick Sweeting
73f46b0b29 add proper typechecked json parsing and dumping 2019-03-30 15:03:46 -04:00
Nick Sweeting
35c05c321f minor bin version checking changes 2019-03-30 15:03:31 -04:00
Nick Sweeting
529a0f8bb2
fix broken function name 2019-03-30 15:00:21 -04:00
Nick Sweeting
066b36b6a9
make URL_BLACKLIST empty by default 2019-03-30 14:56:19 -04:00
Nick Sweeting
9cdceecda8 final link rewrite on ctrl+c 2019-03-27 20:49:09 -04:00
Nick Sweeting
4c8e45b8d7 save all imports to sources dir 2019-03-27 20:48:41 -04:00
Nick Sweeting
cc3d1e9cc9 limit length of stringified arg_vals in exceptions 2019-03-27 18:26:22 -04:00
Nick Sweeting
8b50fee0f5 better type checking of latest output methods 2019-03-27 18:25:17 -04:00
Nick Sweeting
d2a34f2602 switch to atomic disk writes for all index operations 2019-03-27 18:24:57 -04:00
Nick Sweeting
a214bd7c02 make everything take link_dir as an optional arg since its derivable from link url 2019-03-27 18:24:30 -04:00
Nick Sweeting
9fc1e3c3e1 provide migration hint when initializing 2019-03-27 18:21:53 -04:00
Nick Sweeting
a26c2fe467 show full version info using flag 2019-03-27 16:44:00 -04:00
Nick Sweeting
3375522ff4 remove uneeded bin shortcuts 2019-03-27 15:49:41 -04:00
Nick Sweeting
64f92af60b working setuptools package distribution 2019-03-27 15:39:30 -04:00
Nick Sweeting
93216a3c3e new version handling and absolute imports 2019-03-27 15:35:13 -04:00
Nick Sweeting
bc1bc9fe02 htmldecode all urls and titles during parsing 2019-03-27 15:33:59 -04:00
Nick Sweeting
b1b0c8d1c5 show prettier failure output during link archiving 2019-03-27 15:33:12 -04:00
Nick Sweeting
ea695b8bef remove dataclass for ArchiveIndex in favor of plain dict to simplify schema file 2019-03-27 15:32:39 -04:00
Nick Sweeting
88721512d4 more detailed parsing and indexing cli output 2019-03-27 15:16:53 -04:00
Nick Sweeting
b9839500b2 make archivebox use current directory as OUTPUT_DIR by default 2019-03-27 15:15:51 -04:00
Nick Sweeting
0ad8d51f0e remove base32 crockford in favor of dependency 2019-03-27 15:14:47 -04:00
Nick Sweeting
2e8008009e make main compatible with setuptools entrypoint api 2019-03-27 15:14:22 -04:00
Nick Sweeting
79b319a48c make archive.py runnable as package and as module 2019-03-27 15:13:47 -04:00
mlazana
8502fa5cc3 config.py: update function exclude_blacklisted(links) 2019-03-27 20:10:05 +02:00
mlazana
a3705e31c6 Merge remote-tracking branch 'upstream/master' 2019-03-27 20:03:07 +02:00
Nick Sweeting
002206d4fe remove distutils in favor of shutil 2019-03-27 11:39:51 -04:00
Nick Sweeting
e1a1ea25dd add readability script 2019-03-27 11:39:28 -04:00
Nick Sweeting
7ae680a461 Merge branch 'master' into dev 2019-03-27 10:36:29 -04:00
Nick Sweeting
0835baf435 show link titles in black 2019-03-27 10:31:44 -04:00
Nick Sweeting
407484b91e show progress during main index writing 2019-03-27 10:31:22 -04:00
Nick Sweeting
19e1c35f1a support loading link indexes with extra keys 2019-03-27 10:31:07 -04:00
Nick Sweeting
6bec1709f6
Update config.py 2019-03-27 04:48:38 -04:00
Nick Sweeting
98870ba428 fit bigger titles with tighter spacing 2019-03-27 03:56:38 -04:00
Nick Sweeting
d2cf260e7c css tweaks 2019-03-27 03:52:38 -04:00
Nick Sweeting
2ed91fe429 new details page design 2019-03-27 03:49:39 -04:00
Nick Sweeting
c9c5b04df0 full type-hinting coverage 2019-03-26 23:25:07 -04:00
Nick Sweeting
ab09560f14 working runtime type casting and enforcement for a wide range of types 2019-03-26 22:26:21 -04:00