Nick Sweeting
|
49b77b91bb
|
fix unused var
|
2021-03-27 05:12:54 -04:00 |
|
Nick Sweeting
|
3e26ae4a66
|
support finding multiple urls as substrings in text
|
2021-03-27 04:30:40 -04:00 |
|
Nick Sweeting
|
f3a3d76439
|
support adding urls with tags directly via CLI and add page
|
2021-03-27 04:30:15 -04:00 |
|
Nick Sweeting
|
5fb9ca389f
|
check more url parsing invariants on startup
|
2021-03-27 03:57:22 -04:00 |
|
Nick Sweeting
|
fea0b89dbe
|
add tag cli option
|
2021-03-27 03:57:05 -04:00 |
|
Nick Sweeting
|
d486f8c162
|
use tempfile when logs dir is not available
|
2021-03-27 02:17:12 -04:00 |
|
Nick Sweeting
|
3c2f4c95cf
|
fix unused import
|
2021-03-27 01:50:26 -04:00 |
|
Nick Sweeting
|
56c6b11b14
|
add comment
|
2021-03-27 01:19:32 -04:00 |
|
Nick Sweeting
|
bd6d9c165b
|
enforce utf8 on literally all file operations because windows sucks
|
2021-03-27 01:16:29 -04:00 |
|
Nick Sweeting
|
185d2f9f9b
|
check for JSON1 extesnion in Sqlite on startup
|
2021-03-27 00:27:58 -04:00 |
|
Nick Sweeting
|
177d22da50
|
fix clicking add tag when no tag is selected throwing 500
|
2021-03-01 01:39:06 -05:00 |
|
Nick Sweeting
|
76ff789164
|
fix tags page rendering when snapshot has no updated timestamp
|
2021-03-01 00:40:41 -05:00 |
|
Nick Sweeting
|
0036e9cce2
|
add migration
|
2021-02-28 22:55:12 -05:00 |
|
Nick Sweeting
|
9fc9f52cfb
|
increase sqlite timeout and dont check for same thread condition
|
2021-02-28 22:55:00 -05:00 |
|
Nick Sweeting
|
1cabde3ccd
|
remove atomic transactions
|
2021-02-28 22:54:40 -05:00 |
|
Nick Sweeting
|
844b5c5e20
|
minor db fix
|
2021-02-28 22:54:04 -05:00 |
|
Nick Sweeting
|
62089fdb22
|
close sqlite3 connections if unused
|
2021-02-28 22:53:34 -05:00 |
|
Nick Sweeting
|
6aef1dd98d
|
dont check db if init is pending
|
2021-02-28 22:53:23 -05:00 |
|
Nick Sweeting
|
acbce25201
|
missing migrations
|
2021-02-18 08:05:05 -05:00 |
|
Nick Sweeting
|
9ead76f9f8
|
cross link snapshot index, admin, and actions pages using uuids
|
2021-02-18 08:04:50 -05:00 |
|
Nick Sweeting
|
c257ae240e
|
only enable debug toolbar if nothreading is on
|
2021-02-18 08:04:26 -05:00 |
|
Nick Sweeting
|
ca2bb673ea
|
improve inline admin forms and add tags autocomplete
|
2021-02-18 08:04:14 -05:00 |
|
Nick Sweeting
|
33df9c1ebe
|
fix after and before in remove tests
|
2021-02-18 06:21:44 -05:00 |
|
Nick Sweeting
|
9c07fbdc0b
|
unused import fix
|
2021-02-18 05:56:00 -05:00 |
|
Nick Sweeting
|
106f6adc59
|
fix lgtm alerts
|
2021-02-18 04:29:24 -05:00 |
|
Nick Sweeting
|
46a4197514
|
fix tests
|
2021-02-18 04:26:56 -05:00 |
|
Nick Sweeting
|
13c2b7c8eb
|
fix url used by gridview
|
2021-02-18 02:38:30 -05:00 |
|
Nick Sweeting
|
e3b69c450c
|
move db checks under check_db if statement
|
2021-02-18 02:37:33 -05:00 |
|
Nick Sweeting
|
74a9dd8880
|
add missing migrations
|
2021-02-18 02:36:21 -05:00 |
|
Nick Sweeting
|
7282f4a42a
|
add favicon and robots to internal static dir
|
2021-02-18 02:35:51 -05:00 |
|
Nick Sweeting
|
dcc812b9f5
|
make output link easier to see on archiveresult admin list
|
2021-02-18 02:35:33 -05:00 |
|
Nick Sweeting
|
df47486d31
|
make admin link easier to find on snapshot detail page
|
2021-02-18 02:35:11 -05:00 |
|
Nick Sweeting
|
8369ca0b87
|
fix snapshot detail page titles garbled due to double escaping
|
2021-02-18 02:34:56 -05:00 |
|
Nick Sweeting
|
ba2afa0672
|
allow cancelling init partway through and show hints to resume
|
2021-02-18 02:34:42 -05:00 |
|
Nick Sweeting
|
75e1bfd0a9
|
create_or_update ArchiveResults from history instead of get_or_create
|
2021-02-18 02:34:20 -05:00 |
|
Nick Sweeting
|
69e0302c2a
|
only add https to url if needed when prompting to save new snapshot
|
2021-02-18 02:34:03 -05:00 |
|
Nick Sweeting
|
9918bddb7e
|
remove emptystring tags before saving
|
2021-02-18 02:33:42 -05:00 |
|
Nick Sweeting
|
f1823381d0
|
improve latest title logic to take longest title
|
2021-02-18 02:33:28 -05:00 |
|
Nick Sweeting
|
ad4bd49163
|
increase max title length to 512
|
2021-02-18 02:33:08 -05:00 |
|
Nick Sweeting
|
4e5671dda9
|
add ability to add and remove tags directly from snapshot list
|
2021-02-18 02:32:58 -05:00 |
|
Nick Sweeting
|
c877d67e0c
|
check if pragma is already wal before setting
|
2021-02-18 02:31:42 -05:00 |
|
Nick Sweeting
|
7b7aa239fd
|
autocreate db cache table when needed and reenable WAL mode
|
2021-02-17 18:26:04 -05:00 |
|
Nick Sweeting
|
d60d73754d
|
fix favicon.ico and robots.txt served by runserver
|
2021-02-17 18:25:47 -05:00 |
|
Nick Sweeting
|
a8a6752b06
|
add CACHE_BACKEND options to settings for easier dev
|
2021-02-17 18:25:23 -05:00 |
|
Nick Sweeting
|
3457773988
|
fix ArchiveResult extractor showing up on top of dropdown in admin inline form
|
2021-02-17 18:25:01 -05:00 |
|
Nick Sweeting
|
084cf7ff51
|
add more explanation about snapshot.save timestamp bump
|
2021-02-17 13:34:46 -05:00 |
|
Nick Sweeting
|
265bcc0264
|
fix lint errors2
|
2021-02-16 16:29:41 -05:00 |
|
Nick Sweeting
|
6f0eec92eb
|
fix lint errors
|
2021-02-16 16:26:48 -05:00 |
|
Nick Sweeting
|
d89034dcde
|
disable debug_toolbar by default
|
2021-02-16 16:23:09 -05:00 |
|
Nick Sweeting
|
71cf8d5224
|
add migrations
|
2021-02-16 15:57:13 -05:00 |
|
Nick Sweeting
|
118bddb41a
|
fix admin title and url truncation and add edit/admin link and ID to Snapshot detail page
|
2021-02-16 15:55:07 -05:00 |
|
Nick Sweeting
|
05e891632c
|
add snapshot_id to Link and uuid to ArchiveResult
|
2021-02-16 15:54:27 -05:00 |
|
Nick Sweeting
|
0b8bdd8cc5
|
show dir size after each snapshot archiving process in cli
|
2021-02-16 15:53:52 -05:00 |
|
Nick Sweeting
|
acb932ba12
|
improve readability and mercury error handling and fix output path to be relative
|
2021-02-16 15:53:11 -05:00 |
|
Nick Sweeting
|
c95698e608
|
bump Snapshot.updated time after each extractor, change extractor order
|
2021-02-16 15:52:18 -05:00 |
|
Nick Sweeting
|
28e50c5e49
|
tweak snapshot asset serving logic to show multiple choices in case of conflict
|
2021-02-16 15:51:56 -05:00 |
|
Nick Sweeting
|
a6c64f2560
|
only get archive_size if index.html is present within dir
|
2021-02-16 15:51:17 -05:00 |
|
Nick Sweeting
|
c24e4bf11d
|
tweak django debug toolbar panels and add djdt_flamegraph
|
2021-02-16 15:51:02 -05:00 |
|
Nick Sweeting
|
1e2188517b
|
speed up latest_title by preferring db title if present
|
2021-02-16 15:49:53 -05:00 |
|
Nick Sweeting
|
8b236b9367
|
cache dir size, snapshot icons, tags str, and title in django cache
|
2021-02-16 15:49:29 -05:00 |
|
Nick Sweeting
|
51440ede3a
|
show extra fields on ArchiveResult admin list and detail page
|
2021-02-16 15:47:49 -05:00 |
|
Nick Sweeting
|
74c882ef16
|
add nothreading arg to archivebox server for perf profiling
|
2021-02-16 15:46:58 -05:00 |
|
Nick Sweeting
|
8cde6bc676
|
add gist.github.com to git domains
|
2021-02-16 07:36:09 -05:00 |
|
Nick Sweeting
|
bdf1b102be
|
load ArchiveResults from orphaned links history during init
|
2021-02-16 06:20:05 -05:00 |
|
Nick Sweeting
|
d0f8a5e710
|
change mercury atomic_write output order
|
2021-02-16 06:19:16 -05:00 |
|
Nick Sweeting
|
e62ecffeb0
|
disable django caches explicitly
|
2021-02-16 06:18:39 -05:00 |
|
Nick Sweeting
|
988a10a9f6
|
fix warc path in snapshot_icons
|
2021-02-16 06:18:05 -05:00 |
|
Nick Sweeting
|
48eddadc9b
|
inline archive_size and archive_path snapshot methods
|
2021-02-16 06:16:02 -05:00 |
|
Nick Sweeting
|
46a7b972ee
|
disable WAL and cache table for now
|
2021-02-16 06:13:50 -05:00 |
|
Nick Sweeting
|
24ae01cdbe
|
add ArchiveResult admin
|
2021-02-16 06:13:27 -05:00 |
|
Nick Sweeting
|
87069dd41e
|
fix wsgi.py
|
2021-02-16 04:16:51 -05:00 |
|
Nick Sweeting
|
8c2d81c041
|
always serve static files
|
2021-02-16 04:16:24 -05:00 |
|
Nick Sweeting
|
fb8e6cabcb
|
fix error log location
|
2021-02-16 04:15:09 -05:00 |
|
Nick Sweeting
|
26fa63749d
|
add debug toolbar
|
2021-02-16 02:50:05 -05:00 |
|
Nick Sweeting
|
fad2620c62
|
minor tweaks
|
2021-02-16 02:49:31 -05:00 |
|
Nick Sweeting
|
ae43d35e65
|
fix color option in docker
|
2021-02-16 01:26:26 -05:00 |
|
Nick Sweeting
|
4eac9d0ec1
|
show extra system setup info in version output
|
2021-02-16 01:23:58 -05:00 |
|
Nick Sweeting
|
82de67db34
|
fix missing/outdated template variables
|
2021-02-16 01:23:31 -05:00 |
|
Nick Sweeting
|
22da885148
|
log every archivebox command run to the errors.log
|
2021-02-16 01:23:01 -05:00 |
|
Nick Sweeting
|
19f7c907e0
|
exec archivebox from docker entrypoint script to avoid nesting pid under bash
|
2021-02-16 01:22:36 -05:00 |
|
Nick Sweeting
|
10d687c55c
|
add new MEDIA_MAX_SIZE=750m size option for limiting youtubedl downloads
|
2021-02-16 01:21:19 -05:00 |
|
Nick Sweeting
|
49939f3eaa
|
only accept stdin if args are not passed, fix stdin hang in docker
|
2021-02-16 01:20:47 -05:00 |
|
Nick Sweeting
|
de1a939df4
|
fix public index pagination links and total count
|
2021-02-15 21:07:12 -05:00 |
|
Nick Sweeting
|
108cb100b3
|
hotlink direclty to specific archivebox release from footer info
|
2021-02-15 21:06:56 -05:00 |
|
Nick Sweeting
|
56ec19fb29
|
allow hotlinking directly to a specific extractor output using hash on Snapshot detail page
|
2021-02-15 20:55:22 -05:00 |
|
Nick Sweeting
|
a089136fea
|
fix missing stdout template var on /add when not rendering success page
|
2021-02-15 20:54:47 -05:00 |
|
Nick Sweeting
|
b6d7c74680
|
speed up the Snapshot handling view and show index page when extractor output is missing or multiple snapshots returned
|
2021-02-15 20:52:08 -05:00 |
|
Nick Sweeting
|
0375853683
|
log error tracebacks to logs/errors.log file and filter noisy 404s and 200s from log output
|
2021-02-15 20:51:23 -05:00 |
|
Nick Sweeting
|
0ec9bfb971
|
fix dead missing template variables
|
2021-02-15 20:50:12 -05:00 |
|
Nick Sweeting
|
b3a50a2c10
|
fix server quick-init param not being passed properly to subcommand
|
2021-02-15 20:49:40 -05:00 |
|
Nick Sweeting
|
b06e256ad9
|
fix add command not updating snapshot detail index pages when passed index-only and overwrite flags together
|
2021-02-15 20:49:23 -05:00 |
|
Nick Sweeting
|
8e98cef7ad
|
fix after and before args flipped when filtering
|
2021-02-15 20:48:51 -05:00 |
|
Nick Sweeting
|
33d180afe7
|
allow filtering snapshots by timestamp in list, update, and remove cmds
|
2021-02-15 20:48:35 -05:00 |
|
Nick Sweeting
|
0c9db1c554
|
remove symbols from random secret key for easier copy pastin
|
2021-02-15 20:45:42 -05:00 |
|
Nick Sweeting
|
4faef03ba3
|
compute snapshot properties directly without loading whole Link
|
2021-02-15 20:44:08 -05:00 |
|
Nick Sweeting
|
9ce3bd5bdc
|
use index.LINK_FILTERS to validate filter-type args instead of hardocding them twice
|
2021-02-15 20:43:36 -05:00 |
|
Nick Sweeting
|
c28ad8bd1b
|
fix AddLinkForm widget complaining about missing template var class
|
2021-02-15 20:42:59 -05:00 |
|
Nick Sweeting
|
78463c243a
|
remove unused GIT_SHA config option
|
2021-02-15 20:42:33 -05:00 |
|
Nick Sweeting
|
9cd4ba38f0
|
add new SNAPSHOTS_PER_PAGE pagination limit config
|
2021-02-15 20:42:00 -05:00 |
|
Nick Sweeting
|
00ae1f15a7
|
ignore shm db file and config files in archivebox data dir on init
|
2021-02-15 14:52:37 -05:00 |
|