Cristian
|
33182fd53c
|
fix: Add missing assignation
|
2020-11-04 15:07:45 -05:00 |
|
Cristian
|
d064a3eeff
|
fix: Handle case when update tries to re-add a link that is not in the sql index
|
2020-11-04 15:02:54 -05:00 |
|
Cristian
|
f292cface2
|
fix: Add condition for oneshot when archiving links
|
2020-11-04 14:40:44 -05:00 |
|
Cristian
|
4484491fb7
|
feat: Create ArchiveResult after finishing an extractor process
|
2020-11-04 11:22:55 -05:00 |
|
Cristian
|
b3e0400bc0
|
feat: initial functional version with icons calculated based on archive results
|
2020-11-04 10:31:20 -05:00 |
|
Cristian
|
309a87e8fe
|
feat: Add extractor field to the database
|
2020-11-04 07:28:02 -05:00 |
|
Cristian
|
8f3c03a0f9
|
feat: Initial (and naive) ArchiveResult model
|
2020-11-03 09:54:02 -05:00 |
|
Cristian
|
ac0ec160d1
|
lint: Fix warnings in master branch
|
2020-11-02 08:51:48 -05:00 |
|
Nick Sweeting
|
7d4738a674
|
fix intermittent BrokenPipe error on macOS when SHOW_PROGRESS=True
|
2020-10-31 19:38:54 -04:00 |
|
Nick Sweeting
|
9c6ff5036c
|
add suppress output helper
|
2020-10-31 19:33:17 -04:00 |
|
Nick Sweeting
|
22fb9c2ad7
|
tweak icons
|
2020-10-31 19:32:43 -04:00 |
|
Nick Sweeting
|
cafe35c595
|
show pending in light font
|
2020-10-31 16:33:31 -04:00 |
|
Nick Sweeting
|
5cae05ae76
|
tweak tags css and add tags to navbar
|
2020-10-31 07:57:11 -04:00 |
|
Nick Sweeting
|
c47398851b
|
nicer timeout hints
|
2020-10-31 07:57:11 -04:00 |
|
Nick Sweeting
|
651d6c4447
|
bold snapshots over 50MB
|
2020-10-31 07:57:11 -04:00 |
|
Nick Sweeting
|
b8bbb75f9c
|
logarithmic progress bars woohoo
|
2020-10-31 07:57:11 -04:00 |
|
Nick Sweeting
|
ac9e0e356d
|
config fixes
|
2020-10-31 07:57:11 -04:00 |
|
Nick Sweeting
|
79051ca15b
|
new package build
|
2020-10-31 03:08:41 -04:00 |
|
Nick Sweeting
|
18355dc2c6
|
clean up config loading in settings and config file layout
|
2020-10-31 03:08:03 -04:00 |
|
Cristian
|
e7e33ea7a5
|
tests: Add tests for several different ways to extract the title
|
2020-10-30 08:04:26 -05:00 |
|
Nick Sweeting
|
aede134ab3
|
temporarily disable icon highlighting in favor of performance
|
2020-10-30 05:12:33 -04:00 |
|
Nick Sweeting
|
f727ece7b3
|
add regex fallback back to title parser
|
2020-10-30 04:57:31 -04:00 |
|
Nick Sweeting
|
79bef1384e
|
Merge pull request #493 from ttimasdf/feat-ogtitle
Feature: add og:title metadata as alternative title
|
2020-10-30 04:51:14 -04:00 |
|
Nick Sweeting
|
cac3912439
|
small type fixes
|
2020-10-30 04:50:14 -04:00 |
|
Nick Sweeting
|
1e5fbf4bd2
|
Update archivebox/config/__init__.py
|
2020-10-29 13:46:03 -04:00 |
|
Cristian
|
81dd626b85
|
fix: CHROME_USER_DATA_DIR was causing an error after the update to posix paths
|
2020-10-29 11:09:18 -05:00 |
|
Cristian
|
a6bee5f111
|
feat: Move setup_django to an inner module
|
2020-10-26 08:02:04 -05:00 |
|
Cristian
|
e1d0b8bce7
|
feat: Initialize django at the beginning
|
2020-10-26 07:45:21 -05:00 |
|
Nick Sweeting
|
5faadee7d1
|
workaround for mercury version output
|
2020-10-24 22:59:09 -04:00 |
|
Nick Sweeting
|
e727af6f22
|
allow Path args to get_dir_size and copy_and_overwrite
|
2020-10-24 22:47:18 -04:00 |
|
Cristian
|
f330e6428b
|
lint: Remove unused imports from utils
|
2020-10-23 06:45:56 -05:00 |
|
Cristian
|
f397634dd2
|
feat: Rename old indexes at the end of init process
|
2020-10-23 06:45:56 -05:00 |
|
Cristian
|
7fc9b7d456
|
refactor: Update mentions of the html index in the logs
|
2020-10-23 06:45:56 -05:00 |
|
Cristian
|
572b46cecf
|
lint: Remove unused imports
|
2020-10-23 06:45:56 -05:00 |
|
Cristian
|
ae1484b8bf
|
feat: Remove index.json and index.html generation from the regular process
|
2020-10-23 06:45:56 -05:00 |
|
Nick Sweeting
|
494af5f2e1
|
Merge pull request #507 from ehainry/master
Add parser for Wallabag Atom feeds
|
2020-10-22 14:04:57 -04:00 |
|
Cristian
|
14f56a868a
|
refactor: Change typing for new stubs
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
c12fe0e3d7
|
feat: Use CURL_ARGS on title extractor
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
563d0f94ec
|
feat: Use CURL_ARGS in favicon extractor
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
2e1cdca789
|
feat: Use CURL_ARGS on header extractor
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
972d57bd08
|
feat: Add CURL_ARGS to control curl arguments
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
24e7a74855
|
feat: Add WGET_ARGS to control wget arguments
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
65530e1e5b
|
refactor: Use json.loads instead of split for list arguments
|
2020-10-22 08:46:16 -05:00 |
|
Cristian
|
bc02e0ffe3
|
feat: Add config for youtubedl (YOUTUBEDL_ARGS)
|
2020-10-22 08:46:16 -05:00 |
|
Cristian Vargas
|
a850b4a9d9
|
Merge branch 'master' into tags
|
2020-10-20 08:23:25 -05:00 |
|
Emmanuel Hainry
|
aebc83659d
|
Add parser for Wallabag Atom feeds
|
2020-10-18 11:20:07 +02:00 |
|
Cristian
|
62c78e1d10
|
refactor: Remove django-taggit and replace it with a local tags setup
|
2020-10-12 13:47:03 -05:00 |
|
Nick Sweeting
|
6c704fa8cf
|
Merge pull request #498 from adamwolf/bookmarklet
Add a bookmarklet
|
2020-10-09 21:59:07 -04:00 |
|
Cristian
|
10384a8a6f
|
style: Improve look of tags in admin list
|
2020-10-07 10:15:56 -05:00 |
|
Cristian
|
b9e5b781a7
|
fix: Avoid creating empty tag on migration
|
2020-10-07 09:59:49 -05:00 |
|
Cristian
|
62f3d648d4
|
fix: reverse_func functional
|
2020-10-07 09:46:10 -05:00 |
|
Adam Wolf
|
8d3295458c
|
Add a bookmarklet
The bookmarklet lets you quickly open the Add page
with the URL already populated in the URLs box.
|
2020-10-03 14:57:55 -05:00 |
|
Angel Rey
|
3e26ab3ce3
|
Replaced os.path in clic tests
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
01461a98a7
|
Replaced os.path in logging_util.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
25ac18c8b7
|
Replaced os.path in system.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
16b5ca3207
|
Replaced os.path in init config
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
897bace84d
|
Fixed paths in settings
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
0e7c337dcb
|
Replaced os.path in settings.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
ce71747538
|
replaced os.path in init extractors
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
fa364ed728
|
Replaced od.path in init cli
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
3fb410a604
|
Replaced os.path in favicon.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
ad04fb5300
|
Replaced os.path in init index
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
78f7062761
|
Replaced os.path in html.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
8b03c37fbb
|
Replaced os.path in json.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
9264ad88e0
|
Fixed string casting
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
7d513b9b19
|
Replaced os.path in schema.py
|
2020-10-02 15:46:39 -05:00 |
|
Angel Rey
|
2c62abb270
|
Replaced os.path in init parsers
|
2020-10-02 15:46:39 -05:00 |
|
ttimasdf
|
eda3836dee
|
feat: add og:title metadata as alternative title
|
2020-09-27 12:54:52 +08:00 |
|
Cristian
|
5975c27a6a
|
fix: Remove trailing slash from public index
|
2020-09-25 13:48:19 -05:00 |
|
Cristian
|
abde871a3c
|
fix: Wget absolute path generating issues
|
2020-09-25 08:24:06 -05:00 |
|
Angel Rey
|
4581ea956f
|
Fixed empty tags
|
2020-09-24 15:34:23 -05:00 |
|
Angel Rey
|
533ae7413c
|
Removed comments
|
2020-09-24 15:34:23 -05:00 |
|
Angel Rey
|
e06d3f9128
|
Fixed Link schema
|
2020-09-24 15:34:23 -05:00 |
|
Angel Rey
|
45775c607c
|
Fixed empty tags
|
2020-09-24 15:34:23 -05:00 |
|
Angel Rey
|
f26c0c6cd8
|
Fix serialization
|
2020-09-24 15:34:23 -05:00 |
|
Angel Rey
|
62c9028212
|
Improved tags
|
2020-09-24 15:34:23 -05:00 |
|
Cristian
|
7d3767b882
|
fix: oneshot command not running extractors
|
2020-09-24 12:56:16 -05:00 |
|
Cristian
|
62ed11a5ca
|
fix: Improve headers handling
|
2020-09-24 12:55:51 -05:00 |
|
Angel Rey
|
a40af98ced
|
removed static file check
|
2020-09-24 12:55:51 -05:00 |
|
Angel Rey
|
f0915a56aa
|
Replaced get method
|
2020-09-24 12:55:51 -05:00 |
|
Cristian
|
e0939d7fe4
|
fix: Syntax issue on config module
|
2020-09-24 08:48:58 -05:00 |
|
Nick Sweeting
|
a7cd01ad4f
|
Merge pull request #480 from apkallum/master
|
2020-09-23 17:30:11 -04:00 |
|
Nick Sweeting
|
38c1f96e2c
|
Update archivebox/config/__init__.py
|
2020-09-23 17:29:57 -04:00 |
|
Karim
|
2b987421fb
|
simpler check for CHROME_USER_DATA_DIR
|
2020-09-23 17:23:53 -04:00 |
|
apkallum
|
508984c941
|
fix: ensure chrome data dir is none when appropiate
|
2020-09-23 13:22:10 -04:00 |
|
Angel Rey
|
dc160daba8
|
Fixed lint
|
2020-09-23 11:07:00 -05:00 |
|
Angel Rey
|
7fd7dced9a
|
Added curl params
|
2020-09-23 11:07:00 -05:00 |
|
Angel Rey
|
a8a8fd14ac
|
Fixed indent headers.json
|
2020-09-23 11:07:00 -05:00 |
|
Angel Rey
|
852e3c9cff
|
Added headers extractor
|
2020-09-23 11:07:00 -05:00 |
|
Cristian
|
eb34a6af62
|
lint: Fix mercury extractor lint issues
|
2020-09-23 10:35:39 -05:00 |
|
Cristian
|
46b9e3d536
|
fix: Fix mercury extractor test
|
2020-09-23 10:34:05 -05:00 |
|
ttimasdf
|
2bf496e7e9
|
feat: Add mercury-parsed content to summary page
|
2020-09-22 18:44:12 -05:00 |
|
ttimasdf
|
357b677363
|
fix: add mercury-parser to extractors list
|
2020-09-22 18:44:12 -05:00 |
|
ttimasdf
|
706bd895e0
|
feat: Add mercury-parser
|
2020-09-22 18:44:12 -05:00 |
|
Cristian
|
b18bbf8874
|
test: Fix tests post-rebase
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
422664079a
|
fix test type casting for folder['path']
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
0144f19227
|
fix github action folder listing
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
1aa7bac85b
|
fix oneshot command type signature
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
95157427c2
|
update stubs file
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
008769d296
|
add support for Paths in json encoder
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
abf68e5437
|
no home() in Paths
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
b99784b919
|
pathlib with / syntax for config, index
|
2020-09-17 09:09:52 -05:00 |
|
apkallum
|
594d9e49ce
|
first attempt to migrate to Pathlib
|
2020-09-17 09:09:52 -05:00 |
|
Cristian
|
b2ed96c35a
|
feat: Redirect old add view to the main one
|
2020-09-17 09:08:20 -05:00 |
|
Cristian
|
b3ec170e39
|
fix: Remove unused imports
|
2020-09-16 08:50:56 -05:00 |
|
Cristian
|
bc116c25f8
|
refactor: Change View to FormView
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
a06bd715a9
|
remove reference to old home
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
1cdaad00a8
|
no more oldhome, cbvs uniform across views
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
94a590b31a
|
factor out a base.html template
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
5e8c115f3f
|
unify public archive view
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
3288f8579b
|
add public add view + toggle setting
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
6f7cc2b3ef
|
ensure results have icons
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
3048c0f6dc
|
add icons to new public view
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
c50af04cce
|
search view inherits from modified public view
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
948b2469f6
|
no files count in public view
|
2020-09-16 08:50:56 -05:00 |
|
apkallum
|
5c4ac3cf3d
|
new public view derived from django
|
2020-09-16 08:50:56 -05:00 |
|
Cristian
|
50f3f16203
|
lint: Remove unused import
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
0a83392cbf
|
fix: Replace any typing with Union[Iterable[Link], QuerySet] in archive_links
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
779a446085
|
feat: Make title and tags editable in admin
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
5348f4735a
|
fix: Change check to avoid issues with empty querysets
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
cf18130f85
|
feat: Add deprecation warning for index.json
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
018bd91745
|
refactor: Remove get_iter lambda from archive_links
|
2020-09-15 08:05:46 -05:00 |
|
Cristian Vargas
|
5e9b3099c6
|
Update fix_duplicate_links_in_index docstring
Co-authored-by: Nick Sweeting <git@sweeting.me>
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
01fb44fd40
|
refactor: Change archive_links check to focus on queryset, so it allows other iterables and not just lists
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
fa622d3e14
|
refactor: Replace --index with --with-headers in the list command to make it more explicit. Change it so it affects the csv output too.
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
2aa8d69b72
|
fix: Save history in main index (to mimic previous behaviour)
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
7e9d195d13
|
feat: Update list command to sort using sqlite
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
f55153eab3
|
feat: Update update command to work with querysets
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
fe9604a772
|
feat: Add tests for remove command
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
a8ed72501d
|
feat: Refactor remove command to use querysets
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
be520d137a
|
feat: Refactor add method to use querysets
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
6a2e6aad2f
|
fix: status command was failing on empty archives
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
be0dff8126
|
feat: Add tests to refactored init command
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
404f333e17
|
feat: Refactor get_invalid_folders to work with a queryset instead of a list of links
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
dae606de6e
|
feat: Update init to take advantage of querysets to reduce memory consumption
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
6b4b7127b4
|
feat: Remove unused imports
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
b8585dd92e
|
feat: load_main_index returns a queryset now
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
a77d6dc235
|
feat: list command fails when --index is used without --json or --html
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
885ff50449
|
feat: Add html export to list command
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
aab8f96520
|
feat: Add flag to list command to support index like output
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
be57db1369
|
feat: Save static indexes at the end of init
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
c16fdf1b47
|
feat: Update data folder check
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
874403e667
|
feat: Remove patch_main_index
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
31343c1367
|
feat: Update extractors and add command to use sql index as source of truth
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
e9caee6b10
|
feat: Update status command to consider sql as the main index
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
02f36b2096
|
feat: Replace index.json with index.sql as the main index in init
|
2020-09-15 08:05:46 -05:00 |
|
Cristian
|
bd3c824d45
|
fix: Escape JSON output on command failure so the user can run the command manually
|
2020-09-04 10:23:41 -05:00 |
|
Nick Sweeting
|
a645f36b87
|
add comment about fake cmd
|
2020-09-01 19:42:22 -04:00 |
|
Cristian
|
66037535fd
|
feat: Add curl command on readability as default command to debug
|
2020-09-01 10:16:24 -05:00 |
|
Cristian
|
bf3ea42141
|
fix: Add a default cmd value to handle case where the html cannot be retrieved
|
2020-08-27 09:51:33 -05:00 |
|