1
0
Fork 0
mirror of synced 2024-08-04 12:51:22 +12:00
Commit graph

159 commits

Author SHA1 Message Date
Nick Sweeting
529a0f8bb2
fix broken function name 2019-03-30 15:00:21 -04:00
Nick Sweeting
066b36b6a9
make URL_BLACKLIST empty by default 2019-03-30 14:56:19 -04:00
mlazana
8502fa5cc3 config.py: update function exclude_blacklisted(links) 2019-03-27 20:10:05 +02:00
mlazana
a3705e31c6 Merge remote-tracking branch 'upstream/master' 2019-03-27 20:03:07 +02:00
Nick Sweeting
6bec1709f6
Update config.py 2019-03-27 04:48:38 -04:00
Starbeamrainbowlabs
ab72a2dad1
Try to add --compression back again 2019-03-26 23:38:50 +00:00
Starbeamrainbowlabs
51859731d3
config.py: add WGET_AUTO_COMPRESSION 2019-03-26 23:34:45 +00:00
Starbeamrainbowlabs
ed7ad04fd9
wget: Remove unsupported compression option
--compression=auto is not supported on Raspberry Pis. This PR removes it from ArchiveBox.
2019-03-26 15:46:57 +00:00
Nick Sweeting
58c9b47d43 fix rss parsing when items have newlines between them 2019-03-25 16:27:55 -04:00
mlazana
81d846427e fix comments in links.py 2019-03-24 19:04:22 +02:00
mlazana
4d10568477 exclude links that are in blacklist 2019-03-24 14:40:26 +02:00
mlazana
417ee9e302 add env variable URL_BLACKLIST 2019-03-23 21:27:41 +02:00
Nick Sweeting
fb8d4e9369 fix title None error 2019-03-22 23:10:11 -04:00
Nick Sweeting
c28c0d0e71 enable gzip auto decompression 2019-03-22 23:01:01 -04:00
Nick Sweeting
f7a0568a6c better chrome options loading 2019-03-22 23:00:53 -04:00
Nick Sweeting
ef865dd76a better stats collection and printing 2019-03-22 23:00:43 -04:00
Nick Sweeting
4c499d77b6 move dependency checking into config file 2019-03-22 22:05:45 -04:00
Nick Sweeting
096832210c better logging totals counts 2019-03-22 21:38:24 -04:00
Nick Sweeting
d06775923b move latest to derived data using history 2019-03-22 21:38:08 -04:00
Nick Sweeting
69f837bbf6 simplify chrome_user_data_dir default 2019-03-22 21:37:02 -04:00
Nick Sweeting
8f73fdbe09 fix chrome profile precedence order to be equal 2019-03-22 21:31:55 -04:00
Nick Sweeting
bd9f3e313f better logging during long output 2019-03-22 15:09:39 -04:00
Nick Sweeting
1c5732d5c6 improve logging of skipped links 2019-03-22 14:01:29 -04:00
Nick Sweeting
0075daa45c
Merge pull request #187 from simon987/master
Fix succeded typo
2019-03-22 12:35:15 -04:00
simon987
1c7dafb378 Fix for #188 2019-03-21 20:12:27 -04:00
simon987
fa425b563e Fix succeded typo 2019-03-21 19:59:09 -04:00
Nick Sweeting
d798117081 better separation of archive method checking and running logic 2019-03-21 05:35:41 -04:00
Nick Sweeting
e6bd1f8ca8 major codebase-wide code cleanups 2019-03-21 01:28:12 -04:00
Nick Sweeting
c806068683 fix missing import 2019-03-20 21:12:43 -04:00
Nick Sweeting
5ee1c39720 remove flawed link_type concept in favor of simpler staticfile detection 2019-03-20 21:11:29 -04:00
Nick Sweeting
c79e1df8b2 use hints system to pass stdout and errors up to the traceback 2019-03-20 21:10:09 -04:00
Nick Sweeting
c38de3bbe7 nicer iframes on detail pages 2019-03-20 04:30:44 -04:00
Nick Sweeting
e4c7683983 move js to head and optimize for loading speed 2019-03-20 04:30:28 -04:00
Nick Sweeting
c2ea90ed39 better favicon loading 2019-03-20 04:30:00 -04:00
Nick Sweeting
1772bbfb13 minor ui tweaks 2019-03-20 02:57:06 -04:00
Nick Sweeting
ac56023bfd fix wget_output_path relative location building 2019-03-20 02:37:27 -04:00
Nick Sweeting
9c166d5bcf add more files links to index details page 2019-03-20 02:37:13 -04:00
Nick Sweeting
7f84c4b3c8 dont show in progresss message or regen index on exit 2019-03-20 02:36:55 -04:00
Nick Sweeting
f9a7c530b9 fix pinboard RSS parser 2019-03-19 18:44:22 -04:00
Nick Sweeting
61ec4971e9 fix nested archive index page and improve wget output finding 2019-03-19 18:10:11 -04:00
Nick Sweeting
eb5cc8078a better UX before titles have been fetched during archiving progress 2019-03-19 18:10:11 -04:00
Nick Sweeting
914750c453 better title regex to match titles surrounded by newlines 2019-03-19 18:10:11 -04:00
Nick Sweeting
1b5201fd58 re-save index on Ctrl+c to hide in progress message on html output 2019-03-19 18:10:11 -04:00
noncetonic
28758cf16c
Adds CHROME_USER_AGENT 2019-03-19 10:15:52 -07:00
noncetonic
e230e27929
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:13:27 -07:00
noncetonic
a13f22d15a
Adds support for HEADLESS_USER_AGENT for Chrome 2019-03-19 05:32:48 -07:00
Nick Sweeting
1c1bc76ac1 add chrome headless option and improve default data dir finding 2019-03-12 17:50:10 -04:00
Nick Sweeting
5e583573d5 pretty warning when missing distutils 2019-03-12 15:50:41 -04:00
Nick Sweeting
8319ccf064
add docs link to config.py 2019-03-12 12:48:46 -04:00
Nick Sweeting
10bb970d66
Update archive_methods.py 2019-03-12 12:45:33 -04:00