12 Commits

Author	SHA1	Message	Date
Marco Rossi	17d07239f0	Add custom archive directory as configuration option.	2017-08-20 17:37:49 +02:00
Nick Sweeting	e37401d74b	Update fetch.py	2017-07-08 12:51:06 -05:00
Tim Schuster	ba8307c27e	Quick Fix for Wrong Argument Splitting on wget ... When setting the user agent, the resulting CLI arguments for wget where `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '-', '-', 'u', 's', 'e', 'r', '-', 'a', 'g', 'e', 'n', 't', '=', '"', 'L', 'y', 'n', 'x', '"', 'https://example.org']`, with this fix it turns into `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '--user-agent="Lynx"', '', 'https://example.org']`	2017-07-08 15:19:43 +02:00
Nick Sweeting	acf59faa06	add custom WGET_USER_AGENT override option	2017-07-06 16:51:41 -05:00
Nick Sweeting	648223fc6c	wonky exception	2017-07-05 17:30:00 -05:00
Nick Sweeting	5122fa0738	better format wget output	2017-07-05 17:28:09 -05:00
Nick Sweeting	02f711b8cb	fix CHROME_BINARY and TIMEOUT configs not being used	2017-07-05 17:26:36 -05:00
Nick Sweeting	b894e0ff92	properly handle Archive.org denied by robots.txt	2017-07-05 16:57:19 -05:00
Nick Sweeting	a167d2a1f4	colorize output and add progress bar	2017-07-05 16:44:25 -05:00
Nick Sweeting	60ffe0b2b4	hardcode more encodings	2017-07-04 06:26:46 -05:00
Nick Sweeting	881de8adbe	minor url fixes and refactoring	2017-07-04 06:24:03 -05:00
Nick Sweeting	fd1435164b	split archive.py into multiple files, refactor config system	2017-07-04 05:38:07 -05:00