Nick Sweeting
099f7d00fe
Use feedparser for RSS parsing ( #1362 )
...
Fixes #1171
Fixes #870 (probably, would need to test against a Wallabag Atom file to
Fixes #135
Fixes #123
Fixes #106
2024-03-14 01:51:45 -07:00
Nick Sweeting
3512dc7e60
Disable searching for existing chrome user profiles by default
2024-03-14 00:58:45 -07:00
Nick Sweeting
62183b4c85
Make it a little easier to run specific tests ( #1371 )
2024-03-02 05:03:58 -08:00
jim winstead
741ff5f1a8
Make it a little easier to run specific tests
...
Changes ./bin/test.sh to pass command line options to pytest, and default to
only running tests in the tests/ directory instead of everywhere excluding
a few directories which is more error-prone.
Also keeps the mock_server used in testing quiet so access log entries don't
appear on stdout.
2024-03-01 12:43:53 -08:00
jim winstead
0f402df42f
Merge with latest dev
2024-03-01 12:05:43 -08:00
jim winstead
e7119adb0b
Add tests for generic_rss and pinboard_rss parsers
2024-03-01 11:27:59 -08:00
jim winstead
9f462a87a8
Use feedparser for RSS parsing in generic_rss and pinboard_rss parsers
...
The feedparser packages has 20 years of history and is very good at parsing
RSS and Atom, so use that instead of ad-hoc regex and XML parsing.
The medium_rss and shaarli_rss parsers weren't touched because they are
probably unnecessary. (The special parse for pinboard is just needing because
of how tags work.)
Doesn't include tests because I haven't figured out how to run them in the
docker development setup.
Fixes #1171
2024-03-01 11:25:45 -08:00
jim winstead
1f828d9441
Add tests for generic_rss and pinboard_rss parsers
2024-03-01 11:22:28 -08:00
Nick Sweeting
7b042c854a
Fix generic_json parser ( #1365 )
...
Fixes #1347 .
2024-02-29 17:19:10 -08:00
jim winstead
ccabda4c7d
Handle list of tags in JSON, and be more clever about comma vs. space
2024-02-28 17:38:49 -08:00
jim winstead
178e676e0f
Fix JSON parser by not always mangling the input
...
Rather than by assuming the JSON file we are parsing has junk at the beginning
(which maybe only used to happen?), try parsing it as-is first, and then fall
back to trying again after skipping the first line
Fixes #1347
2024-02-27 14:48:19 -08:00
jim winstead
22f9a289d3
Use feedparser for RSS parsing in generic_rss and pinboard_rss parsers
...
The feedparser packages has 20 years of history and is very good at parsing
RSS and Atom, so use that instead of ad-hoc regex and XML parsing.
The medium_rss and shaarli_rss parsers weren't touched because they are
probably unnecessary. (The special parse for pinboard is just needing because
of how tags work.)
Doesn't include tests because I haven't figured out how to run them in the
docker development setup.
Fixes #1171
2024-02-25 12:34:51 -08:00
Nick Sweeting
31d05d8526
Merge branch 'main' into dev
2024-02-22 04:50:46 -08:00
Nick Sweeting
8b9bc3dec8
minor fixes
2024-02-22 04:50:22 -08:00
Nick Sweeting
6a4e568d1b
new archivebox update speed improvements
2024-02-22 04:50:22 -08:00
Nick Sweeting
2d32f05a62
lower default sonic log level
2024-02-22 04:50:22 -08:00
Nick Sweeting
3afd7b0cf0
add healthcheck to Dockerfile
2024-02-22 04:50:22 -08:00
Nick Sweeting
0899c298c0
ignore data dirs
2024-02-22 04:50:22 -08:00
Nick Sweeting
743e1ca7ad
Update README.md
2024-02-22 03:07:16 -08:00
Nick Sweeting
52faf81096
Update README.md
2024-02-22 02:42:25 -08:00
Nick Sweeting
9026726a00
Update README.md
2024-02-22 01:23:51 -08:00
Nick Sweeting
113895277d
Update README.md
2024-02-21 17:14:09 -08:00
Nick Sweeting
b3be86f2cf
Update .readthedocs.yaml
2024-02-20 17:58:27 -08:00
Nick Sweeting
8a25502650
Merge branch 'main' into dev
2024-02-20 17:41:10 -08:00
Nick Sweeting
87a86dd111
Update README.md
2024-02-19 00:23:44 -08:00
Nick Sweeting
9b1df2b381
Update README.md
2024-02-19 00:21:45 -08:00
Nick Sweeting
6de23cd8fe
Update README.md
2024-02-19 00:19:48 -08:00
Nick Sweeting
335e3aadb0
revert main changes
2024-02-18 20:01:06 -08:00
Nick Sweeting
20575e7cc8
Merge branch 'main' into dev
2024-02-18 19:15:40 -08:00
Nick Sweeting
841c01ec2c
bump required python version to 3.10 to match brew and apt
2024-02-18 19:14:08 -08:00
Nick Sweeting
f554ae903e
fix requirements.txt so docks build doesnt crash on missing ldap c headers
2024-02-18 19:13:40 -08:00
Nick Sweeting
fa24136ff7
Update setup.sh
2024-02-18 05:46:53 -08:00
Nick Sweeting
b706ab390d
Merge branch 'main' into dev
2024-02-18 05:40:49 -08:00
Nick Sweeting
84fe8e1c75
Update setup.sh
2024-02-18 05:40:30 -08:00
Nick Sweeting
8519c81711
Update setup.sh
2024-02-18 05:32:38 -08:00
Nick Sweeting
9373a2853e
Update setup.sh
2024-02-18 05:32:20 -08:00
Nick Sweeting
0b8ff4c84c
Update setup.sh
2024-02-18 05:28:48 -08:00
Nick Sweeting
0cdfab7f45
Update setup.sh
2024-02-18 05:27:17 -08:00
Nick Sweeting
e9f3b041ec
Update setup.sh
2024-02-18 05:21:27 -08:00
Nick Sweeting
968cd8f19c
Update README.md
2024-02-18 05:03:08 -08:00
Nick Sweeting
ae7cbf4c54
Update README.md
2024-02-18 04:55:33 -08:00
Nick Sweeting
f9ad8e911b
Update README.md
2024-02-18 04:54:27 -08:00
Nick Sweeting
bf0983ce77
Update README.md
2024-02-18 04:48:37 -08:00
Nick Sweeting
dd6bb4b274
Update README.md
2024-02-18 04:46:25 -08:00
Nick Sweeting
a79bfde0db
Update README.md
2024-02-18 04:17:25 -08:00
Nick Sweeting
74e3645c6a
Update README.md
2024-02-18 04:14:57 -08:00
Nick Sweeting
2a845d1976
Update README.md
2024-02-18 04:13:55 -08:00
Nick Sweeting
903c72fa88
fix typing errors
2024-02-12 21:28:52 -08:00
Nick Sweeting
91c4641199
skip dir size calculation when path is too long
2024-02-12 21:26:34 -08:00
Nick Sweeting
c94ed53570
Merge branch 'main' into dev
2024-02-12 21:25:52 -08:00
