Commit Graph

34 Commits

Author SHA1 Message Date
Shadowfacts 1beff21fc5
Switch to Mojito for HTTP requests 2020-09-11 19:15:19 -04:00
Shadowfacts 12bb742be9
Add Gemini protocol scrape stage 2020-07-18 19:50:41 -04:00
Shadowfacts 4f16933198
Add gemini protocol feed fetching 2020-07-18 19:27:53 -04:00
Shadowfacts 3cd6495d3a
Rescue from error updating feeds 2020-06-06 13:45:22 -04:00
Shadowfacts e429d256d6
Add configurable refresh frequency to feeds 2020-05-31 22:48:04 -04:00
Shadowfacts 939470767b
Use HTTP helper when refreshing feeds 2020-05-31 16:23:51 -04:00
Shadowfacts b63081392c
Make feed refresh request asynchronous 2020-05-31 16:13:00 -04:00
Shadowfacts 5ee8515bb2
Add missing error case 2020-05-29 20:04:41 -04:00
Shadowfacts e684737fcd
Implement basic favicon scraping 2019-11-10 14:23:07 -05:00
Shadowfacts 2d88b0b4e1
Prune unread items after two weeks 2019-11-10 14:03:13 -05:00
Shadowfacts 1a934430cc
Change feed refresh interval to 30 minutes 2019-10-31 22:21:32 -04:00
Shadowfacts d8139c6ce0
Make item creation multi-threaded 2019-10-31 22:21:17 -04:00
Shadowfacts 9e6b185cfd
Fix crash caused filter tombstone-ing an item 2019-10-31 14:26:02 -04:00
Shadowfacts 07a62fec25
Remove old code from before filters and scraping were combined into pipelines 2019-10-31 14:18:41 -04:00
Shadowfacts 27dd2c4a8e
Add default HTTP response handler 2019-09-26 11:59:44 -04:00
Shadowfacts bd896641df
Fix crash on certificate errors 2019-09-26 11:55:42 -04:00
Shadowfacts 4f002037fb
Better logging for feed fetch error 2019-09-18 15:58:43 -04:00
Shadowfacts 56121de540
Fix crash onn storing items with too precise dates 2019-09-18 15:55:22 -04:00
Shadowfacts 5c4b989446
Use feed_parser instead of fiet 2019-09-01 16:46:56 -04:00
Shadowfacts 0a1909dbc4
Start pipeline system 2019-07-08 22:45:02 -04:00
Shadowfacts 24c942c5d2
Add option to disable remote scraping for feeds 2019-07-05 22:00:18 -04:00
Shadowfacts d3d5e28b4e
Misc bug fixes 2019-07-01 17:46:54 -04:00
Shadowfacts 6ec519a11f
Handle feed URL redirects
Closes #1
2019-06-30 22:01:12 -04:00
Shadowfacts e004b65263
Additional HTTP error handling in get_article_content 2019-06-30 21:31:24 -04:00
Shadowfacts b686938bfa
Fix crash on missing feed update date 2019-06-30 21:25:11 -04:00
Shadowfacts 74a82967dd
Add authentication for web UI 2019-03-23 19:42:38 -04:00
Shadowfacts 7a39e649d1
Fix using invalid RSS entry property 2019-03-21 17:40:34 -04:00
Shadowfacts eefa65ed56
Add feed filters 2019-03-14 21:42:02 -04:00
Shadowfacts 27cf787d52
Add tombstone items 2019-03-14 19:48:46 -04:00
Shadowfacts 3c4210d9a6
More random filter crap 2019-03-10 22:23:28 -04:00
Shadowfacts c90f2d48e2
Add filter web UI 2019-03-10 21:39:31 -04:00
Shadowfacts 0ebaca4a83
Fallback to RSS item content when article fetching fails 2019-03-10 19:44:31 -04:00
Shadowfacts eaa463f2c0
Make parsing articles more resilient 2019-03-09 10:59:08 -05:00
Shadowfacts 026b0ea2ae
Initial commit 2019-02-11 17:22:35 -05:00