Commit Graph

125 Commits

Author SHA1 Message Date
Shadowfacts f84d849432
Add conditional stage
Allows applying another pipeline stage based on a condition, which can
either be a whole filter or a single filter rule.
2019-11-01 22:50:25 -04:00
Shadowfacts 13c44d5e10
Refactor filtering logic into separate module 2019-11-01 22:49:52 -04:00
Shadowfacts c9cc9f2428
Fix crash while scraping images 2019-11-01 18:29:41 -04:00
Shadowfacts 9264c9a97d
Add extractor for om.co 2019-11-01 18:27:15 -04:00
Shadowfacts 5d38d9567e
Fix error while validating scrape stage options 2019-11-01 18:27:08 -04:00
Shadowfacts 1a934430cc
Change feed refresh interval to 30 minutes 2019-10-31 22:21:32 -04:00
Shadowfacts d8139c6ce0
Make item creation multi-threaded 2019-10-31 22:21:17 -04:00
Shadowfacts 3bc37952d1
Add option to convert images in article content to data URIs 2019-10-31 21:59:55 -04:00
Shadowfacts 98a182986c
Fix module name of whatever.scalzi.com extractor 2019-10-31 19:15:35 -04:00
Shadowfacts 9638a8cdbf
Use latest version of Floki 2019-10-31 19:14:51 -04:00
Shadowfacts 8c96a94cd3
Add extractor for finertech.com 2019-10-31 19:04:15 -04:00
Shadowfacts 118de4ae53
Add extractor for macstories.net 2019-10-31 18:48:36 -04:00
Shadowfacts 957f271425
Add extractor for 512pixels.net 2019-10-31 18:38:01 -04:00
Shadowfacts c0f04791b6
Add extractor for beckyhansmeyer.com 2019-10-31 17:46:32 -04:00
Shadowfacts d7641b1c28
Also show untitled indicator on item pages 2019-10-31 17:43:15 -04:00
Shadowfacts cfd9f7505a
Rewrite image URLs without hosts to use the host of the article URL 2019-10-31 17:38:16 -04:00
Shadowfacts eec0b918e7
Change extractors to accept/return html trees 2019-10-31 17:12:02 -04:00
Shadowfacts d476839fce
Add extractor for ericasadun.com 2019-10-31 17:03:34 -04:00
Shadowfacts 6f568a03e1
Add whatever.scalzi.com extractor 2019-10-31 16:52:01 -04:00
Shadowfacts 3192969889
Replace site-specific pipeline stages with new extractor architecture 2019-10-31 16:45:52 -04:00
Shadowfacts dbef262779
Fix error on opening feed edit page 2019-10-31 15:34:52 -04:00
Shadowfacts c113ee08ee
Add blockquote style 2019-10-31 15:30:47 -04:00
Shadowfacts 048e2b755e
Indicate untitled items in feed view 2019-10-31 14:31:52 -04:00
Shadowfacts 9e6b185cfd
Fix crash caused filter tombstone-ing an item 2019-10-31 14:26:02 -04:00
Shadowfacts 6a30b57ca4
Remove more old code related to filters 2019-10-31 14:22:53 -04:00
Shadowfacts 07a62fec25
Remove old code from before filters and scraping were combined into pipelines 2019-10-31 14:18:41 -04:00
Shadowfacts a856c80d4a
Change article links to open in new tabs 2019-10-31 13:49:35 -04:00
Shadowfacts b91062cc22
Add migration to remove old feed data 2019-10-31 13:47:34 -04:00
Shadowfacts 27dd2c4a8e
Add default HTTP response handler 2019-09-26 11:59:44 -04:00
Shadowfacts bd896641df
Fix crash on certificate errors 2019-09-26 11:55:42 -04:00
Shadowfacts 4f002037fb
Better logging for feed fetch error 2019-09-18 15:58:43 -04:00
Shadowfacts 56121de540
Fix crash onn storing items with too precise dates 2019-09-18 15:55:22 -04:00
Shadowfacts 5c4b989446
Use feed_parser instead of fiet 2019-09-01 16:46:56 -04:00
Shadowfacts 0ced9df13a
don't allow empty group titles 2019-08-31 15:13:29 -04:00
Shadowfacts 9c1bbbbf23
Don't allow empty feed URLs 2019-08-31 15:09:40 -04:00
Shadowfacts b559bd9dc3
Add OPML export 2019-08-30 19:44:51 -04:00
Shadowfacts 1015fd5162
Add types, Dialyzer, fix Dialyzer warnings 2019-08-30 19:31:38 -04:00
Shadowfacts c42c93e0db
Add OPML importing 2019-08-30 14:27:52 -04:00
Shadowfacts e55a694194
Add Daring Fireball scraper 2019-07-21 19:04:43 -04:00
Shadowfacts 17310911ce
Add pipeline stage option validation/error reporting 2019-07-21 12:21:28 -04:00
Shadowfacts d0c6831d45
Add error messages for creating/editing pipeline stages 2019-07-20 20:06:23 -04:00
Shadowfacts 7f3ff17925
Start pipeline UI 2019-07-20 19:08:56 -04:00
Shadowfacts 0a1909dbc4
Start pipeline system 2019-07-08 22:45:02 -04:00
Shadowfacts 24c942c5d2
Add option to disable remote scraping for feeds 2019-07-05 22:00:18 -04:00
Shadowfacts d3d5e28b4e
Misc bug fixes 2019-07-01 17:46:54 -04:00
Shadowfacts 6ec519a11f
Handle feed URL redirects
Closes #1
2019-06-30 22:01:12 -04:00
Shadowfacts e004b65263
Additional HTTP error handling in get_article_content 2019-06-30 21:31:24 -04:00
Shadowfacts b686938bfa
Fix crash on missing feed update date 2019-06-30 21:25:11 -04:00
Shadowfacts 68280cea8e
Clean up Fervor authentication plug 2019-05-20 20:05:54 -04:00
Shadowfacts 3e4e2d1831
Remove old Phoenix assets 2019-04-01 12:25:19 -04:00