Commit Graph

191 Commits

Author SHA1 Message Date
Shadowfacts 1beff21fc5
Switch to Mojito for HTTP requests 2020-09-11 19:15:19 -04:00
Shadowfacts 04ffe0036d
Fix feed update failing on missing favicon 2020-08-14 21:56:38 -04:00
Shadowfacts bd42073e24
Fix whatever.scalzi.com extractor 2020-08-14 21:55:38 -04:00
Shadowfacts 5f3be52132
Add OPML tests 2020-07-19 11:40:14 -04:00
Shadowfacts 978ee86667
Use has_many through association for user feeds 2020-07-19 10:36:32 -04:00
Shadowfacts 93aebeb600
Tweak rule configuration UI 2020-07-19 10:08:53 -04:00
Shadowfacts ab105d71ae
Add Gemini document -> HTML converter stage 2020-07-18 23:13:42 -04:00
Shadowfacts 26bfb2e58f
Store item content MIME type 2020-07-18 23:13:24 -04:00
Shadowfacts 198ca0345b
Don't fetch favicon for Gemini protocol feeds 2020-07-18 22:13:51 -04:00
Shadowfacts 12bb742be9
Add Gemini protocol scrape stage 2020-07-18 19:50:41 -04:00
Shadowfacts 4f16933198
Add gemini protocol feed fetching 2020-07-18 19:27:53 -04:00
Shadowfacts 537fcc62f8
Tweak button styles 2020-07-18 12:23:50 -04:00
Shadowfacts f5dc0b8deb
Add conditional stage live configuration 2020-07-18 12:22:16 -04:00
Shadowfacts daa0c51db5
Fix filter score/weight being converted to string 2020-07-18 11:03:14 -04:00
Shadowfacts 6c9247873f
Add edit pipeline as JSON option 2020-07-18 10:50:41 -04:00
Shadowfacts a10f1bea30
Add live filter configuration 2020-07-18 10:25:43 -04:00
Shadowfacts 0884bf3f32
Add continue parameter when logging in 2020-07-18 10:16:25 -04:00
Shadowfacts 6d30442edd
Open feed links in new tab 2020-07-18 10:13:54 -04:00
Shadowfacts 046c4d47a9
Use keypaths for stage option editing 2020-06-10 19:05:37 -04:00
Shadowfacts 5f81d8dfe4
Add pipeline stage reordering 2020-06-08 23:27:40 -04:00
Shadowfacts fc2b8f6036
Add basic LiveView pipeline editor, scrape stage config editing 2020-06-08 22:49:45 -04:00
Shadowfacts a66990782e
Reintroduce Webpack and add Phoenix LiveView 2020-06-07 14:42:38 -04:00
Shadowfacts 4d8bc7ad38
Fix warnings 2020-06-07 11:23:26 -04:00
Shadowfacts 58b3361623
Update to Phoenix 1.5 2020-06-07 11:13:52 -04:00
Shadowfacts f5fb8cbdb4
Add feed link to show page 2020-06-06 15:23:03 -04:00
Shadowfacts 3cd6495d3a
Rescue from error updating feeds 2020-06-06 13:45:22 -04:00
Shadowfacts 55c6d6fd88
Remove newsletter info from om.co extractor 2020-06-01 23:05:18 -04:00
Shadowfacts bb0607b959
Actually fix pagination with tombstoned items 2020-06-01 23:00:49 -04:00
Shadowfacts 28a35b8241
Fix pagination breaking on tombstoned items 2020-06-01 22:58:27 -04:00
Shadowfacts 4e79a1fe19
Fix pagination not working correctly with multiple feeds 2020-06-01 22:46:15 -04:00
Shadowfacts 5087ef0395
Fix feed favicon_url not setting 2020-06-01 22:45:47 -04:00
Shadowfacts 5da980aef4
Add group read view 2020-06-01 22:38:27 -04:00
Shadowfacts 2a3c085fef
Add item pagination 2020-06-01 22:24:18 -04:00
Shadowfacts 3eeef799ad
Fix feed item dates not displaying 2020-06-01 19:37:06 -04:00
Shadowfacts b66a5d2934
Add editing group title 2020-06-01 18:51:45 -04:00
Shadowfacts 35f8c983ad
Tweak group controls 2020-06-01 18:45:02 -04:00
Shadowfacts 09832d5da3
Allow editing feed URL 2020-06-01 18:36:15 -04:00
Shadowfacts 4cccab8df0
Remove old code 2020-06-01 18:30:59 -04:00
Shadowfacts 50af019c6f
Update hackney, fixes issue with OTP 23 2020-06-01 18:27:23 -04:00
Shadowfacts 929614dab2
Only show pipelines for the current user 2020-05-31 22:49:17 -04:00
Shadowfacts e429d256d6
Add configurable refresh frequency to feeds 2020-05-31 22:48:04 -04:00
Shadowfacts 939470767b
Use HTTP helper when refreshing feeds 2020-05-31 16:23:51 -04:00
Shadowfacts b63081392c
Make feed refresh request asynchronous 2020-05-31 16:13:00 -04:00
Shadowfacts c37bed932f
Fix pipeline validation not working 2020-05-31 15:56:27 -04:00
Shadowfacts 09d2e4ae72
Fix wrong return type 2020-05-29 20:06:42 -04:00
Shadowfacts 5ee8515bb2
Add missing error case 2020-05-29 20:04:41 -04:00
Shadowfacts b0d9189399
Prevent unnecessary refetching of favicons 2020-05-29 19:47:14 -04:00
Shadowfacts 4a09ce1cb0
Fix scraping images w/ URLs w/o schemes 2020-02-17 12:09:03 -05:00
Shadowfacts ecaf4c78b7
Fix updating pipelines 2020-01-29 22:20:49 -05:00
Shadowfacts c37ab63bce
Fix showing pipeline editing errors 2020-01-29 22:17:04 -05:00
Shadowfacts bc8b3a8a38
Change default item date to now if item date couldn't be parsed 2020-01-29 22:01:23 -05:00
Shadowfacts 2086a31537
Update HTTPoison, improve handling for URIs with no scheme 2020-01-26 21:46:49 -05:00
Shadowfacts 740e0e7fca
Allow items without dates 2020-01-12 21:51:58 -05:00
Shadowfacts fbe98c2e66
Fix typo 2019-12-21 22:57:15 -05:00
Shadowfacts 66f7206b47
Add fallback handler for unknown response codes 2019-12-21 22:56:10 -05:00
Shadowfacts 2c06b785c9
Fix incorrect handling of relative favicon links 2019-11-10 15:27:40 -05:00
Shadowfacts 8d790b8af0
Fix HTTP not handling relative reidrects correctly 2019-11-10 15:15:54 -05:00
Shadowfacts 2a5bfb22db
Prevent crash when trying to load a favicon from a non-existent URL 2019-11-10 15:05:48 -05:00
Shadowfacts a09901e44e
When fetching favicons, if a feed doens't have a site URL, fallback on
the root page of the domain.
2019-11-10 15:03:38 -05:00
Shadowfacts 899cd5afff
Send favicons in Fever API 2019-11-10 14:55:35 -05:00
Shadowfacts fb6a441acd
Fix several Fever API bugs 2019-11-10 14:55:24 -05:00
Shadowfacts 24643fa91a
Add Fever POST / route to support Fiery Feeds app 2019-11-10 14:54:58 -05:00
Shadowfacts 7c13ea8ee4
Show favicons in the web UI 2019-11-10 14:37:06 -05:00
Shadowfacts e684737fcd
Implement basic favicon scraping 2019-11-10 14:23:07 -05:00
Shadowfacts 2d88b0b4e1
Prune unread items after two weeks 2019-11-10 14:03:13 -05:00
Shadowfacts 1603d907c8
Show the feed an item is from on the item show page 2019-11-10 11:53:45 -05:00
Shadowfacts acbc07f2ee
Add title to new group page 2019-11-10 11:52:54 -05:00
Shadowfacts 9a1ecf3b0b
Reorganize account settings page 2019-11-10 11:48:41 -05:00
Shadowfacts 4888a45243
Make item titles not required by changesets
Fixes a bug where items without titles could not be marked as read
2019-11-10 11:48:27 -05:00
Shadowfacts a5fb5216ce
Replace top nav bar with side nav 2019-11-09 13:21:45 -05:00
Shadowfacts 0d0c749b68
Make pipelines not tied directly to feeeds
Allows using the same pipeline for multiple different feeds
2019-11-08 22:27:46 -05:00
Shadowfacts f84d849432
Add conditional stage
Allows applying another pipeline stage based on a condition, which can
either be a whole filter or a single filter rule.
2019-11-01 22:50:25 -04:00
Shadowfacts 13c44d5e10
Refactor filtering logic into separate module 2019-11-01 22:49:52 -04:00
Shadowfacts c9cc9f2428
Fix crash while scraping images 2019-11-01 18:29:41 -04:00
Shadowfacts 9264c9a97d
Add extractor for om.co 2019-11-01 18:27:15 -04:00
Shadowfacts 5d38d9567e
Fix error while validating scrape stage options 2019-11-01 18:27:08 -04:00
Shadowfacts 1a934430cc
Change feed refresh interval to 30 minutes 2019-10-31 22:21:32 -04:00
Shadowfacts d8139c6ce0
Make item creation multi-threaded 2019-10-31 22:21:17 -04:00
Shadowfacts 3bc37952d1
Add option to convert images in article content to data URIs 2019-10-31 21:59:55 -04:00
Shadowfacts 98a182986c
Fix module name of whatever.scalzi.com extractor 2019-10-31 19:15:35 -04:00
Shadowfacts 8c96a94cd3
Add extractor for finertech.com 2019-10-31 19:04:15 -04:00
Shadowfacts 118de4ae53
Add extractor for macstories.net 2019-10-31 18:48:36 -04:00
Shadowfacts 957f271425
Add extractor for 512pixels.net 2019-10-31 18:38:01 -04:00
Shadowfacts c0f04791b6
Add extractor for beckyhansmeyer.com 2019-10-31 17:46:32 -04:00
Shadowfacts d7641b1c28
Also show untitled indicator on item pages 2019-10-31 17:43:15 -04:00
Shadowfacts cfd9f7505a
Rewrite image URLs without hosts to use the host of the article URL 2019-10-31 17:38:16 -04:00
Shadowfacts eec0b918e7
Change extractors to accept/return html trees 2019-10-31 17:12:02 -04:00
Shadowfacts d476839fce
Add extractor for ericasadun.com 2019-10-31 17:03:34 -04:00
Shadowfacts 6f568a03e1
Add whatever.scalzi.com extractor 2019-10-31 16:52:01 -04:00
Shadowfacts 3192969889
Replace site-specific pipeline stages with new extractor architecture 2019-10-31 16:45:52 -04:00
Shadowfacts dbef262779
Fix error on opening feed edit page 2019-10-31 15:34:52 -04:00
Shadowfacts 048e2b755e
Indicate untitled items in feed view 2019-10-31 14:31:52 -04:00
Shadowfacts 9e6b185cfd
Fix crash caused filter tombstone-ing an item 2019-10-31 14:26:02 -04:00
Shadowfacts 6a30b57ca4
Remove more old code related to filters 2019-10-31 14:22:53 -04:00
Shadowfacts 07a62fec25
Remove old code from before filters and scraping were combined into pipelines 2019-10-31 14:18:41 -04:00
Shadowfacts a856c80d4a
Change article links to open in new tabs 2019-10-31 13:49:35 -04:00
Shadowfacts 27dd2c4a8e
Add default HTTP response handler 2019-09-26 11:59:44 -04:00
Shadowfacts bd896641df
Fix crash on certificate errors 2019-09-26 11:55:42 -04:00
Shadowfacts 4f002037fb
Better logging for feed fetch error 2019-09-18 15:58:43 -04:00
Shadowfacts 56121de540
Fix crash onn storing items with too precise dates 2019-09-18 15:55:22 -04:00