shadowfacts
/
frenzy
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
185 Commits 2 Branches 0 Tags 2.6 MiB
Commit Graph

118 Commits

Author SHA1 Message Date
Shadowfacts 6916647737
Don't try to convert data URIs to data URIs 2021-09-22 19:46:07 -04:00
Shadowfacts 1c2ef3bc51
More Sentry logging 2021-09-22 15:06:45 -04:00
Shadowfacts 64162fee92
Fix not handling non-200 HTTP codes when fetching feed 2021-09-22 14:41:29 -04:00
Shadowfacts fce1bf6c2f
Add Sentry 2021-09-22 13:59:44 -04:00
Shadowfacts 6e0271bf4b
Slate extractor: strip newsletter signup form 2021-09-19 22:32:10 -04:00
Shadowfacts 3b12f62379
Fix items w/o guids getting duplicated on every update 2021-09-12 19:55:19 -04:00
Shadowfacts 4d7843ee5f
Add force update feeds 2021-09-08 20:17:33 -04:00
Shadowfacts ddceb28803
Fix update feeds thinking all items already exist 
Repo.exists? needs a query, not the keyword list
 2021-09-08 20:10:19 -04:00
Shadowfacts a02ec174be
Use unique index to prevent duplicate items from being created 2021-09-08 09:35:46 -04:00
Shadowfacts cd36b40978
Fix double refreshing feeds 2021-09-08 09:35:37 -04:00
Shadowfacts 162ba74dde
Extract authors from feeds 2021-09-03 17:09:16 -04:00
Shadowfacts 5990d0e4c2
Add Slate extractor 2021-09-03 17:09:10 -04:00
Shadowfacts a85dca5b3d
Add filtering by item content 2021-08-28 12:17:16 -04:00
Shadowfacts 5c8baa2057
Generalize WP lazy-loading stripper 2021-03-31 20:19:01 -04:00
Shadowfacts 0593fcdb9a
Switch to hackney via Tesla 2021-03-31 19:33:19 -04:00
Shadowfacts 33d1cac5e1
Recover from errors in custom extractors 2021-03-31 15:30:17 -04:00
Shadowfacts 26b832b622
Fix whatever.scalzi.com extractor 2021-03-31 15:30:05 -04:00
Shadowfacts 0ded09a65d
Fix redirect handling not working with HTTPoison 2021-03-31 15:29:52 -04:00
Shadowfacts e10a614f3e
Switch back to HTTPoison 2021-03-31 14:43:59 -04:00
Shadowfacts 8e18a415eb
Fix error when attempting to convert image w/o Content-Type header to data URI 2020-10-24 13:37:06 -04:00
Shadowfacts 3bbf42df75
Fix error when sending never-updated feeds via Fever API 2020-10-24 13:32:00 -04:00
Shadowfacts a13b1d8181
Fix error rendering gemtext with preformatted blocks 2020-09-30 22:50:07 -04:00
Shadowfacts 1beff21fc5
Switch to Mojito for HTTP requests 2020-09-11 19:15:19 -04:00
Shadowfacts 04ffe0036d
Fix feed update failing on missing favicon 2020-08-14 21:56:38 -04:00
Shadowfacts bd42073e24
Fix whatever.scalzi.com extractor 2020-08-14 21:55:38 -04:00
Shadowfacts 5f3be52132
Add OPML tests 2020-07-19 11:40:14 -04:00
Shadowfacts 978ee86667
Use has_many through association for user feeds 2020-07-19 10:36:32 -04:00
Shadowfacts ab105d71ae
Add Gemini document -> HTML converter stage 2020-07-18 23:13:42 -04:00
Shadowfacts 26bfb2e58f
Store item content MIME type 2020-07-18 23:13:24 -04:00
Shadowfacts 198ca0345b
Don't fetch favicon for Gemini protocol feeds 2020-07-18 22:13:51 -04:00
Shadowfacts 12bb742be9
Add Gemini protocol scrape stage 2020-07-18 19:50:41 -04:00
Shadowfacts 4f16933198
Add gemini protocol feed fetching 2020-07-18 19:27:53 -04:00
Shadowfacts daa0c51db5
Fix filter score/weight being converted to string 2020-07-18 11:03:14 -04:00
Shadowfacts 046c4d47a9
Use keypaths for stage option editing 2020-06-10 19:05:37 -04:00
Shadowfacts fc2b8f6036
Add basic LiveView pipeline editor, scrape stage config editing 2020-06-08 22:49:45 -04:00
Shadowfacts 58b3361623
Update to Phoenix 1.5 2020-06-07 11:13:52 -04:00
Shadowfacts 3cd6495d3a
Rescue from error updating feeds 2020-06-06 13:45:22 -04:00
Shadowfacts 55c6d6fd88
Remove newsletter info from om.co extractor 2020-06-01 23:05:18 -04:00
Shadowfacts 5087ef0395
Fix feed favicon_url not setting 2020-06-01 22:45:47 -04:00
Shadowfacts 2a3c085fef
Add item pagination 2020-06-01 22:24:18 -04:00
Shadowfacts 4cccab8df0
Remove old code 2020-06-01 18:30:59 -04:00
Shadowfacts 50af019c6f
Update hackney, fixes issue with OTP 23 2020-06-01 18:27:23 -04:00
Shadowfacts e429d256d6
Add configurable refresh frequency to feeds 2020-05-31 22:48:04 -04:00
Shadowfacts 939470767b
Use HTTP helper when refreshing feeds 2020-05-31 16:23:51 -04:00
Shadowfacts b63081392c
Make feed refresh request asynchronous 2020-05-31 16:13:00 -04:00
Shadowfacts c37bed932f
Fix pipeline validation not working 2020-05-31 15:56:27 -04:00
Shadowfacts 09d2e4ae72
Fix wrong return type 2020-05-29 20:06:42 -04:00
Shadowfacts 5ee8515bb2
Add missing error case 2020-05-29 20:04:41 -04:00
Shadowfacts b0d9189399
Prevent unnecessary refetching of favicons 2020-05-29 19:47:14 -04:00
Shadowfacts 4a09ce1cb0
Fix scraping images w/ URLs w/o schemes 2020-02-17 12:09:03 -05:00