Commit Graph

26 Commits

Author SHA1 Message Date
Shadowfacts 53cbe0a7e9 Update things, fix warnings 2023-06-25 14:03:16 -07:00
Shadowfacts ff3d9affe5 Fix error when parsing updating feeds without item guids 2022-09-19 10:02:11 -04:00
Shadowfacts 5ece9cd21c
Yet more Sentry 2021-09-22 19:54:45 -04:00
Shadowfacts 1c2ef3bc51
More Sentry logging 2021-09-22 15:06:45 -04:00
Shadowfacts 3b12f62379
Fix items w/o guids getting duplicated on every update 2021-09-12 19:55:19 -04:00
Shadowfacts a02ec174be
Use unique index to prevent duplicate items from being created 2021-09-08 09:35:46 -04:00
Shadowfacts 162ba74dde
Extract authors from feeds 2021-09-03 17:09:16 -04:00
Shadowfacts 0593fcdb9a
Switch to hackney via Tesla 2021-03-31 19:33:19 -04:00
Shadowfacts e10a614f3e
Switch back to HTTPoison 2021-03-31 14:43:59 -04:00
Shadowfacts 1beff21fc5
Switch to Mojito for HTTP requests 2020-09-11 19:15:19 -04:00
Shadowfacts 04ffe0036d
Fix feed update failing on missing favicon 2020-08-14 21:56:38 -04:00
Shadowfacts 26bfb2e58f
Store item content MIME type 2020-07-18 23:13:24 -04:00
Shadowfacts 198ca0345b
Don't fetch favicon for Gemini protocol feeds 2020-07-18 22:13:51 -04:00
Shadowfacts 4f16933198
Add gemini protocol feed fetching 2020-07-18 19:27:53 -04:00
Shadowfacts 5087ef0395
Fix feed favicon_url not setting 2020-06-01 22:45:47 -04:00
Shadowfacts 09d2e4ae72
Fix wrong return type 2020-05-29 20:06:42 -04:00
Shadowfacts b0d9189399
Prevent unnecessary refetching of favicons 2020-05-29 19:47:14 -04:00
Shadowfacts 4a09ce1cb0
Fix scraping images w/ URLs w/o schemes 2020-02-17 12:09:03 -05:00
Shadowfacts bc8b3a8a38
Change default item date to now if item date couldn't be parsed 2020-01-29 22:01:23 -05:00
Shadowfacts 2086a31537
Update HTTPoison, improve handling for URIs with no scheme 2020-01-26 21:46:49 -05:00
Shadowfacts 740e0e7fca
Allow items without dates 2020-01-12 21:51:58 -05:00
Shadowfacts 2c06b785c9
Fix incorrect handling of relative favicon links 2019-11-10 15:27:40 -05:00
Shadowfacts 8d790b8af0
Fix HTTP not handling relative reidrects correctly 2019-11-10 15:15:54 -05:00
Shadowfacts 2a5bfb22db
Prevent crash when trying to load a favicon from a non-existent URL 2019-11-10 15:05:48 -05:00
Shadowfacts a09901e44e
When fetching favicons, if a feed doens't have a site URL, fallback on
the root page of the domain.
2019-11-10 15:03:38 -05:00
Shadowfacts e684737fcd
Implement basic favicon scraping 2019-11-10 14:23:07 -05:00