shadowfacts
/
frenzy
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Slate extractor: strip newsletter signup form

This commit is contained in:
Shadowfacts 2021-09-19 22:32:10 -04:00
parent d62d12262d
commit 6e0271bf4b
Signed by: shadowfacts
GPG Key ID: 94A5AB95422746E5
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
lib/frenzy/pipeline/extractor/slate.ex
View File

@ -20,7 +20,8 @@ defmodule Frenzy.Pipeline.Extractor.Slate do
defp get_article_content(html_tree) do defp get_article_content(html_tree) do
case Floki.find(html_tree, ".article__content") do case Floki.find(html_tree, ".article__content") do
[el] -> [el] ->
article_content = Floki.filter_out(el, ".slate-ad, .in-article-recirc, .social-share") article_content =
Floki.filter_out(el, ".slate-ad, .in-article-recirc, .social-share, .newsletter-signup")
image = Floki.find(html_tree, ".article__top-image img") image = Floki.find(html_tree, ".article__top-image img")