Commit Graph

35 Commits

Author SHA1 Message Date
Shadowfacts 75404b197d
Fix error when removing attributes from tree that contains comments 2021-09-22 21:08:52 -04:00
Shadowfacts 71fa17caaf
Remove HTTPoison dependency 2018-11-22 13:00:53 -05:00
Ben Olive 5dd52d5698 Ensure `remove_tag` returns a valid html_tree
If the entire input is stripped out, this used to return `nil` which
caused downstream parsing to fail. Instead, return `[]` which is the
Floki representation of an empty tree.

Fixes #36
2018-10-11 10:35:16 +09:00
Ben Olive b35746bfed Strip out atom tags
Standard tags are returned by Mochiweb as binaries. The atom tags are
for special case parsing (such as php includes). Since that's not oging
to be part of the article, simply exclude those while normalizing.

Fixes #30

See also:

Mochiweb parser: 9608d786ef/src/mochiweb_html.erl (L345)
2018-10-11 10:34:29 +09:00
keepcosmos 2ed20b6fe1 update deps and deprecated 2018-07-24 18:50:08 +09:00
Jaehyun Shin 133044f50c
Merge pull request #37 from fribmendes/frm/img-tags
Convert relative img paths into absolute
2018-07-24 18:00:43 +09:00
Simon Bowen bbe8f6ad1a Made tests pass, Floki updated to allow encoding of special characters of entities, update readability to disable this. 2018-07-18 16:00:47 +01:00
Fernando Mendes ebc8c90e71 Convert relative img paths into absolute
Fixes #27
2018-06-30 11:14:17 +01:00
Jaehyun Shin 4f2449558d
Merge pull request #35 from chingan90/feature/formatter
Add Elixir 1.6 formatter config file and formatted the codebase
2018-02-12 10:28:31 +09:00
Chi Ngan Lee b2f8a3b4da Add Elixir 1.6 formatter config file and formatted the codebase 2018-02-09 11:42:08 +08:00
Chi Ngan Lee 87958400a1 When we regex-check the MIME header we should also support zero space between the type and the charset, say "text/html;charset=utf-8". 2018-02-09 11:22:17 +08:00
Adlan Razalan 9e43c454e7 Manually compare tag type for candidate
The match? method is no longer available starting Floki 0.15.0.
2017-11-03 23:40:18 +08:00
Adlan Razalan 49d21b71dc Do a case-insensitive content-type check 2017-10-29 15:09:00 +08:00
keepcosmos e2c5a4beed support elixir 1.5.1 2017-08-23 14:38:08 +09:00
Jaehyun Shin 89d3958fd7 Merge pull request #25 from OldhamMade/master
Handle text-based responses
2017-08-23 14:08:33 +09:00
Phillip Oldham 2b53a90f3d added ability to handle text-based responses
added fix for content-type with charset

updated function names to match elixir naming conventions (is_ vs ?)

minor version bump

added default content-type of text/plain when header is missing
2017-08-21 21:54:30 +01:00
Josip Janzic 59b539ef43
Make sure title is set if h_tag_title is empty 2017-06-11 22:13:22 +02:00
keepcosmos 1aa682a31a fix some bug and update deps 2017-02-05 18:48:26 +09:00
Jeff Browning 760e1f03bc Fix merging of title tag matches and raising on no matches
Fixes #19, fixes #20
2016-11-22 11:14:23 -05:00
Jeff Browning 91dcb1e285 Scope the title tag selector to the head element 2016-11-14 17:54:12 -05:00
DalHo Park e799dc4a18 reasonable default for httpoison_options 2016-11-07 13:20:39 +09:00
Jeff Browning d3be3bdd82 Only split title suffix for tag titles 2016-11-04 14:51:24 -04:00
Jeff Browning 2f8e84eb8a Clean up and fix warnings 2016-11-04 14:49:42 -04:00
Jeff Browning 747e0495ed Fix detection of title suffix 2016-11-04 14:49:25 -04:00
Jeff Browning a6acaa9c81 Allow HTTPoison options to be specified in config 2016-10-18 09:54:00 -04:00
Eason Goodale 6840a9d0d7 Fixes crash when html has an xml version tag by stripping it out 2016-08-13 22:11:01 -07:00
keepcosmos 93bdf48b8c add summarize function
this closes #4, closes #3
2016-05-07 18:28:39 +09:00
keepcosmos 2274b3d063 add authors extractor doc 2016-04-28 15:19:11 +09:00
keepcosmos 4aa8f6ecea add authors finder 2016-04-28 15:15:24 +09:00
keepcosmos 23db20bbf0 add document 2016-04-24 18:40:35 +09:00
keepcosmos 46ac9dddde add doc 2016-04-24 16:14:31 +09:00
keepcosmos d8677a599c add test 2016-04-24 14:32:43 +09:00
keepcosmos b131d7effa add candidate builder
add test
2016-04-23 12:31:03 +09:00
keepcosmos 4e4a712718 add filter algorithms 2016-04-17 15:28:33 +09:00
keepcosmos d91604a519 initial commit 2016-04-15 20:51:29 +09:00