Scrape any website, article or RSS/Atom Feed with ease!
Structured Data extraction from common web resources, using information-retrieval techniques. See the docs
The package can be installed by adding scrape
to your list of dependencies in mix.exs
:
def deps do
[
{:scrape, "~> 3.0.0"}
]
end
httpoison
because of keepcosmos/readability
. You can override this in your app with override: true
and everything should work.Scrape.domain!(url)
-> get structured data of a domain-type url (like https://bbc.com)Scrape.feed!(url)
-> get structured data of a RSS/Atom feedScrape.article!(url)
-> get structured data of an article-type urlLGPLv3. You can use this package any way you want (including commercially), but I want bugfixes and improvements to flow back into this package for everyone's benefit.