2 Like

Newspaper

News, full-text, and article metadata extraction in Python 3 Created by Lucas Ou-Yang (codelucas)

Free Open Source
Web
Self-Hosted
Python

Newspaper is a news, full-text, and article metadata extraction built with Python 3.

FEATURES

- Works in 10+ languages (English, Chinese, German, Arabic, ...)
- Multi-threaded article download framework
- News url identification
- Text extraction from html
- Top image extraction from html
- All image extraction from html
- Keyword extraction from text
- Summary extraction from text
- Author extraction from text
- Google trending terms extraction More Info »

Link to official Newspaper site

Official Website

Features

No features added Add a feature

Tags

web-scraper web-scraping-tools website-scraper

Newspaper was added by kurtmadsen in Oct 2016 and the latest update was made in Oct 2016. The list of alternatives was updated Aug 2019. It's possible to update the information on Newspaper or report it as discontinued, duplicated or spam.

Newspaper Demo online—input screen (http://newspaper-demo.herokuapp.com)

An example of the extracted text from a BBC News article (http://www.bbc.com/news/business-37801845) in the Newspaper Demo online.

MORE APP INFO Official website

Reviews 0

Alternatives to Newspaper for all platforms with any license

Scrapy

Scrapy is an open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

Free Open Source Mac Windows Linux BSD
Data Mining Add a feature

78 Like
Portia

An open-source visual scraping tool that lets you scrape the web without coding, built by Scrapy creators.

Free Open Source Mac Windows Linux Web
Screen scraping Add a feature

49 Like
Scrapinghub

Scrapinghub is the most advanced platform for deploying and running web crawlers (also known as "spiders"). It allows your organization to build crawlers...

Commercial Web
Data Mining Web-Based Add a feature

10 Like
DataScraping.co

Power your intelligence business decision with real time data. Web scraping solution for SMBs and Enterprises in cloud, Leverage the structured data from on-demand and...

Commercial Windows Web Chrome
No features added Add a feature

4 Like
Scraper API

Scraper API handles proxies, browsers, and CAPTCHAs for you, so you can scrape any web page with a simple API call.

Commercial $ $ $ Web
No features added Add a feature

1 Like
Octoparse

Octoparse is a modern visual web data extraction software. Both experienced and inexperienced users would find it easy to use Octoparse to bulk extract information from...

Freemium Windows
No coding required Data analytics Point-and-click interface Add a feature

12 Like
ProxyCrawl

Scraping and crawling websites while being anonymous and bypass any restriction, blocks or captchas.

Freemium $ $ $ Web
Anonymous web scraping Free API Add a feature

3 Like
Mercury Webparser

Mercury Webparser allows you to download the full text of an article in json format via an http web api.

Free Web
Api REST API Add a feature

1 Like
ScrapeHero

A web scraping service to collect data from websites, without any programming or DIY tools. .

Commercial Web
Data Mining Add a feature

13 Like
WebHarvy

WebHarvy is a visual web scraper which can be used to easily extract data from websites. WebHarvy can easily extract Text, HTML, Images, URLs & Emails from...

Commercial Windows
Data Mining Integrated Web Browser Proxy support WYSIWYG Support Add a feature

0 Like
artoo.js

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities. This nice droid is loaded into the...

Free Open Source Web Self-Hosted Chrome JavaScript Node.JS
No features added Add a feature

0 Like
Lateral.io Article Extractor API

This is a REST API which provides the full text of an article based on a web url. Note: Uses 'Newspaper' under the hood. ...

Commercial Web
REST API Add a feature

0 Like
ScrapingNinja

Scraping is hard, scraping at scale can be very challenging. You have to handle: - Javascript rendering - Chrome headless - Captcha - Proxy Scraping Ninja is a...

Commercial $ $ $ Software as a Service (SaaS)
Api Add a feature

0 Like

Newspaper Comments

Echo echo ... Feels empty in here

Maybe you want to be the first to submit a comment about Newspaper? Just click the button up to your right!