Scrapy icon
Scrapy icon

Scrapy

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Scrapy screenshot 1

Cost / License

Application type

Platforms

  • Mac
  • Windows
  • Linux
  • BSD
108likes
0articles
Save

Features

Features

Highlights All activities

Scrapy News & Activities

Recent News

No news, maybe you know any news worth sharing?

Share a News Tip

Recent activities

Scrapy information

AlternativeTo Category

OS & Utilities

GitHub repository

  •  64,691 Stars
  •  11,995 Forks
  •  264 Open Issues
  •   Updated  
View on GitHub

Our users have written 1 comments and reviews about Scrapy, and it has gotten 108 likes

Scrapy was added to AlternativeTo by Danilo Venom on and this page was last updated .

Comments and Reviews

   
Top Positive Comment
Tomi Toivio
1

Excellent web crawler.

Featured in Lists

Core, Development & Services

A list with 807 apps by AmileyaRyver without a description.
By AmileyaRyver807 appsUpdated

Data mining

A list with 33 apps by 6feriolimarco without a description.
By Francisco Ferioli Marco33 appsUpdated

Official Links

Install from the command line

  • brew install scrapy

Be careful what you paste into a terminal. Check what a command installs before running it.

What is Scrapy?

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping development and services company.