AlternativeTo Logo
Scrapy icon

Scrapy

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a g...

  • Mac
  • Windows
  • Linux
  • BSD
Avg rating of 5 (1)| 1 comments

What is Scrapy?

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping development and services company.

show full description

Scrapy Screenshots

 Suggest and vote on features

Scrapy Features

  1.  Command line interfaceScrapy either have CLI support or is a CLI-only app.

Scrapy information

  • LicensingOpen Source and Free product.
  • Alternatives83 alternatives listed

Supported Languages

  • English

Our users have written 1 comments and reviews about Scrapy, and it has gotten 90 likes

Scrapy was added to AlternativeTo by Danilo_Venom on and this page was last updated .

Comments and Reviews  Post a comment/review

 all • positive • negative      relevance • date
tomiolavitoivio
  
Top positive comment ago
Copy a direct link to this comment to your clipboard   
If this Review contains spam or other abuse, notify admins about it.   

Excellent web crawler.

Show entire comment
0

Said about Scrapy as an alternative

Guest

All the infrastructure bits that come with it if you need. Its pretty much impossible to do a significant crawl all by yourself (proxy management hell), so being able to get things working first and then lean on the backend infrastructure the scrapy guys have is a major relief.

Positive comment ago
as an alternative to  
silenzushka

Requires lots of development to make it work. Has certain limitations when it comes to markup detection on a moderns sites.

Positive comment ago
as an alternative to  
Guest

Like ParseHub, Scrapy allows users to construct and run web scrapes. Unlike ParseHub, Scrapy is command-prompt based and has no GUI.

Positive comment ago
as an alternative to  

Tags

  • Web Scraping
  • framework
  • web-scraping

List containing Scrapy

Core, Development & Services

Recent user activities on Scrapy

AlternativeTo