Scrapy

    • Free • Open Source
    • Mac
    • Windows
    • Linux
    • BSD
    ...

    What is Scrapy?

    Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping development and services company.
    Show full description ▾

    Features Vote on or suggest new features

    Comments and Reviews Post a comment / review
     all • positive • negative      relevance • date

    No comments or reviews, maybe you want to be first?

    Said about Scrapy as an alternative

    All the infrastructure bits that come with it if you need. Its pretty much impossible to do a significant crawl all by yourself (proxy management hell), so being able to get things working first and then lean on the backend infrastructure the scrapy guys have is a major relief.
    Positive comment • almost 6 years ago • as an alternative to   Kimono

    silenzushka Requires lots of development to make it work. Has certain limitations when it comes to markup detection on a moderns sites.
    Positive comment • about 5 years ago • as an alternative to   ParseHub

    Like ParseHub, Scrapy allows users to construct and run web scrapes. Unlike ParseHub, Scrapy is command-prompt based and has no GUI.
    Positive comment • about 5 years ago • as an alternative to   ParseHub

    Tags

    • framework
    • web-scraping
    Scrapy

    Links and Download

     Official Website

    Other

    Ubuntu Software Center
    Scrapy

    Summary

    Our users have written 0 comments and reviews about Scrapy, and it has gotten 87 likes

    • Open Source and Free product.
    • 75 alternatives listed

    Popular alternatives

    View all
    Scrapy was added to AlternativeTo by Danilo_Venom on Jun 23, 2015 and this page was last updated Jul 15, 2021.

    Recent user activities on Scrapy