Scrapy
107 likes
Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...
Features
- Command line interface
- Fast motion
- Data Mining
- Screen Scraping
Scrapy News & Activities
Highlights All activities
Recent News
No news, maybe you know any news worth sharing?
Share a News TipRecent activities
jsonsupport123 added Scrapy as alternative to JSON Support
Datacyberyozh added Scrapy as alternative to Yozh Scraper- PredatorQ liked Scrapy
selenowitz added Scrapy as alternative to SocialCrawl
AbrahamEsther added Scrapy as alternative to Cockroach Crawler
Danilo_Venom added Scrapy as alternative to Thunderbit, WebscrapeAI and FoxScrape
Scrapy information
Developed by
UnknownLicensing
Open Source (BSD-3-Clause) and Free product.Written in
Alternatives
124 alternatives listedSupported Languages
- English
AlternativeTo Category
OS & UtilitiesGitHub repository
- 64,081 Stars
- 11,928 Forks
- 449 Open Issues
- Updated
Featured in Lists
A list with 807 apps by AmileyaRyver without a description.
List by AmileyaRyver with 807 apps, updated
A list with 33 apps by 6feriolimarco without a description.
List by Francisco Ferioli Marco with 33 apps, updated
What is Scrapy?
Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping development and services company.
Comments and Reviews
Excellent web crawler.