Crawlee
apify.com- Category
- Developer Tools
- Pricing
- Open Source
- Type
- TOOL
- Builder
- @apify
- GitHub
- 25.6k stars
- Latest release
- v4.0.0-rc.0
- Date
About
Crawlee is an open-source Node.js library for web scraping and browser automation that unifies HTTP and headless-browser crawling (via Playwright/Puppeteer) under one API. It provides built-in request queuing, proxy rotation, automatic scaling, and anti-blocking fingerprinting to help developers build reliable scrapers quickly.
Why it made the leaderboard
Crawlee gives Node/TypeScript developers a single API to switch between fast HTTP crawling and headless-browser crawling without rewriting the scraper, with request queuing, autoscaling, proxy rotation, and browser-fingerprint anti-blocking already handled. It's the pragmatic pick when you need durable, production-grade data collection rather than a hosted extraction endpoint.
Tags
Tech Stack
Media
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.