Webcrawl Anything
github.com/brainfish-ai/webcrawl-anything- Category
- Developer Tools
- Rank
- No. 2013Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 2 stars
- Latest release
- v1.4.4
- Date
About
Webcrawl Anything gives AI agents and the command line tools to search, scrape, map, crawl and monitor websites, PDFs, YouTube videos, GitHub repos, ArXiv papers, product pages and CVEs. It runs locally without an API key, with an optional cloud browser service. It installs as agent skills for Claude Code, Cursor, Codex and others, and an MCP server lets agents call the tools directly.
Tags
web-scrapingcrawlermcpai-agentscliskill
Tech Stack
Node.jsTypeScript
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.