crw
Lightweight web scraping, crawling, and search API with MCP server support.
- Type
- MCP
- Transport
- http
- Open source
- Yes
- GitHub Stars
- ★ 1.1k
- Source
- mcp-github
- Repository
- github.com/fastcrw/crw
Overview
fastCRW is a fast, lightweight alternative to Firecrawl/Tavily, written in Rust. It provides an MCP server enabling AI agents to perform web scraping, crawling, and searching. The tool is compatible with the Firecrawl API (/scrape, /crawl, /search) and is 2.3x faster than Tavily and 1.5x faster than Firecrawl on a 1K-URL benchmark. With only 6MB of memory usage, it can be self-hosted or used via managed cloud services.
Capabilities
- ▪Web scraping
- ▪Website crawling
- ▪Web search
- ▪Structured data extraction
- ▪Markdown and JSON output
Use cases
Setup
curl -fsSL https://fastcrw.com/install | sh
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
How do I install fastCRW?
Run `curl -fsSL https://fastcrw.com/install | sh`.
Do I need an API key?
Yes, an API key is required when using the managed cloud service.
Related skills
Scrapling
An adaptive web scraping framework capable of handling everything from single requests to large-scale scraping.
TrendRadar
An AI-driven tool for sentiment monitoring and trend analysis, supporting multi-platform aggregation, RSS subscription, and intelligent notifications.
gpt-researcher
An autonomous agent for deep research using any LLM provider.
geo-optimizer-skill
AI search engine optimization tool that helps websites get cited in generative engines like ChatGPT.
SurfSense
SurfSense is an open-source AI agent network research platform providing real-time data connectivity via REST API or MCP server.
google-maps-scraper
Scrape business data from Google Maps, such as name, address, phone number, etc.