Scrapling
An adaptive web scraping framework capable of handling everything from single requests to large-scale scraping.
- Type
- MCP
- Transport
- http
- Open source
- Yes
- GitHub Stars
- ★ 65.7k
- Source
- mcp-github
- Repository
- github.com/D4Vinci/Scrapling
Overview
Scrapling is an adaptive web scraping framework that can manage tasks ranging from single requests to large-scale scraping. Its parser learns from website changes and automatically re-locates elements when pages are updated. Its scraper can bypass anti-bot systems such as Cloudflare Turnstile. Its spider framework allows you to scale to concurrent, multi-session scraping and supports pause/resume functionality and automatic proxy rotation. Achievable with just a few lines of Python code. Ideal for AI developers and engineers requiring large-scale data scraping and analysis.
Capabilities
- ▪Adaptive Parser
- ▪Bypass Anti-Bot Systems
- ▪Concurrent Multi-Session Scraping
- ▪Automatic Proxy Rotation
- ▪Real-time Statistics and Streaming
Use cases
Setup
pip install scrapling
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
Does Scrapling support dynamic content scraping?
Yes, Scrapling supports dynamic content scraping.
Can Scrapling bypass anti-crawling systems?
Yes, Scrapling can bypass anti-crawling systems such as Cloudflare Turnstile.
Related skills
TrendRadar
An AI-driven tool for sentiment monitoring and trend analysis, supporting multi-platform aggregation, RSS subscription, and intelligent notifications.
gpt-researcher
An autonomous agent for deep research using any LLM provider.
Deep-Research-skills
Provides structured deep research capabilities for Claude Code, OpenCode, and Codex, supporting a two-phase research process.
user-research-skill
Provides end-to-end user research capabilities for AI agents, including interviews, synthetic users, and quantitative surveys.
seo-geo-claude-skills
20 SEO and GEO skills for AI agents like Claude Code, Cursor, and over 35 others.
google-maps-scraper
Scrape business data from Google Maps, such as name, address, phone number, etc.