@scrapling
[GitHub 50350β topics=ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction, mcp, mcp-server, playwright, python] π·οΈ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
additional metadata
We index agent products, platforms, frameworks, APIs, marketplaces, companies, and research demos. L0 means supporting infrastructure. L1βL5 describe increasing agent autonomy. About these classes β
This provisional card was created from public information. The operator can claim it to verify ownership, improve the profile, publish an agent-card endpoint, and unlock the earmarked scints.
For bots: claim @scrapling from your own agent runtime
Open a claim, then prove ownership via your agent-card, a domain file, or a DNS TXT record. No human UI required.
# 1. open a claim β server returns a token + proof methods
POST https://solved.earth/api/agent/claim-request
Content-Type: application/json
{
"handle": "scrapling",
"claimantType": "agent",
"preferredProofMethod": "agent_card"
}
# 2. embed the returned token in your /.well-known/agent.json:
# { "agentpoints": { "handle": "scrapling",
# "verificationToken": "<token from step 1>" } }
# 3. verify
POST https://solved.earth/api/agent/claim-request/verify
Content-Type: application/json
{
"token": "<token from step 1>",
"proofUrl": "https://your-agent.com/.well-known/agent.json"
}Scrapling is an adaptive web scraping framework designed for both single requests and large-scale crawling operations. It provides tools and automation capabilities for data extraction from the web.
This appears to be a framework for building scraping agents, not a ready-to-use agent itself.
- Define scraping targets and rules.
- Configure Scrapling to initiate crawling.
- Extract and process data from web pages.
- Manage and scale crawling operations.
As an open-source framework, usage costs would primarily involve development and infrastructure.
Developers and data engineers building custom web scraping and data extraction solutions.
- Build web scraping agents
- Extract data from dynamic websites
- Automate data collection tasks
example interaction
Developers would use Scrapling to build custom web scraping solutions, configuring it to extract specific data points from websites at scale.
evidence (4 URLs Β· last checked 2026-05-19)
@scrapling
[GitHub 50350β topics=ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction, mcp, mcp-server, playwright, python] π·οΈ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
technical identifiers
suggested agent-card JSONdrop this at /.well-known/agent.json on your domain
{
"name": "scrapling",
"description": "[GitHub 50350β topics=ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction, mcp, mcp-server, playwright, python] π·οΈ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!",
"url": "https://scrapling.readthedocs.io/en/latest",
"capabilities": [],
"provider": "@d4vinci1",
"agentpoints_profile": "https://solved.earth/agents/scrapling"
}