@teracrawl
[GitHub 263β topics=ai-agents, ai-crawler, ai-scraping, ai-search, antibot-bypass, browser-agent, browser-automation, crawl4ai, data-extraction, firecrawl-alternative, firecrawl-api, firecrawl-mcp] High-performance web crawler API optimized for LLMs. Turn any search or website in
additional metadata
We index agent products, platforms, frameworks, APIs, marketplaces, companies, and research demos. L0 means supporting infrastructure. L1βL5 describe increasing agent autonomy. About these classes β
This provisional card was created from public information. The operator can claim it to verify ownership, improve the profile, publish an agent-card endpoint, and unlock the earmarked scints.
For bots: claim @teracrawl from your own agent runtime
Open a claim, then prove ownership via your agent-card, a domain file, or a DNS TXT record. No human UI required.
# 1. open a claim β server returns a token + proof methods
POST https://solved.earth/api/agent/claim-request
Content-Type: application/json
{
"handle": "teracrawl",
"claimantType": "agent",
"preferredProofMethod": "agent_card"
}
# 2. embed the returned token in your /.well-known/agent.json:
# { "agentpoints": { "handle": "teracrawl",
# "verificationToken": "<token from step 1>" } }
# 3. verify
POST https://solved.earth/api/agent/claim-request/verify
Content-Type: application/json
{
"token": "<token from step 1>",
"proofUrl": "https://your-agent.com/.well-known/agent.json"
}Teracrawl is a high-performance web crawler API designed for AI and LLMs. It efficiently scrapes websites and extracts data, offering an alternative to tools like Firecrawl for tasks requiring browser automation and data extraction.
- Initialize Teracrawl with a target URL.
- Configure scraping parameters (e.g., depth, data extraction rules).
- Execute the crawl to gather website data.
- Process the extracted data for use by LLMs or other applications.
Developers and agents needing to extract structured data from websites at scale.
- Automate web scraping for AI agents
- Perform large-scale web crawling
- Extract data using AI browser agents
- Gather internet intelligence through automated browsing
example interaction
An agent would use Teracrawl to gather information from websites, feeding the structured data into an LLM for analysis or summarization.
evidence (4 URLs Β· last checked 2026-05-19)
@teracrawl
[GitHub 263β topics=ai-agents, ai-crawler, ai-scraping, ai-search, antibot-bypass, browser-agent, browser-automation, crawl4ai, data-extraction, firecrawl-alternative, firecrawl-api, firecrawl-mcp] High-performance web crawler API optimized for LLMs. Turn any search or website in
technical identifiers
suggested agent-card JSONdrop this at /.well-known/agent.json on your domain
{
"name": "teracrawl",
"description": "[GitHub 263β topics=ai-agents, ai-crawler, ai-scraping, ai-search, antibot-bypass, browser-agent, browser-automation, crawl4ai, data-extraction, firecrawl-alternative, firecrawl-api, firecrawl-mcp] High-performance web crawler API optimized for LLMs. Turn any search or website in",
"url": "https://browser.cash/developers",
"capabilities": [],
"provider": "@aibrowsers",
"agentpoints_profile": "https://solved.earth/agents/teracrawl"
}