~index · 23developer-tools-infraweb-scraping-agent · 117niche intel · updated daily

Web Scraping Agent

117 listingsall of Developer Tools Infra
overviewlistings (117)
Listing typeAll types 117Agents 47MCP servers 70
Price modelPaid 43↳ incl. free tier 30Usage-based 9Free only 4No public price 70All 117▲ most upvotedprice: cheapest ↑
crawlforgedev_crawlforge_mcp logo
@crawlforgedev_crawlforge_mcpMCP server
CrawlForge MCP is a production-ready MCP server that gives AI agents the power to scrape websites, extract str…
· free tier · from $3/mo
tubepull_tubepull logo
@tubepull_tubepullMCP server
Hosted MCP server that lets Claude, Perplexity, ChatGPT, and Cursor download videos as MP3 or MP4 from YouTube…
· free tier · from $4/mo
afdian_to_markdown logo
@afdian_to_markdowntool
Go-based web scraper and MCP server for downloading Afdian creator content (posts, albums, shop items) and con…
· free tier · from $4/mo
anybrowse logo
@anybrowseagent· MCP
Autonomous web browsing agent. Converts any URL to clean, LLM-ready Markdown. Powered by real Chrome browsers …
L2· free tier · from $5/mo
manypi logo
@manypiagent
ManyPI is a data extraction platform that allows users to turn websites into APIs, extract, transform, and aut…
L3· free tier · from $5/mo
icosaedro_toolsnap_mcp logo
@icosaedro_toolsnap_mcpMCP server
Context-efficient microtools for AI agents. 33 tools total. Flagship fetch_extract: 98.1% median token reducti…
· free tier · from $5/mo
spider_cloud logo
@spider_cloudagent
Fast web scraping and crawling API for AI agents and RAG pipelines. Converts web pages to clean, structured ma…
· usage · $1/GB
support_c2w9_reefapi logo
@support_c2w9_reefapiMCP server
One MCP for 160+ live web-data APIs — search, social, e-commerce, real estate, jobs, travel, news, finance. Th…
· free tier · from $8/mo
crawlora_crawlora logo
@crawlora_crawloraMCP server
Crawlora is a hosted MCP server exposing 319 structured web-data tools across search, maps, commerce, social, …
· free tier · from $9/mo
fastcrw logo
@fastcrwagent
Web scraping, search, crawl, and extraction API for AI agents. Search, scrape, crawl, extract, monitor, and ma…
· free tier · from $11/mo
social_fetch logo
@social_fetchagent
Social media scraping API for profiles, posts, comments, transcripts, and metrics across TikTok, Instagram, Yo…
· free tier · from $14/mo
HU
@hustleagent
AI-powered web scraping, deep research, summarization, and screenshot services. Pay-per-request with USDC on B…
L3· free tier · from $15/mo
skrapeai_skrape_mcp logo
@skrapeai_skrape_mcpMCP server
Get any website content - Convert webpages into clean, LLM-ready Markdown.
· free tier · from $15/mo
ext_faheem_veed_crawl logo
@ext_faheem_veed_crawlMCP server
Veedcrawl lets agents search and understand public social videos across YouTube, TikTok, Instagram, X/Twitter,…
· free tier · from $15/mo
firecrawl logo
@firecrawltool
Agent - Gather Data Wherever It Lives on the Web | Firecrawl
L0· free tier · from $16/mo
firecrawl_agent logo
@firecrawl_agentagent
Firecrawl web-agent is an open-source agent stack for web research and extraction. It provides a lightweight f…
L0· free tier · from $16/mo
foura_mcp logo
@foura_mcpMCP server
Web scraping for AI agents. One smart tool fetches any public page and picks the method automatically (direct …
· free tier · from $17/mo
browse_ai logo
@browse_aiagent
AI-powered web scraping and monitoring platform that extracts data from any website without coding. Converts w…
· free tier · from $19/mo
webclaw logo
@webclawagent
Web scraping API for AI agents that converts any URL into clean markdown, JSON, or structured data. Handles bo…
· free tier · from $19/mo
bluefield_data_api logo
@bluefield_data_apiagent
Production web data API that provides clean, structured data from web scraping, search, and crawling. Offers s…
· free tier · from $19/mo
dannydarko_hauntapi logo
@dannydarko_hauntapiMCP server
Structured web extraction for AI agents. Pass any URL and a prompt, get clean JSON data back. Native MCP serve…
· free tier · from $19/mo
deventerprisesoftware_scrapi_m logo
@deventerprisesoftware_scrapi_mMCP server
Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captc…
· from $19/mo
BK
@beatanalytics_kleinanzeigenMCP server
Search and retrieve listings from Kleinanzeigen, Germany's largest classifieds platform (formerly eBay Kleinan…
· free tier · from $19/mo
scrapegraphai logo
@scrapegraphaitool
ScrapeGraphAI is "the web scraping API built for the AI era" that extracts structured data from any website wi…
L0· free tier · from $20/mo
mindstudio_platform logo
@mindstudio_platformagent
MindStudio's 'Extract from URL' capability scrapes webpages and uses AI to extract specific information based …
L0· free tier · from $20/mo
context_dev logo
@context_devagent
Web scraping and crawling API designed for AI agents. Extracts clean markdown, HTML, structured data, brand in…
· free tier · from $25/mo
mercury_web_fetch logo
@mercury_web_fetchagent
The keyless, signed-provenance web-fetch for autonomous agents. Give it a URL and it returns clean page text +…
L3· free tier · from $29/mo
scrapfly_mcp logo
@scrapfly_mcpMCP server
Hosted MCP server providing web scraping, screenshots, data extraction, and crawling tools for AI agents. Conn…
· free tier · from $30/mo
integuru logo
@integuruagent
Generates production-ready APIs for websites and web systems using direct HTTP requests. Enables AI agents and…
· free tier · from $30/mo
oxylabs logo
@oxylabsagent
Web data collection platform with 175M+ residential proxies, headless browser automation, and APIs for web scr…
· usage · $30 billed monthly
ai_people_search logo
@ai_people_searchagent
AI-powered reverse image search tool that finds people by uploading photos. Scans billions of public images ac…
· from $30/mo
twitch_scraper_ai logo
@twitch_scraper_aiagent
TaskAGI's Twitch Scraper AI Agent extracts Twitch streams, channels, and viewer data to automate gaming conten…
L3· from $30/mo
dumpling_ai_mcp_server_dumplin logo
@dumpling_ai_mcp_server_dumplinMCP server
Integrate powerful data scraping, content processing, and AI capabilities into your applications. Leverage a w…
· from $40/mo
konbiniapi_konbiniapi_mcp logo
@konbiniapi_konbiniapi_mcpMCP server
KonbiniAPI gives your AI agent access to Instagram and TikTok public data. Connect once and ask for profiles, …
· free tier · from $49/mo
agentql_mcp logo
@agentql_mcpMCP server
Model Context Protocol server that integrates AgentQL's web data extraction capabilities with AI agents, enabl…
· free tier · from $99/mo
bright_data logo
@bright_dataagent
Web data platform providing APIs, proxies, and datasets for AI agents. Offers web scraping, browser automation…
· free tier · from $499/mo
crawlbase logo
@crawlbaseagent
Web data infrastructure with crawling API, smart AI proxy, enterprise crawler, and Web MCP Server for AI agent…
· usage · $0.77 blended per 1,000 re
hasdata_scraping logo
@hasdata_scrapingMCP server
Direct access to 40+ scraping and search tools. Extract structured data from Google (Search, Maps, Trends), Am…
· usage · $0.08 CPM
ZZ
@zlurp_zlurpMCP server
Web scraping for AI agents. Convert any URL to clean markdown via x402 micropayments on Base.
· usage · $0.005 per URL
RW
@refetch_webMCP server
Fetch pages, search the web, and extract structured data — built for AI agents. ## Tools - **fetch** — Any URL…
· usage · $2.50 per 1,000 credits
getanyapi_com_anyapi logo
@getanyapi_com_anyapiMCP server
Hundreds of scraping and data APIs through one gateway — one key, USD pay-per-request, normalized schemas, aut…
· usage · $0.0008
scrapezy_mcp logo
@scrapezy_mcpMCP server
Extract structured data from websites using AI models. Simplify data extraction by providing a URL and a clear…
· usage · $29.00
artespraticas_scrape_agent_mcp logo
@artespraticas_scrape_agent_mcpMCP server
Pay-per-use web scraping API built on x402. Extract clean text, links or HTML from any URL for $0.01 USDC on B…
· usage · $0.01 per request