Scrapfly\_# Scrape any site, drive any browser, power any agent. One API key. ## Anti-bot vendors evolve weekly. Headless browsers crash at scale. We absorb both so your scraper stays up. [ Get Free API Key ](https://scrapfly.io/register) [ Pricing ](https://scrapfly.io/pricing) 1,000 free credits. No credit card. [ ](https://www.capterra.com/p/212653/Scrapfly/) 4.9/5 from 235 reviews POST api.scrapfly.io/scrape { "success": true, "result": { "status\_code": 200, "duration": 1.24, "antibot": "bypassed", "proxy": "residential/us", "browser": "chrome/148", "content": "<!doctype html>..." } } STATUS: one call, full stack FIG. 01 · ONE SCRAPE CALL, FULL STACK RESPONSE --- ## 15B+ requests / month ## 99.99% pass rate ## 8PB+ data / month ## 30K+ enterprises --- PRODUCTS## One API key. Web scraping, browser automation, AI agents. Pick the tool. We handle the rest: proxies, fingerprints, retries, billing. - Web Scraping API - Cloud Browser - Screenshot API - Extraction API - Crawler API - AI Browser Agent - MCP Server Web Scraping API The unblocker. Fetch any URL with anti-bot bypass, proxy rotation, and JS rendering toggle. Clean HTML or markdown, stable JSON. $> `POST https://api.scrapfly.io/scrape` [ Web Scraping API ](https://scrapfly.io/products/web-scraping-api) [ Documentation ](https://scrapfly.io/docs/scrape-api/getting-started) Cloud Browser Drive a real stealth Chromium over CDP. Full Playwright / Puppeteer compatibility. Hosted, scaled, undetected. $> `wss://browser.scrapfly.io/cdp?key=...` [ Cloud Browser API ](https://scrapfly.io/products/cloud-browser-api) [ Documentation ](https://scrapfly.io/docs/cloud-browser-api/getting-started) Screenshot API Full-page, viewport, or element screenshots. PNG / JPEG / WebP. Ad-block, cookie-banner dismiss, custom viewport. $> `POST https://api.scrapfly.io/screenshot` [ Screenshot API ](https://scrapfly.io/products/screenshot-api) [ Documentation ](https://scrapfly.io/docs/screenshot-api/getting-started) Extraction API Turn HTML into typed data with a prompt or a JSON schema. LLM-powered, built-in templates for products, articles, reviews, jobs. $> `POST https://api.scrapfly.io/extraction` [ Extraction API ](https://scrapfly.io/products/extraction-api) [ Documentation ](https://scrapfly.io/docs/extraction-api/getting-started) Crawler API Traverse entire sites with depth limits, follow rules, rate control. Streams URLs as discovered; every page runs through the Web Scraping API. $> `POST https://api.scrapfly.io/crawler` [ Crawler API ](https://scrapfly.io/products/crawler-api) [ Documentation ](https://scrapfly.io/docs/crawler-api/getting-started) AI Browser Agent Stealth Chromium tuned for autonomous agent loops. Browser Use, Stagehand, and Vibium compatible. Pay only for the actions that succeed. $> `POST https://api.scrapfly.io/agent` [ AI Browser Agent ](https://scrapfly.io/products/ai-browser-agent) [ Documentation ](https://scrapfly.io/products/ai-browser-agent) MCP Server Connect any MCP client (Claude, Cursor, Cline, Windsurf, ChatGPT) to scrape, screenshot, extract, and crawl with one API key. $> `mcp.scrapfly.io` [ MCP Server ](https://scrapfly.io/products/mcp-cloud) [ Documentation ](https://scrapfly.io/products/mcp-cloud) [Get Free API Key](https://scrapfly.io/register) --- // ANTI-BOT BYPASS## Pay on success. Failed bypasses are free. One parameter. Every anti-bot vendor. No per-target configuration. [ **Bypass Cloudflare** 98% ](https://scrapfly.io/bypass/cloudflare) [ **Bypass Akamai** 97% ](https://scrapfly.io/bypass/akamai) [ **Bypass DataDome** 96% ](https://scrapfly.io/bypass/datadome) [ **Bypass Imperva** 96% ](https://scrapfly.io/bypass/incapsula) [ **Bypass AWS WAF** 96% ](https://scrapfly.io/bypass/aws-waf) [ **Bypass PerimeterX** 95% ](https://scrapfly.io/bypass/perimeterx) [ **Bypass F5** 95% ](https://scrapfly.io/bypass/f5) [ **Bypass Kasada** 94% ](https://scrapfly.io/bypass/kasada) [ Bypass any anti-bot vendor ](https://scrapfly.io/bypass) --- // LIVE## Observability included. Success rate, throughput, latency. SCRAPE LOG · /scrape tail -f SUCCESS RATE · last 60s up 47d 12h **99.99**% TARGETS **12,483** RPS **4,210** p50 LATENCY **1.12s** BYPASS RATE **99.99%** FIG. 02 · LIVE PLATFORM TELEMETRY, SAMPLED IN REAL TIME --- ARCHITECTURE## Every layer, built in-house. Your API call. Our stack. From clean JSON all the way down to the exit IP. // LAYER 03 · API### What you call. One API key. Stable JSON envelope. Seven endpoints for scrapers, browsers, and AI agents. [Web Scraping](https://scrapfly.io/products/web-scraping-api) [Cloud Browser](https://scrapfly.io/products/cloud-browser-api) [Screenshot](https://scrapfly.io/products/screenshot-api) [Extraction](https://scrapfly.io/products/extraction-api) [Crawler](https://scrapfly.io/products/crawler-api) [AI Browser Agent](https://scrapfly.io/products/ai-browser-agent) [MCP Server](https://scrapfly.io/products/mcp-cloud) // LAYER 02 · STEALTH### How we stay invisible. Two proprietary engines, auto-routed per target. Byte-perfect Chrome on the wire and in the DOM. **JA4** matched **H2** exact **QUIC** aligned [ **Curlium** Stealth HTTP engine. Byte-perfect Chrome JA4, HTTP/2 SETTINGS, QUIC transport params. 10-50x faster than a browser. ](https://scrapfly.io/curlium) [ **Scrapium** Stealth Chromium. Same JA4 as Curlium, so you can alternate mid-session with no fingerprint change. CDP, wait-for rules, custom scripts. ](https://scrapfly.io/scrapium) // LAYER 01 · FOUNDATION### Where we exit. Global proxy mesh across 190+ countries. Geo-aligned DNS, Accept-Language, and client-hints coherence on every request. Residential Datacenter TCP / UDP 190+ countries --- // INTEGRATIONS## Works with what you already use. Plug Scrapfly into your favorite AI agents, workflow automations, and first-class SDKs. ### No-code automation [ Zapier ](https://scrapfly.io/integration/zapier) [ Make ](https://scrapfly.io/integration/make) [ n8n ](https://scrapfly.io/integration/n8n) ### LLM & RAG frameworks [ LlamaIndex ](https://scrapfly.io/integration/llamaindex) [ LangChain ](https://scrapfly.io/integration/langchain) [ CrewAI ](https://scrapfly.io/integration/crewai) ### First-class SDKs [ Python pip install scrapfly-sdk ](https://scrapfly.io/docs/sdk/python) [ TypeScript Node, Deno, Bun ](https://scrapfly.io/docs/sdk/typescript) [ Go go get scrapfly-sdk ](https://scrapfly.io/docs/sdk/golang) [ Rust cargo add scrapfly-sdk ](https://scrapfly.io/docs/sdk/rust) [ Scrapy Full-feature extension ](https://scrapfly.io/docs/sdk/scrapy) [ See all integrations ](https://scrapfly.io/integration) // WHY SCRAPFLY## Five reasons teams pick Scrapfly. What you get with us versus what you get with the rest of the category. // SCRAPFLY- Protected-site success rate98% on protected sites, measured weekly by the [Scrapeway](https://scrapeway.com) benchmark. - Failed requestsFailed requests are free. You only pay for successful scrapes. - PricingCredits scale with the actual complexity of each target. - Product breadthOne API key covers [scraping](https://scrapfly.io/products/web-scraping-api), [browser automation](https://scrapfly.io/products/cloud-browser-api), [screenshots](https://scrapfly.io/products/screenshot-api), [extraction](https://scrapfly.io/products/extraction-api), [crawling](https://scrapfly.io/products/crawler-api), [agents](https://scrapfly.io/products/ai-browser-agent), and [MCP](https://scrapfly.io/products/mcp-cloud). - Stack ownershipOwns the entire stack: [in-house proxy mesh](https://scrapfly.io/products/proxy-saver), stealth HTTP engine ([Curlium](https://scrapfly.io/curlium)), and stealth browser ([Scrapium](https://scrapfly.io/scrapium)). // MOST SCRAPING APIS- Protected-site success rateOften well below 60% on the same targets. - Failed requestsFailed requests still consume credits. - PricingTiered pricing with premium-domain surcharges and rigid plans. - Product breadthMost cover scraping only. Browser or extraction usually means a second vendor. - Stack ownershipResells someone else's stack. [ See full vendor comparisons ](https://scrapfly.io/compare) --- // TESTIMONIALS## Trusted by 30,000+ enterprises. Teams pick Scrapfly after testing the alternatives. Here is why they stay. “Love using scrapfly, would highly recommend it. Their scraper set up is easily superior to something like firecrawl (firecrawl gets blocked often and is easy to replicate). MR **Marcelo R.** Managing Member [ Verified Capterra review ](https://www.capterra.com/p/212653/Scrapfly/) “Takes the pain out of dealing with anti-bot protections and lets us focus on what we actually want to do with the data rather than fighting to access it. MM **Megan M.** Principal Investigator, AI research platform [ Verified Capterra review ](https://www.capterra.com/p/212653/Scrapfly/) “Ran a 74k URL scraping job without major issues. Good value with the 200k credits on Discovery plan. GV **Gilbert V.** Growth [ Verified Capterra review ](https://www.capterra.com/p/212653/Scrapfly/) --- // PRICING## Try Scrapfly today. Same API key across every Scrapfly product. Pick a credit budget, every product shares the pool. No per-product lock-in, no surprise line items. FREE **1,000 credits on signup.** Every product, no credit card, no time limit. [ Get Free Credits ](https://scrapfly.io/register) // DISCOVERY **$30** /mo **$0.15** per 1k credits, prepaid **200,000** API credits / month - **5** concurrent requests - **1 week** log retention - No pay-as-you-go - Solo account - Basic Support [ Start Free ](https://scrapfly.io/register) // PRO **$100** /mo **$0.10** per 1k credits, prepaid **1,000,000** API credits / month - **20** concurrent requests - **2 weeks** log retention - Extra at **$3.50** / 10k - Solo account - Standard Support [ Start Free ](https://scrapfly.io/register) MOST POPULAR // STARTUP **$250** /mo **$0.10** per 1k credits, prepaid **2,500,000** API credits / month - **50** concurrent requests - **3 weeks** log retention - Extra at **$2.00** / 10k - Team management - Standard Support [ Start Free ](https://scrapfly.io/register) // ENTERPRISE **$500** /mo **$0.09** per 1k credits, prepaid **5,500,000** API credits / month - **100** concurrent requests - **4 weeks** log retention - Extra at **$1.20** / 10k - Team management - Premium Support [ Start Free ](https://scrapfly.io/register) // CUSTOM **Custom** **Negotiated** volume contract **Unlimited** credits negotiated - **Committed** concurrency - **Custom** log retention - MSA, DPA - Dedicated residential pools - Premium 24/7 support [ Talk to Sales ](mailto:sales@scrapfly.io?subject=Enterprise%20Plan%20Request) Full plan details on the [pricing page](https://scrapfly.io/pricing). No annual contract required, upgrade or downgrade anytime. --- // USE CASES## Built for every web-scraping workflow. From price monitoring to AI training corpora. One API, every vertical. [ E-commerce ](https://scrapfly.io/use-case/ecommerce-web-scraping) [ Finance ](https://scrapfly.io/use-case/finance-web-scraping) [ Travel ](https://scrapfly.io/use-case/travel-web-scraping) [ Real estate ](https://scrapfly.io/use-case/real-estate-web-scraping) [ Jobs ](https://scrapfly.io/use-case/jobs-web-scraping) [ SEO & SERP ](https://scrapfly.io/use-case/seo-and-serp-web-scraping) [ Social media ](https://scrapfly.io/use-case/social-media-web-scraping) [ News & media ](https://scrapfly.io/use-case/media-and-news-web-scraping) [ Lead gen ](https://scrapfly.io/use-case/web-scraping-leads) [ AI training ](https://scrapfly.io/use-case/ai-training-web-scraping) [ Compliance ](https://scrapfly.io/use-case/compliance-web-scraping) [ Fraud detection ](https://scrapfly.io/use-case/fraud-detection-web-scraping) [ Logistics ](https://scrapfly.io/use-case/logistics-web-scraping) [ See all ](https://scrapfly.io/use-case/web-scraping) --- // FROM THE BLOG## Web scraping guides, deep-dives, and updates. New tutorials and bypass guides every week. [ ](https://scrapfly.io/blog/posts/http2-http3-fingerprinting-guide) NEW http ### [HTTP/2 and HTTP/3 Fingerprinting: Protocol-Level Bot Detection](https://scrapfly.io/blog/posts/http2-http3-fingerprinting-guide) Learn how HTTP/2 and HTTP/3 fingerprinting works at the protocol level, how anti-bot services use SETTINGS frames, pseudo-header ordering, and QUIC transport parameters to detect scrapers, and how to bypass detection with proper fingerprint matching using Python. 13 min read [ ](https://scrapfly.io/blog/posts/how-browser-fingerprinting-works) NEW blocking ### [How Browser Fingerprinting Works and How to Defend Against It](https://scrapfly.io/blog/posts/how-browser-fingerprinting-works) Learn how browser fingerprinting works, from canvas to WebGPU, and discover developer-focused techniques to bypass detection in your web scrapers. 16 min read [ ](https://scrapfly.io/blog/posts/playwright-stealth-bypass-bot-detection) NEW python ### [Playwright Stealth: Bypass Bot Detection in Python & Node.js](https://scrapfly.io/blog/posts/playwright-stealth-bypass-bot-detection) Complete guide to using playwright-stealth in Python and playwright-extra with stealth plugin in Node.js. Covers how detection works, evasion module breakdown, testing, limitations, and scaling to production with cloud browsers. 19 min read [ ](https://scrapfly.io/blog/posts/how-to-scrape-instagram) python ### [How to Scrape Instagram in 2026](https://scrapfly.io/blog/posts/how-to-scrape-instagram) Tutorial on how to scrape instagram.com user and post data using pure Python. How to scrape instagram without loging in or being blocked. 22 min read [ ](https://scrapfly.io/blog/posts/how-to-bypass-cloudflare-anti-scraping) blocking ### [How to Bypass Cloudflare When Web Scraping in 2026](https://scrapfly.io/blog/posts/how-to-bypass-cloudflare-anti-scraping) Cloudflare offers one of the most popular anti scraping service, so in this article we'll take a look how it works and how to bypass it. 15 min read [ ](https://scrapfly.io/blog/posts/how-to-scrape-twitter) python ### [How to Scrape X.com (Twitter) in 2026](https://scrapfly.io/blog/posts/how-to-scrape-twitter) X.com changed the game in 2023 by closing free API access and implementing defenses that shift every 2-4 weeks. This guide explains what breaks, why it breaks, and how ScrapFly's maintained scraper handles it automatically. 14 min read [ ](https://scrapfly.io/blog/posts/how-to-scrape-linkedin) python ### [How to Scrape LinkedIn in 2026](https://scrapfly.io/blog/posts/how-to-scrape-linkedin) LinkedIn aggressively blocks scrapers. This guide shows how to scrape profiles, companies, and jobs anyway using ScrapFly's anti-bot solution. Python code included. 29 min read [ ](https://scrapfly.io/blog/posts/how-to-bypass-anti-bot-protection-when-web-scraping) blocking ### [How to Bypass Anti-Bot Protection When Web Scraping](https://scrapfly.io/blog/posts/how-to-bypass-anti-bot-protection-when-web-scraping) Learn how anti-bot systems detect scrapers and 5 universal bypass techniques including proxy rotation, fingerprinting, and fortified headless browsers. 14 min read [ Browse the blog ](https://scrapfly.io/blog) --- FAQ## Frequently Asked Questions ### WHAT IS SCRAPFLY'S WEB SCRAPING API? A web scraping API is a service that fetches any URL with anti-bot bypass, proxy rotation, and JavaScript rendering on every request, without you maintaining headless browsers or proxy stacks. Scrapfly's [Web Scraping API](https://scrapfly.io/products/web-scraping-api) delivers this with one HTTP call returning HTML, markdown, plain text, or structured JSON. You only pay for successful requests. ### WHAT'S SCRAPFLY'S SUCCESS RATE ON PROTECTED SITES? 98% on Cloudflare, 97% on Akamai, 96% on DataDome, Imperva, and AWS WAF, 95% on PerimeterX and F5, and 94% on Kasada. Tracked daily against production traffic. See [Anti-Bot Bypass](https://scrapfly.io/bypass) for current numbers. ### HOW DO YOU BYPASS ANTI-BOT PROTECTION? Set `asp=true` on any request. Scrapfly detects which [anti-bot system](https://scrapfly.io/bypass) is active on the target and routes through the right engine: [Curlium](https://scrapfly.io/curlium) (byte-perfect Chrome HTTP layer for JA4 / HTTP/2 / QUIC fingerprinting) or [Scrapium](https://scrapfly.io/scrapium) (stealth Chromium for JavaScript challenges, captchas, and behavioral biometrics). Both share the same Chrome identity so detection systems never see a fingerprint change mid-session. One parameter, every vendor, no per-target configuration. ### WHAT KIND OF PROXIES DOES SCRAPFLY OFFER? Two managed options. Use Scrapfly's built-in pools: datacenter (1 credit per request) or residential (25 credits per request, 190+ countries) with auto-rotation, IP cooling, and optional session stickiness. Or bring your own provider via [Proxy Saver](https://scrapfly.io/products/proxy-saver), which plugs Bright Data, Oxylabs, Webshare, SmartProxy, DataImpulse, or any SOCKS5 / HTTP proxy into the same Web Scraping API endpoint. Either way, anti-bot bypass, JA3 / JA4 fingerprint coherence, and smart retry sit on top. ### DOES SCRAPFLY WORK WITH AI AGENTS AND MCP CLIENTS? Yes. The [MCP Server](https://scrapfly.io/products/mcp-cloud) connects any MCP-compatible client (Claude, Cursor, Cline, Windsurf, ChatGPT, and others) to scrape, screenshot, extract, and crawl. The [AI Browser Agent](https://scrapfly.io/products/ai-browser-agent) supports Browser Use, Stagehand, and Vibium agent loops on stealth Chromium. Native integrations also exist for LangChain, LlamaIndex, and CrewAI. ### WHAT OUTPUT FORMATS DOES SCRAPFLY SUPPORT? Multiple formats from a single API call: HTML (raw or sanitized), Markdown (with link / image stripping for LLM contexts), plain text, JSON (parsed or as the API envelope), screenshots in PNG / JPEG / WebP via the [Screenshot API](https://scrapfly.io/products/screenshot-api), structured JSON via the [Extraction API](https://scrapfly.io/products/extraction-api) using LLM prompts, CSS / XPath rules, or pre-trained models, and WARC archives for [crawl jobs](https://scrapfly.io/products/crawler-api). ### WHICH PROGRAMMING LANGUAGES DOES SCRAPFLY SUPPORT? Five official [SDKs](https://scrapfly.io/docs/sdk): [Python](https://scrapfly.io/docs/sdk/python), [TypeScript](https://scrapfly.io/docs/sdk/typescript) (Node, Deno, Bun), [Go](https://scrapfly.io/docs/sdk/golang), [Rust](https://scrapfly.io/docs/sdk/rust), and a [Scrapy](https://scrapfly.io/docs/sdk/scrapy) extension. The REST API works with any language via plain HTTP. The [CLI](https://scrapfly.io/docs/cli) handles shell pipelines and CI integration. ### HOW IS SCRAPFLY DIFFERENT FROM BRIGHT DATA, ZYTE, AND OXYLABS? Bright Data and Oxylabs are proxy-first platforms with scrapers built on top: strong on proxy infrastructure and managed datasets, heavier configuration per target. Zyte is built around Scrapy and managed services for high-protection enterprise targets. Scrapfly is single-endpoint: one API call with `asp=true` handles anti-bot, proxy rotation, JavaScript rendering, and structured output across every vendor with no per-target setup. You pay only for successful requests. See per-vendor comparisons on the [comparison hub](https://scrapfly.io/compare#grid). ### IS SCRAPFLY SOC 2 COMPLIANT? Yes. Scrapfly holds SOC 2 Type I and SOC 2 Type II certifications, plus ISO 27001 and GDPR compliance. See [Compliance](https://scrapfly.io/compliance) for the full list of attestations. ### DOES SCRAPFLY OFFER ENTERPRISE PLANS AND DEDICATED SUPPORT? Yes. The Enterprise tier is $500 / month (5.5M credits, 100 concurrent requests, premium support, team management). Custom plans above 5.5M credits / month include MSA + DPA, dedicated residential proxy pools, committed concurrency, premium support, and custom log retention. Contact . See [pricing](https://scrapfly.io/pricing) for the full grid. ### WHAT HAPPENS IF A REQUEST FAILS? You are not charged. Failed bypass attempts do not consume API credits. The API returns a structured error response with retry guidance. Transient failures on heavily protected targets are automatically retried within the same request before returning an error. ### WHAT'S THE PRICING? Usage-based, priced per API credit. Free tier: 1,000 credits, no card, no time limit. Paid plans start at $30 / month (Discovery, 200k credits, 5 concurrent) and scale to $500 / month (Enterprise, 5.5M credits, 100 concurrent), with custom contracts above 5.5M credits / month. Credit cost per call scales with features used (1 credit for HTTP, +5 for JavaScript or anti-bot, +25 for residential, 60 for screenshot). Failed requests are free. See [pricing](https://scrapfly.io/pricing) for the full plan grid and credit matrix, or use the [cost estimator](https://scrapfly.io/cost_estimator) to size your project. --- // GET STARTED### Ship in a minute. Not a sprint. Free account, 1,000 credits, no credit card. One key, every product. [ Get Free API Key ](https://scrapfly.io/register) [See pricing](https://scrapfly.io/pricing)