Web Scraping API

Bad success rate? Proxy Issue? Take instant benefits of years of experience directly in your applications.

Web Scraping on autopilot, we rotate proxies, unblock scrape and manage headless browsers for you.

99.9%
55To+
Data Transferred
700M+
Success Scrape
Monthly
curl -i "http://api.scrapfly.io/scrape?key=APIKEY&url=URL"
HTTP/2 200
content-type: application/json; charset=utf-8
x-scrapfly-account-concurrent-usage: 1
x-scrapfly-account-remaining-concurrent-usage: 4
x-scrapfly-api-cost: 1
x-scrapfly-remaining-api-credit: 9982276
x-scrapfly-response-time: 1.090000
{
    "config": {...},
    "result": {
        "content": "{\n  \"args\": {}, \n  \"data\": \"\", \n...
        "size": 1094,
        "ssl": null,
        "status": "DONE",
        "status_code": 200,
        "success": true,
        "url": "https://httpbin.org/anything"
        "format": "text",
        "iframes": [],
        "log_url": "https://scrapfly.io/dashboard/monitoring/log/07f459cd-5b8c-4c5a-9649-c6bb70c1314e",
        "request_headers" : { ... },
        "response_headers" : { ... },
        "screenshots" : [],
        ...
    },
    ...
}}
                                

Quickly Build Your Project

Scrapfly unify the whole toolchain to scrape any targets without spending time with rotating proxies, headless browsers and blocking protection

We help clients by solving their issues in many industries, real estate, ecommerce, human resources, competitive intelligence, news, market stock, travel.

Discover more industries using Web Scraping

Features

Anti Scraping Protection

Anti-Scraping Protection

&asp=true

ASP bypass major anti scraping protection by shielding your scrape. We constantly updating it

Screenshot

Screenshot

&screenshots[test]=fullpage

Take one or multiple screenshots of page, full page or scoped on element

Ban Detection

Ban Detection

IP failover / cooling - Intelligent distribution backed by a statistical model

Real Time Dashboard

Real-Time Dashboard

Monitor, analyze, introspect, debug, screenshot, replay from dedicated URL to fix

Automatic IP Roatation

Proxies

&proxy_pool=public_residential_pool

Datacenter, Residential proxies pool available. Automatic proxy network type upgrade to bypass with anti bot

Presistent Sessions

Persistent Sessions

&session=my-session

Persist session on demand and use the same context across requests

Javascript Rendering

Javascript Rendering

&render_js=true

Scrape with a real browser, execute your own javascript

Caching System

Caching System

&cache=true

On-demand, rebuild dataset from scratch faster without overloading an upstream website

Async

Webhook

&webhook=my-endpoint-name

Send scrape order and receive result through webhook notification when scrape is finished with intelligent backoff, just in case, you know

Fully Customizable

Fully Customizable

&headers[X-Custom]=test

Customs headers, post rendering delay, HTTP method (GET, POST, PUT, PATCH, HEAD)

Simple & Predictable Billing

How many scrape per month do you need?

Get started with 1,000 free Scrape API calls. Try Scrapfly for free
Custom Subscription
/mo
Custom
ENTERPRISE Subscription
$400/mo
Enterprise
STARTUP Subscription
$250/mo
Startup
PRO Subscription
$100/mo
Pro
HACKER Subscription
$15/mo
Hacker
Included API Calls 5,000,000 3,000,000 1,000,000 200,000
Extra API Calls per 10k $1.10 per 10k $1.50 per 10k $1.80 per 10k
Concurrent Request 100 50 20 5
Log Retention ∞ weeks 4 weeks 3 weeks 2 weeks 1 weeks
Anti Scraping Protection
Residential Proxy
Geo targeting
Javascript Rendering
Support Premium Support Premium Support Standard Support Standard Support Basic Support

* Price may vary with tax