Web Scraping API

Bad success rate? Proxy Issue? Take instant benefits of years of experience directly in your applications.

Web Scraping on autopilot, we rotate proxies, unblock scrape and manage headless browsers for you.

Try for free

99.99%

Uptime

183To+

Data Transferred

1,2B+

Success Requests

Monthly

curl -i "http://api.scrapfly.io/scrape?key=APIKEY&url=URL"

HTTP/2 200

content-type: application/json; charset=utf-8

x-scrapfly-account-concurrent-usage: 1

x-scrapfly-account-remaining-concurrent-usage: 4

x-scrapfly-api-cost: 1

x-scrapfly-remaining-api-credit: 9982276

x-scrapfly-response-time: 1.090000

{
    "config": {...},
    "result": {
        "content": "{\n  \"args\": {}, \n  \"data\": \"\", \n...
        "size": 1094,
        "ssl": null,
        "status": "DONE",
        "status_code": 200,
        "success": true,
        "url": "https://httpbin.dev/anything"
        "format": "text",
        "iframes": [],
        "log_url": "https://scrapfly.io/dashboard/monitoring/log/07f459cd-5b8c-4c5a-9649-c6bb70c1314e",
        "request_headers" : { ... },
        "response_headers" : { ... },
        "screenshots" : [],
        ...
    },
    ...
}}

Quickly Build Your Project

Scrapfly unify the whole toolchain to scrape any targets without spending time with rotating proxies, headless browsers and blocking protection

We help clients by solving their issues in many industries, real estate, ecommerce, human resources, competitive intelligence, news, market stock, travel.

Discover more industries using Web Scraping

Features

Anti-Scraping Protection


                                 &asp=true

ASP bypass major anti scraping protection by shielding your scrape. We constantly updating it

Screenshot


                                 &screenshots[test]=fullpage

Take one or multiple screenshots of page, full page or scoped on element

Ban Detection

IP failover / cooling - Intelligent distribution backed by a statistical model

Real-Time Dashboard

Monitor, analyze, introspect, debug, screenshot, replay from dedicated URL to fix

Proxies


                                 &proxy_pool=public_residential_pool

Datacenter, Residential proxies pool available. Automatic proxy network type upgrade to bypass with anti bot

Persistent Sessions


                                 &session=my-session

Persist session on demand and use the same context across requests

Javascript Rendering


                                 &render_js=true

Scrape with a real browser, execute your own javascript

Caching System


                                 &cache=true

On-demand, rebuild dataset from scratch faster without overloading an upstream website

Webhook


                                 &webhook=my-endpoint-name

Send scrape order and receive result through webhook notification when scrape is finished with intelligent backoff, just in case, you know

Fully Customizable


                                 &headers[X-Custom]=test

Customs headers, post rendering delay, HTTP method (GET, POST, PUT, PATCH, HEAD)

Simple & Predictable Billing

How many scrape per month do you need?

Require Browser +5 API Credits

Require Residential Network +25 API Credits - Protected Website require it

Get started with 1,000 free Scrape API Credits. Try Scrapfly for free

	∞ /mo Custom	$500/mo Enterprise	$250/mo Startup	$100/mo Pro	$30/mo Discovery
Included API Credits	∞	5,500,000	2,500,000	1,000,000	200,000
Extra API Credits	∞ per 10k	$1.20 per 10k	$2.00 per 10k	$3.50 per 10k	✖
Concurrent Request	∞	100	50	20	5
Log Retention	∞ weeks	4 weeks	3 weeks	2 weeks	1 weeks
Anti Scraping Protection	✓	✓	✓	✓	✓
Residential Proxy	✓	✓	✓	✓	✓
Geo targeting	✓	✓	✓	✓	✓
Javascript Rendering	✓	✓	✓	✓	✓
Support	Premium Support	Premium Support	Standard Support	Standard Support	Basic Support

Try with 1,000 Free API Credits

* Price may vary with tax