Scrapfly Web Scraping API | API Documentation

ACCOUNT ERR::ACCOUNT::PAYMENT_REQUIRED
Unable to charge last invoice - Connect to your dashboard to solve the issue

ACCOUNT ERR::ACCOUNT::SUSPENDED
Account Suspended

SCRAPER ERR::API::INTERNAL_ERROR
API Internal Error

SCRAPER ERR::ASP::CAPTCHA_ERROR
Something wrong happened with the captcha. We will figure out to fix the problem as soon as possible

SCRAPER ERR::ASP::CAPTCHA_TIMEOUT
The budgeted time to solve the captcha is reached

THROTTLER ERR::ASP::PROTECTION_FAILED
The attempt to solved or bypass the bot protection failed for this time - Unfortunately it happened sometimes and you should retry this error if it's sporadic. If this issue always happened - check your config and ask support

SCRAPER ERR::ASP::SHIELD_ERROR
The ASP encounter an unexpected problem. We will fix it as soon as possible. Our team has been alerted

SCRAPER ERR::ASP::SHIELD_EXPIRED
The ASP shield previously set is expired, you must retry.

SCRAPER ERR::ASP::SHIELD_PROTECTION_FAILED
The ASP shield failed to solve the challenge against the anti scrapping protection

SCRAPER ERR::ASP::TIMEOUT
The ASP made too much time to solve or respond

SCRAPER ERR::ASP::UNABLE_TO_SOLVE_CAPTCHA
Despite our effort, we were unable to solve the captcha. It can happened sporadically, please retry

SCRAPER ERR::ASP::UPSTREAM_UNEXPECTED_RESPONSE
The response given by the upstream after challenge resolution is not expected. Our team has been alerted

PROXY ERR::PROXY::POOL_NOT_AVAILABLE_FOR_TARGET
The desired proxy pool is not available for the given domain - mostly well known protected domain which require at least residential networks

PROXY ERR::PROXY::POOL_NOT_FOUND
Provided Proxy Pool Name do not exists

PROXY ERR::PROXY::POOL_UNAVAILABLE_COUNTRY
Country not available for given proxy pool

PROXY ERR::PROXY::RESOURCES_SATURATION
Proxy are saturated for the desired country, you can try on other countries. They will come back as soon as possible

PROXY ERR::PROXY::TIMEOUT
Proxy connection was too slow and timeout

PROXY ERR::PROXY::UNAVAILABLE
Proxy is unavailable - The domain (mainly gov website) is restricted, You are using session feature and the proxy is unreachable at the moment

SCHEDULER ERR::SCHEDULE::DISABLED
The targeted schedule has been disabled

SCRAPER ERR::SCRAPE::BAD_PROTOCOL
The protocol is not supported : http:// or https://

SCRAPER ERR::SCRAPE::BAD_UPSTREAM_RESPONSE
The website you target respond with an unexpected status code (>400)

SCRAPER ERR::SCRAPE::COST_BUDGET_LIMIT
You must increase the budget to pass this target

SCRAPER ERR::SCRAPE::DNS_NAME_NOT_RESOLVED
The DNS of the targeted website is not resolving or not responding

SCRAPER ERR::SCRAPE::DOMAIN_NOT_ALLOWED
The Domain targeted is not allowed or restricted

SCRAPER ERR::SCRAPE::DOM_SELECTOR_INVISIBLE
The requested DOM selected is invisible (Mostly issued when element is targeted for screenshot)

SCRAPER ERR::SCRAPE::DOM_SELECTOR_NOT_FOUND
The requested DOM selected was not found in rendered content within 15s

SCRAPER ERR::SCRAPE::DRIVER_CRASHED
Driver used to perform the scrape can crash for many reason

SCRAPER ERR::SCRAPE::DRIVER_TIMEOUT
Driver timeout - No response received

SCRAPER ERR::SCRAPE::JAVASCRIPT_EXECUTION
The javascript to execute goes wrong, please read the associated message to figure out the problem

SCRAPER ERR::SCRAPE::NETWORK_ERROR
Network error happened between Scrapfly server and remote server

SCRAPER ERR::SCRAPE::NETWORK_SERVER_DISCONNECTED
Server of upstream website closed unexpectedly the connection

SCRAPER ERR::SCRAPE::NO_BROWSER_AVAILABLE
No browser available in the pool

SCRAPER ERR::SCRAPE::OPERATION_TIMEOUT
This is a generic error for when timeout occur. It happened when internal operation took too much time

SCRAPER ERR::SCRAPE::PROJECT_QUOTA_LIMIT_REACHED
The limit set to the current project has been reached

SCRAPER ERR::SCRAPE::QUOTA_LIMIT_REACHED
You reach your scrape quota plan for the month. You can upgrade your plan if you want increase the quota

SCRAPER ERR::SCRAPE::SCENARIO_DEADLINE_OVERFLOW
Submitted scenario would require more than 30s to complete

SCRAPER ERR::SCRAPE::SCENARIO_EXECUTION
Javascript Scenario Failed

SCRAPER ERR::SCRAPE::SCENARIO_TIMEOUT
Javascript Scenario Timeout

SCRAPER ERR::SCRAPE::SSL_ERROR
ScrapeEngineError due to SSL, mostly due to handshake error

SCRAPER ERR::SCRAPE::TOO_MANY_CONCURRENT_REQUEST
You reach concurrent limit of scrape request of your current plan

SCRAPER ERR::SCRAPE::UNABLE_TO_TAKE_SCREENSHOT
Unable to take screenshot, happened when renderer encounter bad formatted code

SCRAPER ERR::SCRAPE::UPSTREAM_TIMEOUT
The website you target made too much time to response

SCRAPER ERR::SCRAPE::UPSTREAM_WEBSITE_ERROR
The website you target respond with an unexpected status code (>400)

SCRAPER ERR::SESSION::CONCURRENT_ACCESS
Concurrent access to the session has been tried. If your spider run on distributed architecture, check if the correlation id is correctly configured

THROTTLER ERR::THROTTLE::MAX_API_CREDIT_BUDGET_EXCEEDED
Your scrape request has been throttled. API Credit Budget reached. If it's not expected, please check your throttle configuration for the given project and env.

THROTTLER ERR::THROTTLE::MAX_CONCURRENT_REQUEST_EXCEEDED
Your scrape request has been throttled. Too many concurrent access to the upstream. If it's not expected, please check your throttle configuration for the given project and env.

THROTTLER ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env

WEBHOOK ERR::WEBHOOK::DISABLED
Given webhook is disabled, please check out your webhook configuration for the current project / env

WEBHOOK ERR::WEBHOOK::QUEUE_FULL
We were not able to contact your endpoint

WEBHOOK ERR::WEBHOOK::QUEUE_FULL
You reach the maximum concurrency limit

WEBHOOK ERR::WEBHOOK::MAX_RETRY
Maximum retry exceeded on your webhook

WEBHOOK ERR::WEBHOOK::NOT_FOUND
Unable to find the given webhook for the current project / env

WEBHOOK ERR::WEBHOOK::QUEUE_FULL
You reach the limit of scheduled webhook - You must wait pending webhook are processed

Summary