logo
Website
API Player
API Specification
Error Code
Web Platform
  • Project
  • Account
  • Billing
Web Scraper API
  • Getting started
  • Customize Request
  • Debug
  • Anti Scraping Protection
  • Proxy
  • Javascript Rendering
  • Javascript Scenario NEW
  • SSL
  • DNS
  • Cache
  • Session
  • Webhook
  • Screenshot
  • Errors
  • Timeout
  • FAQ
Web Scraper
  • Monitoring
  • Scheduler
  • Spider
  • Throttling
SDK
  • Python
  • Scrapy

Summary

    • ACCOUNT ERR::ACCOUNT::PAYMENT_REQUIRED
      Unable to charge last invoice - Connect to your dashboard to solve the issue
    • ACCOUNT ERR::ACCOUNT::SUSPENDED
      Account Suspended
    • SCRAPER ERR::API::INTERNAL_ERROR
      API Internal Error
    • SCRAPER ERR::ASP::CAPTCHA_ERROR
      Something wrong happened with the captcha. We will figure out to fix the problem as soon as possible
    • SCRAPER ERR::ASP::CAPTCHA_TIMEOUT
      The budgeted time to solve the captcha is reached
    • THROTTLER ERR::ASP::PROTECTION_FAILED
      The attempt to solved or bypass the bot protection failed for this time - Unfortunately it happened sometimes and you should retry this error if it's sporadic. If this issue always happened - check your config and ask support
    • SCRAPER ERR::ASP::SHIELD_ERROR
      The ASP encounter an unexpected problem. We will fix it as soon as possible. Our team has been alerted
    • SCRAPER ERR::ASP::SHIELD_EXPIRED
      The ASP shield previously set is expired, you must retry.
    • SCRAPER ERR::ASP::SHIELD_PROTECTION_FAILED
      The ASP shield failed to solve the challenge against the anti scrapping protection
    • SCRAPER ERR::ASP::TIMEOUT
      The ASP made too much time to solve or respond
    • SCRAPER ERR::ASP::UNABLE_TO_SOLVE_CAPTCHA
      Despite our effort, we were unable to solve the captcha. It can happened sporadically, please retry
    • SCRAPER ERR::ASP::UPSTREAM_UNEXPECTED_RESPONSE
      The response given by the upstream after challenge resolution is not expected. Our team has been alerted
    • PROXY ERR::PROXY::POOL_NOT_AVAILABLE_FOR_TARGET
      The desired proxy pool is not available for the given domain - mostly well known protected domain which require at least residential networks
    • PROXY ERR::PROXY::POOL_NOT_FOUND
      Provided Proxy Pool Name do not exists
    • PROXY ERR::PROXY::POOL_UNAVAILABLE_COUNTRY
      Country not available for given proxy pool
    • PROXY ERR::PROXY::RESOURCES_SATURATION
      Proxy are saturated for the desired country, you can try on other countries. They will come back as soon as possible
    • PROXY ERR::PROXY::TIMEOUT
      Proxy connection was too slow and timeout
    • PROXY ERR::PROXY::UNAVAILABLE
      Proxy is unavailable - The domain (mainly gov website) is restricted, You are using session feature and the proxy is unreachable at the moment
    • SCHEDULER ERR::SCHEDULE::DISABLED
      The targeted schedule has been disabled
    • SCRAPER ERR::SCRAPE::BAD_PROTOCOL
      The protocol is not supported : http:// or https://
    • SCRAPER ERR::SCRAPE::BAD_UPSTREAM_RESPONSE
      The website you target respond with an unexpected status code (>400)
    • SCRAPER ERR::SCRAPE::COST_BUDGET_LIMIT
      You must increase the budget to pass this target
    • SCRAPER ERR::SCRAPE::DNS_NAME_NOT_RESOLVED
      The DNS of the targeted website is not resolving or not responding
    • SCRAPER ERR::SCRAPE::DOMAIN_NOT_ALLOWED
      The Domain targeted is not allowed or restricted
    • SCRAPER ERR::SCRAPE::DOM_SELECTOR_INVISIBLE
      The requested DOM selected is invisible (Mostly issued when element is targeted for screenshot)
    • SCRAPER ERR::SCRAPE::DOM_SELECTOR_NOT_FOUND
      The requested DOM selected was not found in rendered content within 15s
    • SCRAPER ERR::SCRAPE::DRIVER_CRASHED
      Driver used to perform the scrape can crash for many reason
    • SCRAPER ERR::SCRAPE::DRIVER_TIMEOUT
      Driver timeout - No response received
    • SCRAPER ERR::SCRAPE::JAVASCRIPT_EXECUTION
      The javascript to execute goes wrong, please read the associated message to figure out the problem
    • SCRAPER ERR::SCRAPE::NETWORK_ERROR
      Network error happened between Scrapfly server and remote server
    • SCRAPER ERR::SCRAPE::NETWORK_SERVER_DISCONNECTED
      Server of upstream website closed unexpectedly the connection
    • SCRAPER ERR::SCRAPE::NO_BROWSER_AVAILABLE
      No browser available in the pool
    • SCRAPER ERR::SCRAPE::OPERATION_TIMEOUT
      This is a generic error for when timeout occur. It happened when internal operation took too much time
    • SCRAPER ERR::SCRAPE::PROJECT_QUOTA_LIMIT_REACHED
      The limit set to the current project has been reached
    • SCRAPER ERR::SCRAPE::QUOTA_LIMIT_REACHED
      You reach your scrape quota plan for the month. You can upgrade your plan if you want increase the quota
    • SCRAPER ERR::SCRAPE::SCENARIO_DEADLINE_OVERFLOW
      Submitted scenario would require more than 30s to complete
    • SCRAPER ERR::SCRAPE::SCENARIO_EXECUTION
      Javascript Scenario Failed
    • SCRAPER ERR::SCRAPE::SCENARIO_TIMEOUT
      Javascript Scenario Timeout
    • SCRAPER ERR::SCRAPE::SSL_ERROR
      ScrapeEngineError due to SSL, mostly due to handshake error
    • SCRAPER ERR::SCRAPE::TOO_MANY_CONCURRENT_REQUEST
      You reach concurrent limit of scrape request of your current plan
    • SCRAPER ERR::SCRAPE::UNABLE_TO_TAKE_SCREENSHOT
      Unable to take screenshot, happened when renderer encounter bad formatted code
    • SCRAPER ERR::SCRAPE::UPSTREAM_TIMEOUT
      The website you target made too much time to response
    • SCRAPER ERR::SCRAPE::UPSTREAM_WEBSITE_ERROR
      The website you target respond with an unexpected status code (>400)
    • SCRAPER ERR::SESSION::CONCURRENT_ACCESS
      Concurrent access to the session has been tried. If your spider run on distributed architecture, check if the correlation id is correctly configured
    • THROTTLER ERR::THROTTLE::MAX_API_CREDIT_BUDGET_EXCEEDED
      Your scrape request has been throttled. API Credit Budget reached. If it's not expected, please check your throttle configuration for the given project and env.
    • THROTTLER ERR::THROTTLE::MAX_CONCURRENT_REQUEST_EXCEEDED
      Your scrape request has been throttled. Too many concurrent access to the upstream. If it's not expected, please check your throttle configuration for the given project and env.
    • THROTTLER ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
      Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env
    • WEBHOOK ERR::WEBHOOK::DISABLED
      Given webhook is disabled, please check out your webhook configuration for the current project / env
    • WEBHOOK ERR::WEBHOOK::QUEUE_FULL
      We were not able to contact your endpoint
    • WEBHOOK ERR::WEBHOOK::QUEUE_FULL
      You reach the maximum concurrency limit
    • WEBHOOK ERR::WEBHOOK::MAX_RETRY
      Maximum retry exceeded on your webhook
    • WEBHOOK ERR::WEBHOOK::NOT_FOUND
      Unable to find the given webhook for the current project / env
    • WEBHOOK ERR::WEBHOOK::QUEUE_FULL
      You reach the limit of scheduled webhook - You must wait pending webhook are processed

    Company

    • Terms of service
    • Privacy Policy
    • Data Processing Agreement
    • Status

    Resources

    • API Documentation
    • Is Web Scraping Legal?
    • Web Scraping Tools
    • FAQ

    Learn Web Scraping

    • Web Scraping with Python Scrapy
    • How to Scrape without getting blocked tutorial
    • Web Scraping with Python and BeautifulSoup
    • Web Scraping with Nodejs and Puppeteer
    • Web Scraping with PHP
    • Web Scraping with Ruby
    • Web Scraping with R
    • Web Scraping with NodeJS
    • How To Scrape Graphql
    • Best Proxies for Web Scraping
    • Top 5 Best Residential Proxies

    Usage

    • Web Scraping for Growth Hacking
    • Web Scraping for Ecommerce
    • Web Scraping for Finance
    • Web Scraping for Real Estate
    • Web Scraping for Travel
    • Web Scraping for Machine Learning
    • Web Scraping for News & Media
    • Web Scraping for Competitive Intelligence
    • Web Scraping for Business Automation
    © 2023 Scrapfly