ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED

Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env. See all errors

  • Retryable: Yes
  • HTTP status code: 429
If retryable is "yes" and retry=true the errored is retried internally by scrapfly. In the end if you get the error, it means the errors happened 3 times or the error happened after retries from other kind of retryable error in the last retry round.

Read Error From Response Body

{
    "config": { ... },
    "context": { ... },
    "result": {
        [...],
        "status": "DONE",
        "success": false,
        "reason": null,
        "error": {
            "http_code": 429,
            "code": "ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED",
            "description": "ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED",
            "error_id": "9993a546-b899-4927-b788-04f5c4e473d5",
            "message": "Useful hint with details about your error",
            "scrape_id": "7c61352c-f1a7-4ea6-a0b8-198d7ac6fe1a",
            "retryable": true,
            "doc_url": "https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED"
        },
        [...],
    }
}

Read Error From Response Headers

Moslty relevant with HEAD request

  • X-Scrapfly-Reject-Code: ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
  • X-Scrapfly-Reject-Description: Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env
  • X-Scrapfly-Reject-Doc: https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
  • X-Scrapfly-Reject-Http-Code: https://scrapfly.io/docs/scrape-api/error/429
  • X-Scrapfly-Reject-Retryable: true

Suggested content

Summary