ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED

Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env. See all errors

  • Retryable: Yes
  • HTTP status code: 429
If retryable is "yes" and retry=true the errored is retried internally by scrapfly. In the end if you get the error, it means the errors happened 3 times or the error happened after retries from other kind of retryable error in the last retry round.

Related Documentation

Read Error From Response Body

{
    "config": { ... },
    "context": { ... },
    "result": {
        [...],
        "status": "DONE",
        "success": false,
        "reason": null,
        "error": {
            "http_code": 429,
            "code": "ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED",
            "description": "Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env",
            "error_id": "9993a546-b899-4927-b788-04f5c4e473d5",
            "message": "Useful hint with details about your error",
            "scrape_id": "7c61352c-f1a7-4ea6-a0b8-198d7ac6fe1a",
            "retryable": true,
            "doc_url": "https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED"
        },
        [...],
    }
}

Read Error From Response Headers

Moslty relevant with HEAD request

  • X-Scrapfly-Reject-Code: ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
  • X-Scrapfly-Reject-Description: Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env
  • X-Scrapfly-Reject-Doc: https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
  • X-Scrapfly-Reject-Http-Code: https://scrapfly.io/docs/scrape-api/error/429
  • X-Scrapfly-Reject-Retryable: true

Suggested content