ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env. See all errors
- Retryable: Yes
- HTTP status code: 429
If retryable is "yes" and retry=true
the errored is retried internally by scrapfly. In the end if you get the error, it means the errors happened 3 times or
the error happened after retries from other kind of retryable error in the last retry round.
Related Documentation
Read Error From Response Body
{
"config": { ... },
"context": { ... },
"result": {
[...],
"status": "DONE",
"success": false,
"reason": null,
"error": {
"http_code": 429,
"code": "ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED",
"description": "ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED",
"error_id": "9993a546-b899-4927-b788-04f5c4e473d5",
"message": "Useful hint with details about your error",
"scrape_id": "7c61352c-f1a7-4ea6-a0b8-198d7ac6fe1a",
"retryable": true,
"doc_url": "https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED"
},
[...],
}
}
Read Error From Response Headers
Moslty relevant with HEAD
request
- X-Scrapfly-Reject-Code:
ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
- X-Scrapfly-Reject-Description:
Your scrape request as been throttle. Too much request during the 1m window. If it's not expected, please check your throttle configuration for the given project and env
- X-Scrapfly-Reject-Doc:
https://scrapfly.io/docs/scrape-api/error/ERR::THROTTLE::MAX_REQUEST_RATE_EXCEEDED
- X-Scrapfly-Reject-Http-Code:
https://scrapfly.io/docs/scrape-api/error/429
- X-Scrapfly-Reject-Retryable:
true