ERR::CRAWLER::TIMEOUT

View as markdown
Copy for LLM Open in ChatGPT Open in Claude Open in Perplexity

Crawler exceeded time limit. See all errors

  • Retryable: No
  • HTTP status code: 408
If retryable is "yes" and retry=true the errored is retried internally by scrapfly. In the end if you get the error, it means the errors happened 3 times or the error happened after retries from other kind of retryable error in the last retry round.

Read Error From Response Body

{
    "config": { ... },
    "context": { ... },
    "result": {
        [...],
        "status": "DONE",
        "success": false,
        "reason": null,
        "error": {
            "http_code": 408,
            "code": "ERR::CRAWLER::TIMEOUT",
            "description": "ERR::CRAWLER::TIMEOUT",
            "error_id": "9993a546-b899-4927-b788-04f5c4e473d5",
            "message": "Useful hint with details about your error",
            "crawl_id": "7c61352c-f1a7-4ea6-a0b8-198d7ac6fe1a",
            "retryable": false,
            "doc_url": "https://scrapfly.io/docs/crawler-api/error/ERR::CRAWLER::TIMEOUT"
        },
        [...],
    }
}

Read Error From Response Headers

Moslty relevant with HEAD request

  • X-Scrapfly-Reject-Code: ERR::CRAWLER::TIMEOUT
  • X-Scrapfly-Reject-Description: Crawler exceeded time limit
  • X-Scrapfly-Reject-Doc: https://scrapfly.io/docs/crawler-api/error/ERR::CRAWLER::TIMEOUT
  • X-Scrapfly-Reject-Http-Code: https://scrapfly.io/docs/crawler-api/error/408
  • X-Scrapfly-Reject-Retryable: false

Suggested content

Summary