SSL

View as markdown
Copy for LLM Open in ChatGPT Open in Claude Open in Perplexity

SSL feature is very straightforward - it collects information about the SSL certificate of the scraped page. It can be a useful tool for monitoring certificate changes, expiration dates and validity.

Note that enabling SSL may slow down scraping speed.

SSL details can also be found in the monitoring dashboard logs under the SSL tab:

sll details on the monitoring logs page

Usage

To use SSL feature the SSL parameter can be enabled on any Scrapfly scrape request. This will include SSL details in the result.ssl field:

Ruby HTTP 
# gem install httparty

require 'httparty'
require 'json'

# Build query parameters
params = {
  'ssl' => true,
  'key' => "__API_KEY__",
  'url' => "https://web-scraping.dev/",
}

url = "https://api.scrapfly.io/scrape"

options = {
  query: params,
  timeout: 160,
  open_timeout: 10,
}

begin
  response = HTTParty.get(url, options)

  # Check for HTTP errors
  unless response.success?
    error_data = response.parsed_response
    error_msg = error_data['message'] || error_data['description'] || 'Request failed'
    raise "HTTP error #{response.code}: #{error_msg}"
  end

  data = response.parsed_response
  puts JSON.pretty_generate(data)

  # Access the scrape result
  puts data['result'] if data['result']

rescue HTTParty::Error => e
  STDERR.puts "Request failed: #{e.message}"
  raise
rescue StandardError => e
  STDERR.puts "Error: #{e.message}"
  raise
end

https://api.scrapfly.io/scrape?ssl=true&key=&url=https%3A%2F%2Fweb-scraping.dev%2F

Example Of Response

Pricing

No additional fee is applied on usage.

Summary