Scrapfly n8n Integration

Scrapfly is available on n8n a popular no-code automation platform. The Scrapfly n8n App includes access to all Scrapfly APIs:

  • Use Web Scraping API to scrape any webpage data.
  • Use Extraction API to extract data from n8n inputs.
  • Use Screenshot API to take screenshots of any webpage.

Installation

To use Scrapfly with n8n, you have to install Scrapfly’s community node:

  1. Open your n8n instance settings
  2. Head over the Community nodes section at the bottom of the sidebar
After following the above steps, install the Scrapfly n8n integration using “n8n-nodes-scrapfly” as the package name.

Example Templates

Using n8n and Scrapfly creating web-scraping powered automations is very easy and accessible without any coding experience. Let's take a look at some example templates for common n8n scenarios.

Scraping with Google sheets

Google Sheets is a popular cloud-based spreadsheet tool ideal for automation and web scraping. This example demonstrates how Google Sheets can be used as a web scraping database.

This example watches Google Sheets for newly added URLs and scrapes them using Scrapfly Web Scraping API. Here's a quick breakdown:

  1. Watch for new rows to be added to a Google Sheet
  2. On new URL added:
    1. Scrape the URL using Scrapfly Web Scraping API
    2. Parse Scraped HTML using Scrapfly Extraction API
  3. Save the extracted data back to Google Sheets

Scheduling Scrape Loops

n8n provides a scheduler system that can scrape multiple URLs at regular intervals. This example demonstrates how to schedule a scrape loop using n8n and store results in Google Sheets.

Screenshot to Google Drive

n8n provides a file system infrastructure for handling binary files. This template takes a screenshot of a web page using the Screenshot API and saves the results to Google Drive.

Errors

n8n will return the Scrapfly API error message in the n8n error reporter that matches the standard Scrapfly API error messages. For more see:

Pricing

No additional costs.

Summary