Prerequisites

Before getting started, make sure you have the following:

• Zapier account (free or paid)
• Your Scrapfly API key (create account)

Setup Instructions

Integrate Scrapfly into your Zapier workflows using Webhooks by Zapier. This enables automated web scraping across 5000+ apps with Zapier's simple trigger-action model.

1. Create New Zap

   Start a new automation in Zapier (Note: In Zapier terminology, a Zap is an automated workflow):

   1. Log in to your Zapier account
   2. Click "Create Zap"
   3. Choose a trigger that starts your automation
   Tip: Common Trigger Apps

   • Schedule by Zapier: Run scraping on a schedule (every hour, day, week, etc.)
   • Webhooks by Zapier: Trigger scraping via HTTP request
   • Google Sheets: Scrape URLs when new rows are added
   • Email: Scrape URLs from incoming emails
   • RSS by Zapier: Scrape new feed items automatically
   • Airtable: Scrape when new records are created
2. Add Webhooks by Zapier Action

   Configure a Webhooks action to call the Scrapfly API (Note: In Zapier, Actions are steps that run after a trigger):

   1. Click "+" to add a new action step
   2. Search for and select "Webhooks by Zapier"
   3. Choose "GET" as the action event
   4. Configure the action with these settings:

   Webhooks by Zapier Configuration:

   • URL: https://api.scrapfly.io/scrape?key=__API_KEY__&url=TARGET_URL&format=markdown

   Important Notes:

   • Replace TARGET_URL with the URL you want to scrape (or use data from previous steps)
   • In Zapier, query parameters are included in the URL string (unlike Make/n8n)
   • You can use dynamic data from previous steps: &url={{1.URL}}
   Sign up for free to get your API key.
   Tip: Using Dynamic Data

   To scrape URLs from previous steps:

   • Click in the URL field to open data picker
   • Select the URL field from your trigger (e.g., Google Sheets column)
   • Zapier will insert it as: {{1.URL}} or similar
   • Full URL example: https://api.scrapfly.io/scrape?key=__API_KEY__&url={{1.URL}}&format=markdown
3. Process Scrapfly Response

   Extract and process the scraped content using Zapier's data transformation tools:

   • Direct Field Mapping Simple Easy
   • Formatter by Zapier Advanced Intermediate
   • Code by Zapier Most Flexible Advanced
   1. The Webhooks action automatically parses the JSON response
   2. In your next action (Google Sheets, Airtable, etc.), map fields directly:

   • Content: Use data from Webhooks: Result Content
   • URL: Use data from Webhooks: Result URL
   • Status: Use data from Webhooks: Result Status

   For more complex data processing:

   1. Add a "Formatter by Zapier" action after Webhooks
   2. Choose transformation type:
   • Text: Extract, replace, split, or format text
   • Numbers: Perform calculations or format numbers
   • Date/Time: Format timestamps
   3. Map the formatted output to your destination app

   // Example: Extract specific data using Python or JavaScript
   // Add "Code by Zapier" action for custom processing
   
   // JavaScript example:
   const content = inputData.result.content;
   const lines = content.split("\n");
   const title = lines[0]; // First line as title
   const body = lines.slice(1).join("\n"); // Rest as body
   
   return {
     title: title,
     body: body,
     scrapedAt: new Date().toISOString()
   };

   Pro Tip: Use "Formatter by Zapier" for simple text operations, and "Code by Zapier" for complex JSON parsing or custom logic!
4. Add Output Action

   Send the scraped data to your desired destination using Zapier's extensive app integrations:

   Popular Output Apps:

   • Google Sheets: Create or update rows in a spreadsheet
   • Airtable: Create or update records in a base
   • Slack: Send channel messages or DMs with data
   • Email by Zapier: Send formatted reports or alerts
   • Webhooks by Zapier: POST to your custom API
   • Google Drive: Create documents or save files
   • Notion: Create pages or database entries
   • Trello: Create cards with scraped data
   Example: Save to Google Sheets

   Add a Google Sheets action with these settings:

   • Action Event: Create Spreadsheet Row
   • Spreadsheet: Select or create your spreadsheet
   • Worksheet: Select the sheet name
   • Column Mapping:
   • URL: Insert data from Webhooks → Result URL
   • Content: Insert data from Webhooks → Result Content
   • Timestamp: Insert data from Date/Time → Now
5. Test and Publish Zap

   Test your Zap and publish it for production use:

   1. Click "Test & Continue" on each step to verify configuration
   2. Review the output data from the Webhooks action
   3. Check for errors (red indicators) on any step
   4. Once all steps test successfully, click "Publish"
   5. Monitor Zap runs in the "Zap History" tab
   Tip: Error Handling with Paths

   Add error handling to your Zap using Paths:

   • After the Webhooks action, add a "Paths by Zapier" action
   • Create two paths:
   • Success path: Rule: Result Status equals 200
   • Error path: Rule: Result Status does not equal 200
   • On the error path, add notification actions (Email, Slack, etc.)
   • On the success path, add your normal data processing actions

Example Zap Templates

Troubleshooting

Alternative Automation Platforms

While Zapier offers simplicity and the largest app ecosystem, you might also want to explore these no-code automation alternatives for Scrapfly integration:

Next Steps

• Explore available MCP tools and their capabilities
• See real-world examples of what you can build
• Learn about authentication methods in detail
• Read the FAQ for common questions