Claude Desktop

Claude Desktop logo

Anthropic's official desktop application for Claude AI with native MCP support. Perfect for conversational AI automation and interactive web scraping workflows.

AI Assistant macOS Windows Official Website

Prerequisites

Before getting started, make sure you have the following:

Setup Instructions

Follow these steps to integrate Scrapfly MCP with Claude Desktop. The entire setup takes less than 5 minutes.

  1. Locate Your Configuration File

    Claude Desktop stores its configuration in a JSON file. Open the file for your operating system:

    macOS:

    Windows:

    Tip: How to Open Config File

    On macOS:

    • Open Finder and press ⌘ + Shift + G
    • Paste: ~/Library/Application Support/Claude/
    • Open claude_desktop_config.json with any text editor

    On Windows:

    • Press Win + R to open Run dialog
    • Type: %APPDATA%\Claude and press Enter
    • Open claude_desktop_config.json with Notepad or your preferred editor
  2. Choose Authentication Method

    Select your preferred authentication method:

    Add the following configuration to your claude_desktop_config.json file:

    How it works: On first connection, Claude Desktop will display an OAuth2 URL in the chat. Click it to authorize in your browser - happens once, then managed automatically. See project-scoped setup for team collaboration.

    Add the following configuration to your claude_desktop_config.json file:

    Sign up for free to get your API key.
  3. Restart Claude Desktop

    After saving the configuration file, completely quit and restart Claude Desktop to apply the changes.

    How to Properly Restart

    On macOS:

    • Right-click the Claude icon in the Dock and select "Quit"
    • Or press ⌘ + Q while Claude is active
    • Reopen Claude from Applications or Spotlight

    On Windows:

    • Right-click the Claude icon in the system tray and select "Quit"
    • Or close all Claude windows and exit from Task Manager if needed
    • Reopen Claude from Start Menu or Desktop shortcut
  4. Verify the Integration

    After restarting, check that the MCP tools are available:

    1. Look for the hammer icon (🔨) in the bottom right corner of the chat window
    2. Click the hammer icon to see available MCP tools - you should see Scrapfly tools listed
    3. Try a test prompt: "Can you scrape https://news.ycombinator.com and show me the top 5 posts?"
    Pro Tip: Claude will automatically call the scraping_instruction_enhanced tool first to get the required "pow" parameter before making scraping requests. You do not need to worry about this - it happens behind the scenes!

Example Prompts

Simple Page Scraping
Scrape HN and extract top 5 post titles
Structured Data
Scrape HN and create markdown table with title, URL, points, comments
Screenshot Capture
Take full-page screenshot of scrapfly.io
Multi-Page Workflow
Scrape HN first page, find top post, then scrape its comments

Troubleshooting

  • Ensure npx is available in your PATH
  • Check config file is valid JSON (use JSONLint)
  • Restart Claude Desktop completely
  • Check Claude Desktop logs for errors

macOS: ~/Library/Logs/Claude/

Windows: %APPDATA%\Claude\logs\

Look for errors related to MCP server connection or npx command execution.

  • Ensure your default browser is set correctly
  • Manually copy OAuth2 URL from Claude Desktop and paste in browser
  • Check that you're logged into Scrapfly in your browser
  • Fallback: use API key authentication

On macOS:

  • Open Finder and press ⌘ + Shift + G
  • Paste: ~/Library/Application Support/Claude/
  • Open claude_desktop_config.json with any text editor

On Windows:

  • Press Win + R to open Run dialog
  • Type: %APPDATA%\Claude and press Enter
  • Open claude_desktop_config.json with Notepad

Next Steps

Summary