Scrapfly Blog
Tutorials, guides, and insights on web scraping, data extraction, and automation 268 articles
// Articles
12 posts
Proxy vs VPN: In-Depth Comparison
Explore the proxy vs vpn debate with insights on key differences, benefits, limitations and alternatives. Discover when to choose a proxy or VPN.
10 Ways to Automate Chrome Screenshots
Learn how to automate Chrome screenshots with Playwright, Selenium, Puppeteer, browser commands, extensions, and APIs fo...
Guide to LLM Training, Fine-Tuning, and RAG
Explore LLM training, fine-tuning, and RAG. Learn how to leverage pre-trained models for custom tasks and real-time know...
Guide to Understanding and Developing LLM Agents
Explore how LLM agents transform AI, from text generators into dynamic decision-makers with tools like LangChain for aut...
Guide to Google Jobs API and Alternatives
Explore Google Jobs API alternatives like structured data, web scraping, and third-party job APIs to integrate job listi...
What is Googlebot User Agent String?
Learn about Googlebot user agents, how to verify them, block unwanted crawlers, and optimize your site for better indexi...
How to Find All URLs on a Domain
Learn how to efficiently find all URLs on a domain using Python and web crawling. Guide on how to crawl entire domain to...
Alternatives to Cloudscraper to Bypass Cloudflare
Learn why Cloudscraper is outdated and explore modern alternatives for bypassing Cloudflare protections effectively and ...
How to Capture and Convert a Screenshot to PDF
Quick guide on how to effectively capture web screenshots as PDF documents
Playwright Examples for Web Scraping and Automation
Learn Playwright with Python and JavaScript examples for automating browsers like Chromium, WebKit, and Firefox.
Web Scraping with Playwright and JavaScript
Learn about Playwright - a browser automation toolkit for server side Javascript like NodeJS, Deno or Bun.
How to use wget in Python
Learn how to use wget in Python through subprocess calls and what are other options.
Ready to scale your web scraping?
Anti-bot bypass, browser rendering, and rotating proxies — all in one API.