Articles

How to Bypass CAPTCHA While Web Scraping in 2024

Captchas can ruin web scrapers but we don't have to teach our robots how to solve them - we can just get around it all!

What are Honeypots and How to Avoid Them in Web Scraping

Introduction to web honeypots, their types and functions and how they are used to identify and block web scrapers and bots and how to avoid them.

How to Scrape Immowelt.de Real Estate Data

Immowelt.de is a major real estate website in Germany and it's suprisingly easy to scrape. In this tutorial, we'll be using Python and hidden web data scraping technique to scrape real estate property data.

How to Scrape Immoscout24.ch Real Estate Property Data

In this scrape guide tutorial we'll be taking a look at the biggest real estate marketplace in Switzerland - ImmoScout24.ch. We'll be using hidden web data scraping technique and explore private APIs.

How to Scrape Seloger.com - Real Estate Listing Data

Learn about seloger.com web scraping and how to avoid its blocking. You will also learn how to scrape real estate data from seloger.com.

How to Scrape Hidden APIs

In this tutorial we'll be taking a look at scraping hidden APIs which are becoming more and more common in modern dynamic websites - what's the best way to scrape them?

Web Scraping Emails using Python

In this tutorial we'll take a look at email scraping. How to crawl pages and extract email addresses using Python and what are some popular challenges.

How to Scrape Google Trends using Python

In this article we'll be taking a look at scraping Google Trends - what it is and how to scrape it? For this example, we'll dive into reverse engineering and scrape the secret Google Trends API.

Ultimate XPath Cheatsheet for HTML Parsing in Web Scraping

Ultimate companion for HTML parsing using XPath selectors. This cheatsheet contains all syntax explanations with interactive examples.