"Error 1020: Access Denied" can be seen when web scraping websites powered by Cloudflare WAF. This means Cloudflare has blocked your scraper's IP address.
This error can be caused by a variety of reasons from web scraping too fast to using low-quality proxies. Cloudflare's anti-bot systems are using a variety of technologies to detect web scrapers, like:
So, to avoid this error, the scrapers needs to be fortified against Cloudflare's anti-scraping technologies which can be done by using proxies and better scraping pracitces and libraries.
For more on how Cloudflare is blocking web scrapers see our in-depth explanation blog.
In this article we'll take a look at a popular anti bot service Imperva Incapsula anti bot WAF. How does it detect web scrapers and bots and what can we do to prevent our scrapers from being detected?
In this article we'll take a look at a popular anti bot service Datadome Anti Bot firewall. How does it detect web scrapers and bots and what can we do to prevent our scrapers from being detected?
In this article we'll take a look at a popular anti bot service Akamai Bot Manager. How does it detect web scrapers and bots and what can we do to prevent our scrapers from being detected?
