What is Charles Proxy and How to Use it?
Learn about of the most popular web debugging proxies — Charles Proxy and what it's capable.
What are SOCKS5 proxies and how they compare to HTTP proxies?
SOCKS5 is the latest protocol version of SOCKS network routing protocol used in web proxies.
SOCKS5 is an extension of the SOCKS protocol that supports advanced networking technologies, such as the UDP protocol and IPv6. Though so do modern HTTP and HTTPS protocols.
In web scraping, proxy protocol doesn't have much of an impact though socks5 proxies tend to be more reliable compared to the HTTP counterpart. When choosing a proxy for your scraper it's important to consider client support as while SOCKS5 protocol is considered to be better it's harder to implement and not always available.
Provided by Scrapfly
This knowledgebase is provided by Scrapfly data APIs, check us out! 👇
- Web Scraping API - scrape without blocking, control cloud browsers, and more.
- Extraction API - AI and LLM for parsing data.
- Screenshot API - capture pages or elements with no blocks.
How to Use Tor For Web Scraping
In this article, we'll explain web scraping using Tor. For this, we'll use Tor as a proxy server to change the IP address randomly in either HTTP or SOCKS, as well as using it as a rotating proxy server.
Web Scraping with CloudProxy
One of the most common challenges encountered while web scraping is IP throttling and blocking. Learn about the CloudProxy tool, how to install it and how to use it for cloud-based web scraping.
How to Hide Your IP Address
In this article we'll be taking a look at several ways to hide IP addresses: proxies, tor networks, vpns and other techniques.