What is Charles Proxy and How to Use it?
Learn about of the most popular web debugging proxies — Charles Proxy and what it's capable.
When testing web scraping we might need to edit and experiment with cookie values in the browser to understand website's behavior.
Chrome developer tools come with cookie editing feature which can be accessed through Application -> Storage section:
To edit a cookie, click on the cookie name and change its value. Note that this approach only alters local cookies stored in your browser session. This section also allows to delete all cookies which can be useful when testing whether cookies are required for web scraping.
This knowledgebase is provided by Scrapfly data APIs, check us out! 👇
Learn about of the most popular web debugging proxies — Charles Proxy and what it's capable.
curl and wget are both popular terminal tools but often used for different tasks - let's take a look at the differences.
In this article, we'll explain web scraping using Tor. For this, we'll use Tor as a proxy server to change the IP address randomly in either HTTP or SOCKS, as well as using it as a rotating proxy server.
In this article we'll take a look at two popular tools: WhatWaf and Wafw00f which can identify what WAF service is used.