[Answers](https://scrapfly.io/blog)   /  [http](https://scrapfly.io/blog/tag/http)   /  [What is MITM and how is it used in web scraping?](https://scrapfly.io/blog/answers/what-is-mitm-proxy-and-how-is-it-used-web-scraping)   # What is MITM and how is it used in web scraping?

 by [Bernardas Alisauskas](https://scrapfly.io/blog/author/bernardas) Mar 17, 2023 1 min read [\#http](https://scrapfly.io/blog/tag/http) 

 [  ](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping "Share on LinkedIn")    

 

 

MITM proxy is a proxy server that sits between the client and the server and intercepts or modifies the traffic.

When it comes to web scraping MITM software can be used to inspect web traffic of web browsers and desktop or mobile applications. This information can be used to develop web scrapers that scrape hidden web APIs.

Most commonly MITM software is used in scraping APIs of mobile applications like iOS apps or Android apps. Using MITM public API endpoints can be reverse-engineered and called from web scrapers.

Here are some popular MITM programs used in web scraping:

- [httptoolkit](https://httptoolkit.com/) is known for ease of setup allowing to inspect traffic in single click.
- [mitmproxy](https://mitmproxy.org/) is powered by Python and is easily scriptable and extendible.
- [burpsuite](https://portswigger.net/burp) popular with web security professionals.
- [wireshark](https://www.wireshark.org/) powerful low-level features like byte-level packet editing.



 

   Table of Contents















 

   Join the Newsletter  Get monthly web scraping insights 

 

  



Scale Your Web Scraping

Anti-bot bypass, browser rendering, and rotating proxies, all in one API. Start with 1,000 free credits.

  No credit card required  1,000 free API credits  Anti-bot bypass included 

 [Start Free](https://scrapfly.io/register) [View Docs](https://scrapfly.io/docs/onboarding) 

 Not ready? Get our newsletter instead. 

 

## Explore this Article with AI

 [ ChatGPT ](https://chat.openai.com/?q=Summarize%20this%20page%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping) [ Gemini ](https://www.google.com/search?udm=50&aep=11&q=Summarize%20this%20page%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping) [ Grok ](https://x.com/i/grok?text=Summarize%20this%20page%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping) [ Perplexity ](https://www.perplexity.ai/search/new?q=Summarize%20this%20page%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping) [ Claude ](https://claude.ai/new?q=Summarize%20this%20page%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fanswers%2Fwhat-is-mitm-proxy-and-how-is-it-used-web-scraping) 



 ## Related Articles

 [  

 python data-parsing 

### Web Scraping Phone Numbers with Python

In this article we'll dive into phone number scraping. We'll explore an example object and cover common phone number scr...

 

 ](https://scrapfly.io/blog/posts/how-to-scrape-phone-numbers-with-python) [  

 blocking 

### What is CreepJS Browser Fingerprint and How to Bypass It

In this article, we will explore the inner workings of CreepJS, one of the prominent browser fingerprinting tools and ho...

 

 ](https://scrapfly.io/blog/posts/browser-fingerprinting-with-creepjs) [  

 http 

### What is HTTP 409 Error? (Conflict)

HTTP status code 409 generally means a conflict or mismatch with the server state. Learn why it happens and how to avoid...

 

 ](https://scrapfly.io/blog/posts/what-is-http-409-status-code-conflict) 

  ## Related Questions

- [ Q What are devtools and how they're used in web scraping? ](https://scrapfly.io/blog/answers/browser-developer-tools-in-web-scraping)
- [ Q How to install mitmproxy certificate on Chrome and Chromium? ](https://scrapfly.io/blog/answers/how-to-install-mitmproxy-certificate)
- [ Q What are scrapy middlewares and how to use them? ](https://scrapfly.io/blog/answers/what-are-scrapy-middlewares-and-how-to-use-them)
 
  



   



 Scale your web scraping effortlessly, **1,000 free credits** [Start Free](https://scrapfly.io/register)