[Blog](https://scrapfly.io/blog) / [Hisham Medhat](https://scrapfly.io/blog/author/hisham) HM # @ Hisham Medhat 28 articles published [ai](https://scrapfly.io/blog/tag/ai) [anti-bot](https://scrapfly.io/blog/tag/anti-bot) [api](https://scrapfly.io/blog/tag/api) [beautifulsoup](https://scrapfly.io/blog/tag/beautifulsoup) [blocking](https://scrapfly.io/blog/tag/blocking) [cloud-browser](https://scrapfly.io/blog/tag/cloud-browser) [crawling](https://scrapfly.io/blog/tag/crawling) [css-selectors](https://scrapfly.io/blog/tag/css-selectors) [curl](https://scrapfly.io/blog/tag/curl) [data-parsing](https://scrapfly.io/blog/tag/data-parsing) [ecommerce](https://scrapfly.io/blog/tag/ecommerce) [fashion](https://scrapfly.io/blog/tag/fashion) [frameworks](https://scrapfly.io/blog/tag/frameworks) [golang](https://scrapfly.io/blog/tag/golang) [graphql](https://scrapfly.io/blog/tag/graphql) [headless-browser](https://scrapfly.io/blog/tag/headless-browser) [hidden-api](https://scrapfly.io/blog/tag/hidden-api) [http](https://scrapfly.io/blog/tag/http) [httpx](https://scrapfly.io/blog/tag/httpx) [java](https://scrapfly.io/blog/tag/java) [javascript](https://scrapfly.io/blog/tag/javascript) [jupyter](https://scrapfly.io/blog/tag/jupyter) [nodejs](https://scrapfly.io/blog/tag/nodejs) [parsel](https://scrapfly.io/blog/tag/parsel) [php](https://scrapfly.io/blog/tag/php) [playwright](https://scrapfly.io/blog/tag/playwright) [project](https://scrapfly.io/blog/tag/project) [proxies](https://scrapfly.io/blog/tag/proxies) [puppeteer](https://scrapfly.io/blog/tag/puppeteer) [python](https://scrapfly.io/blog/tag/python) [r](https://scrapfly.io/blog/tag/r) [real-estate](https://scrapfly.io/blog/tag/real-estate) [requests](https://scrapfly.io/blog/tag/requests) [ruby](https://scrapfly.io/blog/tag/ruby) [scaling](https://scrapfly.io/blog/tag/scaling) [scrapeguide](https://scrapfly.io/blog/tag/scrapeguide) [scrapy](https://scrapfly.io/blog/tag/scrapy) [screenshots](https://scrapfly.io/blog/tag/screenshots) [selenium](https://scrapfly.io/blog/tag/selenium) [seo](https://scrapfly.io/blog/tag/seo) [tools](https://scrapfly.io/blog/tag/tools) [typescript](https://scrapfly.io/blog/tag/typescript) [web-scraping](https://scrapfly.io/blog/tag/web-scraping) [xpath](https://scrapfly.io/blog/tag/xpath) ## // Articles by Hisham Medhat Search articles [ python headless-browser hidden-api ### How to Scrape Infinite Scroll, Load More & Paginated Pages Learn to scrape infinite scroll, load more, and paginated pages in 2026 by reverse-engineering the request first and using a brows... Jul 20, 2026 17 min read ](https://scrapfly.io/blog/posts/how-to-scrape-infinite-scroll-load-more-and-paginated-pages) [ ### Best AI Web Scraping Tools for LLM and RAG Pipelines in 2026 A by-job ranking of the best AI web scraping tools for 2026, from prompt-based extraction to MCP servers and open-source crawlers ... Jun 23, 2026 17 min read ](https://scrapfly.io/blog/posts/best-tools-for-ai-webscraping) [ blocking api ai ### Web Scraping with Hermes Agent Hermes Agent ships with Firecrawl and Scrapling, but they break on protected sites. Add Scrapfly as a cloud fetch layer to scrape ... Jul 07, 2026 14 min read ](https://scrapfly.io/blog/posts/web-scraping-with-hermes-agent) [ python api ai ### Web Scraping for AI Agents in 2026 How AI agents consume the web, why their fetch layer breaks, and how to build agent-grade web access that holds up in production. Jun 23, 2026 23 min read ](https://scrapfly.io/blog/posts/ai-agent-web-scraping) [ python blocking scrapeguide ### How to Bypass Anti-Bot Protection in 2026: All 8 Major Vendors Identify and bypass Cloudflare, DataDome, PerimeterX, Kasada, Akamai, Incapsula, F5, and AWS WAF with Python code examples and suc... Jun 11, 2026 18 min read ](https://scrapfly.io/blog/posts/how-to-bypass-anti-bot-protection) [ python api ai ### How to Build a Web Scraping Agent with Gemini Build a Gemini web scraping agent that works on real sites. Covers Gemini CLI skills, URL Context limits, Python pipelines, and an... Jun 16, 2026 21 min read ](https://scrapfly.io/blog/posts/gemini-for-webscraping) [ python ai hidden-api ### How to Scrape Perplexity AI in 2026 Scrape Perplexity AI with Python: render JS, bypass Cloudflare, capture answers + cited domains, and build a citation tracker. Jul 07, 2026 19 min read ](https://scrapfly.io/blog/posts/how-to-scrape-perplexity) [ python ecommerce project ### How to Build a Grocery Price Comparison Tool with Python Build a grocery price comparison tool that scrapes Walmart, Instacart, and Kroger prices by zip code, matches products, and finds ... Jun 23, 2026 19 min read ](https://scrapfly.io/blog/posts/how-to-build-a-grocery-price-comparison-tool-with-python) [ python ecommerce project ### How to Build a Product Scraper for Multiple Sites Learn how to scrape product data from multiple e-commerce sites, normalise it into a canonical schema, and match products across s... Jun 30, 2026 22 min read ](https://scrapfly.io/blog/posts/how-to-build-a-product-data-pipeline-from-multiple-ecommerce-sites) [ blocking proxies scrapeguide ### How to Avoid Proxy Detection in Web Scraping Learn what gets proxies flagged, how to pick a proxy type, and when to rotate vs hold a sticky session to avoid detection. Jun 30, 2026 16 min read ](https://scrapfly.io/blog/posts/how-to-avoid-proxy-detection) [ blocking ### How Anti-Bot Detection Works Discover how anti-bot systems work by assigning a 'trust score' to every request. This guide breaks down the 5 key detection layer... Jul 07, 2026 17 min read ](https://scrapfly.io/blog/posts/how-anti-bot-detection-works) [ headless-browser playwright ai ### Human-in-the-Loop (HITL) Cloud Browsers How Human-in-the-Loop cloud browsers hand a live session to a person for CAPTCHAs, MFA, or approvals, then let automation reconnec... Jul 20, 2026 12 min read ](https://scrapfly.io/blog/posts/human-in-the-loop-cloud-browsers) 1 [2](https://scrapfly.io/blog/author/hisham?page=2) [3](https://scrapfly.io/blog/author/hisham?page=3) [ ](https://scrapfly.io/blog/author/hisham?page=2) Page 1 of 3 ยท 28 articles