[Blog](https://scrapfly.io/blog) / [ai](https://scrapfly.io/blog/tag/ai) # \# ai 27 articles about ai [All](https://scrapfly.io/blog) [ai](https://scrapfly.io/blog/tag/ai) [anti-bot](https://scrapfly.io/blog/tag/anti-bot) [api](https://scrapfly.io/blog/tag/api) [automation](https://scrapfly.io/blog/tag/automation) [beautifulsoup](https://scrapfly.io/blog/tag/beautifulsoup) [blocking](https://scrapfly.io/blog/tag/blocking) [cloud-browser](https://scrapfly.io/blog/tag/cloud-browser) [crawling](https://scrapfly.io/blog/tag/crawling) [css-selectors](https://scrapfly.io/blog/tag/css-selectors) [curl](https://scrapfly.io/blog/tag/curl) [data-parsing](https://scrapfly.io/blog/tag/data-parsing) [ecommerce](https://scrapfly.io/blog/tag/ecommerce) [fashion](https://scrapfly.io/blog/tag/fashion) [frameworks](https://scrapfly.io/blog/tag/frameworks) [golang](https://scrapfly.io/blog/tag/golang) [graphql](https://scrapfly.io/blog/tag/graphql) [headless-browser](https://scrapfly.io/blog/tag/headless-browser) [hidden-api](https://scrapfly.io/blog/tag/hidden-api) [http](https://scrapfly.io/blog/tag/http) [httpx](https://scrapfly.io/blog/tag/httpx) [java](https://scrapfly.io/blog/tag/java) [javascript](https://scrapfly.io/blog/tag/javascript) [jupyter](https://scrapfly.io/blog/tag/jupyter) [nodejs](https://scrapfly.io/blog/tag/nodejs) [parsel](https://scrapfly.io/blog/tag/parsel) [php](https://scrapfly.io/blog/tag/php) [playwright](https://scrapfly.io/blog/tag/playwright) [project](https://scrapfly.io/blog/tag/project) [proxies](https://scrapfly.io/blog/tag/proxies) [puppeteer](https://scrapfly.io/blog/tag/puppeteer) [python](https://scrapfly.io/blog/tag/python) [r](https://scrapfly.io/blog/tag/r) [real-estate](https://scrapfly.io/blog/tag/real-estate) [requests](https://scrapfly.io/blog/tag/requests) [ruby](https://scrapfly.io/blog/tag/ruby) [scaling](https://scrapfly.io/blog/tag/scaling) [scrapeguide](https://scrapfly.io/blog/tag/scrapeguide) [scrapy](https://scrapfly.io/blog/tag/scrapy) [screenshots](https://scrapfly.io/blog/tag/screenshots) [selenium](https://scrapfly.io/blog/tag/selenium) [seo](https://scrapfly.io/blog/tag/seo) [tools](https://scrapfly.io/blog/tag/tools) [typescript](https://scrapfly.io/blog/tag/typescript) [web-scraping](https://scrapfly.io/blog/tag/web-scraping) [xpath](https://scrapfly.io/blog/tag/xpath) ## // 27 results Search articles [ python ai hidden-api ### How to Scrape Perplexity AI in 2026 Scrape Perplexity AI with Python: render JS, bypass Cloudflare, capture answers + cited domains, and build a citation tracker. Jul 07, 2026 19 min read ](https://scrapfly.io/blog/posts/how-to-scrape-perplexity) [ blocking api ai ### Web Scraping with Hermes Agent Hermes Agent ships with Firecrawl and Scrapling, but they break on protected sites. Add Scrapfly as a cloud fetch layer to scrape ... Jul 07, 2026 14 min read ](https://scrapfly.io/blog/posts/web-scraping-with-hermes-agent) [ python api ai ### Web Scraping for AI Agents in 2026 How AI agents consume the web, why their fetch layer breaks, and how to build agent-grade web access that holds up in production. Jun 23, 2026 23 min read ](https://scrapfly.io/blog/posts/ai-agent-web-scraping) [ python api ai ### Best AI Web Scraping Tools for LLM and RAG Pipelines in 2026 A by-job ranking of the best AI web scraping tools for 2026, from prompt-based extraction to MCP servers and open-source crawlers ... Jun 23, 2026 17 min read ](https://scrapfly.io/blog/posts/best-tools-for-ai-webscraping) [ python ai ### How to Scrape ChatGPT Responses in 2026 Scrape ChatGPT responses with Python: when to pick the OpenAI API, how to handle Cloudflare and streaming responses, and an authen... Jun 16, 2026 20 min read ](https://scrapfly.io/blog/posts/how-to-scrape-chatgpt) [ python ai ### How to Build a Web Scraping Agent with Claude Learn how to build a reliable web scraping agent with Claude. Covers Claude Code skills, the Anthropic API, autonomous agent mode,... Jun 16, 2026 21 min read ](https://scrapfly.io/blog/posts/how-to-build-a-web-scraping-agent-with-claude) [ python api ai ### How to Build a Web Scraping Agent with Gemini Build a Gemini web scraping agent that works on real sites. Covers Gemini CLI skills, URL Context limits, Python pipelines, and an... Jun 16, 2026 21 min read ](https://scrapfly.io/blog/posts/gemini-for-webscraping) [ python headless-browser ai ### How to Create an AI Browser Agent for Free Build two free AI browser agents using Browser-Use (Python) and Stagehand (TypeScript) with step-by-step code examples and Google ... Feb 18, 2026 8 min read ](https://scrapfly.io/blog/posts/how-to-create-an-ai-browser-agent-for-free) [ api headless-browser ai ### 7 Best Cloud Browser APIs for Web Scraping in 2026 Compare the best cloud and headless browser APIs for web scraping in 2026, from managed stealth browsers to self-hosted open-sourc... Feb 02, 2026 15 min read ](https://scrapfly.io/blog/posts/best-cloud-browser-apis) [ ai tools cloud-browser ### What Is Browser as a Service? Cloud-hosted browser infrastructure accessible via API for scalable web automation, scraping, and AI agents with managed fingerpri... Feb 02, 2026 13 min read ](https://scrapfly.io/blog/posts/what-is-a-browser-as-a-service) [ python ai crawling ### Build a Documentation Chatbot That Works on ANY Website Build an AI chatbot from any docs site using Scrapfly Crawler API, LangChain, and Streamlit. Works on Cloudflare-protected sites. Dec 26, 2025 16 min read ](https://scrapfly.io/blog/posts/build-a-documentation-chatbot-that-works-on-any-website) [ api ai tools ### Scraper API vs Crawler API - When to Use Each for AI Scraper API for pages, Crawler API for domains. Learn when to use each Scrapfly API for AI training, RAG applications, and web scr... Dec 22, 2025 19 min read ](https://scrapfly.io/blog/posts/scraper-api-vs-crawler-api) 1 [2](https://scrapfly.io/blog/tag/ai?page=2) [3](https://scrapfly.io/blog/tag/ai?page=3) [ ](https://scrapfly.io/blog/tag/ai?page=2) Page 1 of 3 ยท 27 articles ## Ready to scale your web scraping? Anti-bot bypass, browser rendering, and rotating proxies, all in one API. [Try Scrapfly for FREE](https://scrapfly.io/register)