[Blog](https://scrapfly.io/blog) / [scrapeguide](https://scrapfly.io/blog/tag/scrapeguide) # \# scrapeguide 118 articles about scrapeguide [All](https://scrapfly.io/blog) [ai](https://scrapfly.io/blog/tag/ai) [anti-bot](https://scrapfly.io/blog/tag/anti-bot) [api](https://scrapfly.io/blog/tag/api) [beautifulsoup](https://scrapfly.io/blog/tag/beautifulsoup) [blocking](https://scrapfly.io/blog/tag/blocking) [cloud-browser](https://scrapfly.io/blog/tag/cloud-browser) [crawling](https://scrapfly.io/blog/tag/crawling) [css-selectors](https://scrapfly.io/blog/tag/css-selectors) [curl](https://scrapfly.io/blog/tag/curl) [data](https://scrapfly.io/blog/tag/data) [data-parsing](https://scrapfly.io/blog/tag/data-parsing) [debugging](https://scrapfly.io/blog/tag/debugging) [ecommerce](https://scrapfly.io/blog/tag/ecommerce) [elixir](https://scrapfly.io/blog/tag/elixir) [fashion](https://scrapfly.io/blog/tag/fashion) [frameworks](https://scrapfly.io/blog/tag/frameworks) [golang](https://scrapfly.io/blog/tag/golang) [graphql](https://scrapfly.io/blog/tag/graphql) [headless-browser](https://scrapfly.io/blog/tag/headless-browser) [hidden-api](https://scrapfly.io/blog/tag/hidden-api) [http](https://scrapfly.io/blog/tag/http) [httpx](https://scrapfly.io/blog/tag/httpx) [java](https://scrapfly.io/blog/tag/java) [javascript](https://scrapfly.io/blog/tag/javascript) [nodejs](https://scrapfly.io/blog/tag/nodejs) [parsel](https://scrapfly.io/blog/tag/parsel) [php](https://scrapfly.io/blog/tag/php) [playwright](https://scrapfly.io/blog/tag/playwright) [project](https://scrapfly.io/blog/tag/project) [proxies](https://scrapfly.io/blog/tag/proxies) [puppeteer](https://scrapfly.io/blog/tag/puppeteer) [python](https://scrapfly.io/blog/tag/python) [r](https://scrapfly.io/blog/tag/r) [real-estate](https://scrapfly.io/blog/tag/real-estate) [requests](https://scrapfly.io/blog/tag/requests) [ruby](https://scrapfly.io/blog/tag/ruby) [rust](https://scrapfly.io/blog/tag/rust) [scaling](https://scrapfly.io/blog/tag/scaling) [scrapeguide](https://scrapfly.io/blog/tag/scrapeguide) [scrapy](https://scrapfly.io/blog/tag/scrapy) [screenshots](https://scrapfly.io/blog/tag/screenshots) [selenium](https://scrapfly.io/blog/tag/selenium) [seo](https://scrapfly.io/blog/tag/seo) [tools](https://scrapfly.io/blog/tag/tools) [typescript](https://scrapfly.io/blog/tag/typescript) [web-scraping](https://scrapfly.io/blog/tag/web-scraping) [wget](https://scrapfly.io/blog/tag/wget) [xpath](https://scrapfly.io/blog/tag/xpath) ## // 118 results Search articles [ http python headless-browser ### 5 Best Scrapy Alternatives for Web Scraping in 2026 Five Scrapy alternatives by job: Crawlee for JS/TS crawlers, Playwright for browsers, Beautiful Soup with HTTPX for small jobs, Cr... Nov 09, 2026 22 min read ](https://scrapfly.io/blog/posts/best-scrapy-alternatives-for-web-scraping) [ python scrapeguide ### How to Scrape Expedia Flights and Hotels (2026) A repo-backed Python guide to scraping Expedia hotel and flight search results by capturing its GraphQL responses, with pagination... Oct 30, 2026 21 min read ](https://scrapfly.io/blog/posts/expedia-scraper) [ python blocking data-parsing ### How to Scrape LoopNet Commercial Real Estate Listings Scrape LoopNet search and listing pages with Python and Scrapfly's Unblocker: placards for search results, JSON-LD for property de... Oct 27, 2026 25 min read ](https://scrapfly.io/blog/posts/how-to-scrape-loopnet) [ python scrapeguide ### How to Scrape Shopify Stores for Products, Prices, and Variants Build a resilient Shopify storefront scraper around products.json, JSON-LD, response classification, and measured fallbacks. Oct 19, 2026 23 min read ](https://scrapfly.io/blog/posts/how-to-scrape-shopify-stores) [ python data-parsing scrapeguide ### How to Test a Web Scraper Before Production Build parser tests, HTML fixtures, live checks, and deployment gates that catch silent web scraper failures before they reach prod... Oct 16, 2026 24 min read ](https://scrapfly.io/blog/posts/how-to-test-web-scraper-before-production) [ python data-parsing hidden-api ### How to Scrape idealo: Product Offers, Prices, and Price History Scrape idealo product pages for the full merchant offer list, prices, and price history with Python and the Scrapfly Web Scraping ... Oct 16, 2026 24 min read ](https://scrapfly.io/blog/posts/how-to-scrape-idealo) [ python hidden-api scrapeguide ### How to Scrape Pinterest in 2026 Learn to scrape Pinterest pins, boards, profiles, and images with Python by starting a session, calling the hidden resource API, a... Oct 08, 2026 16 min read ](https://scrapfly.io/blog/posts/how-to-scrape-pinterest) [ python hidden-api scrapeguide ### How to Scrape Goodreads for Book Data, Ratings, and Reviews A practical guide to scraping Goodreads book pages, ratings, and review samples in Python, reading JSON-LD and the embedded Nex... Sep 29, 2026 26 min read ](https://scrapfly.io/blog/posts/how-to-scrape-goodreads) [ python scrapeguide ### How to Scrape News Articles from Any Website Learn how to scrape news articles from any website in Python, extracting headline, author, date, and body with Newspaper4k, discov... Sep 29, 2026 19 min read ](https://scrapfly.io/blog/posts/how-to-scrape-news-articles) [ python scrapeguide ### Top 4 (Twitter) X Scrapers on GitHub That Still Work in 2026 Four surviving X scraper repositories compared by coverage, account requirements, maintenance, and infrastructure burden, plus why... Sep 17, 2026 18 min read ](https://scrapfly.io/blog/posts/best-twitter-scrapers-github) [ python api scrapeguide ### 8 Best Financial Data APIs for Developers in 2026 Eight financial data APIs compared by workload, delivery method, history depth, entitlement, and what the licence actually lets yo... Sep 17, 2026 18 min read ](https://scrapfly.io/blog/posts/best-financial-data-apis) [ python api data-parsing ### 8 Best Social Media Data APIs for Developers in 2026 Compare eight official social media APIs across posts, video, communities, research, professional data, and federated networks. Sep 16, 2026 18 min read ](https://scrapfly.io/blog/posts/best-social-media-data-apis) 1 [2](https://scrapfly.io/blog/tag/scrapeguide?page=2) [3](https://scrapfly.io/blog/tag/scrapeguide?page=3) … [10](https://scrapfly.io/blog/tag/scrapeguide?page=10) [ ](https://scrapfly.io/blog/tag/scrapeguide?page=2) Page 1 of 10 · 118 articles ## Ready to scale your web scraping? Anti-bot bypass, browser rendering, and rotating proxies, all in one API. [Try Scrapfly for FREE](https://scrapfly.io/register)