[Blog](https://scrapfly.io/blog) / [python](https://scrapfly.io/blog/tag/python) / [How to Scrape Goibibo Hotel and Flight Prices](https://scrapfly.io/blog/posts/how-to-scrape-goibibo-hotel-and-flight-prices) # How to Scrape Goibibo Hotel and Flight Prices by [Mohab Yousry](https://scrapfly.io/blog/author/mohab-yousry-9396552a) Sep 11, 2026 18 min read [\#python](https://scrapfly.io/blog/tag/python) [\#scrapeguide](https://scrapfly.io/blog/tag/scrapeguide) [ ](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices "Share on LinkedIn") [ ](https://x.com/intent/tweet?url=https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices&text=How%20to%20Scrape%20Goibibo%20Hotel%20and%20Flight%20Prices "Share on X") [ ](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices "Share on Facebook") Summarize this article with [ ](https://chat.openai.com/?q=Summarize%20this%20article%20and%20explain%20how%20Scrapfly%20helps%20me%20scrape%20any%20website%20at%20scale%20and%20bypass%20anti-bot%20systems%20for%20my%20use%20case%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices) [ ](https://claude.ai/new?q=Summarize%20this%20article%20and%20explain%20how%20Scrapfly%20helps%20me%20scrape%20any%20website%20at%20scale%20and%20bypass%20anti-bot%20systems%20for%20my%20use%20case%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices) [ ](https://x.com/i/grok?text=Summarize%20this%20article%20and%20explain%20how%20Scrapfly%20helps%20me%20scrape%20any%20website%20at%20scale%20and%20bypass%20anti-bot%20systems%20for%20my%20use%20case%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices) [ ](https://www.perplexity.ai/search/new?q=Summarize%20this%20article%20and%20explain%20how%20Scrapfly%20helps%20me%20scrape%20any%20website%20at%20scale%20and%20bypass%20anti-bot%20systems%20for%20my%20use%20case%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices) [ ](https://www.google.com/search?udm=50&aep=11&q=Summarize%20this%20article%20and%20explain%20how%20Scrapfly%20helps%20me%20scrape%20any%20website%20at%20scale%20and%20bypass%20anti-bot%20systems%20for%20my%20use%20case%3A%20https%3A%2F%2Fscrapfly.io%2Fblog%2Fposts%2Fhow-to-scrape-goibibo-hotel-and-flight-prices) Goibibo's page routes can return HTTP 200 without returning search data. From a non-India exit, the homepage and hotel route both returned the same regional availability shell. The scraper below uses an India browser session to capture the internal hotel or flight response behind Goibibo's Akamai edge. This guide covers where Goibibo's hotel and flight data lives and how to carry a validated Akamai session into the request that retrieves it. [How to Scrape TripAdvisor.com (2026 Updated)In this scrape guide, we'll be scraping TripAdvisor.com. We'll take a look how to find hotels and other places using the search system and how to scrape hotel reviews, pricing details and other TripAdvisor data.](https://scrapfly.io/blog/posts/how-to-scrape-tripadvisor) [**Latest Goibibo Scraper Code**github.com/scrapfly/scrapfly-scrapers/goibibo-scraper](https://github.com/scrapfly/scrapfly-scrapers/tree/main/goibibo-scraper) ## Key Takeaways - **Akamai guards the search API.** No validated session means a 403. - **MakeMyTrip owns Goibibo.** Both run on the same Akamai backend. - **Akamai scopes cookies per domain.** A flight redirect starts a fresh session. - **One selector captures the listing API.** The flight stream needs a `js_scenario`. - **ASP plus a named `session=`.** Clear Akamai once, then reuse it for pagination. - **Set `country="in"` for INR prices.** Confirmed live for hotels and flights. - **The official `goibibo-scraper` covers both.** The repository includes hotel and flight implementations with committed result files. **Get web scraping tips in your inbox**Trusted by 100K+ developers and 30K+ enterprises. Unsubscribe anytime. ## Why Scrape Goibibo Hotel and Flight Data? You scrape Goibibo directly when you need OTA-specific hotel rates and flight fares for the India travel market. That means prices not filtered through an aggregator or delayed by a caching layer. The most common use cases are: - **Fare and rate monitoring.** Track hotel rates and flight prices at the values Goibibo shows right now. - **Competitive pricing.** Compare direct OTA rates across India booking platforms at scale. - **Route and availability tracking.** Monitor which routes have inventory and when fares shift as departure dates approach. - **Demand and seasonality research.** India travel pricing is event-driven. Scraping over time surfaces patterns a single API snapshot misses. - **Cross-product monitoring.** Compare hotel-rate and flight-fare movements for the same India travel window from one OTA. Goibibo published a developer API several years ago, but it is no longer openly available. Teams that need current data collect it from the public search interface instead, which means dealing with Akamai. An [AltexSoft Traveltech thread](https://www.altexsoft.com/techtalks/how-to-access-and-integrate-goibibo-api/) from 2018 still asks how to reach that API. Its one answer gives generic steps, not working credentials. This guide covers public hotel search and flight search results only. Loyalty flows, booking steps, and login-gated data are out of scope. For scraping the broader hotel OTA market alongside Goibibo, check the guide below. [How to Scrape Booking.com (2026 Update)Tutorial on how to scrape booking.com hotel and pricing data using Python. How to avoid blocking to web scrape data at scale and other tips.](https://scrapfly.io/blog/posts/how-to-scrape-bookingcom) Goibibo's public pages and internal search calls do not fail in the same way. ## Why Is Goibibo Hard to Scrape? Goibibo runs Akamai Bot Manager. A plain request loads the page shell, but the search and availability API rejects you with a 403 until you present a validated Akamai session. That asymmetry is the entire obstacle. A [thread on r/webscraping](https://www.reddit.com/r/webscraping/comments/1qofvmx/akamai_antibot_blocking_flight_search_scraping/) reports the same 403 and 418 pattern on Akamai-protected flight search. The initial page load mints temporary cookies. A follow-up request sends browser fingerprint and behavior telemetry, and only then does Akamai issue long-lived cookies. Skip the telemetry and the search API returns 403 every time. Check the response body as well as the status code. Goibibo can return HTTP 200 without returning hotel or flight data: python```python from curl_cffi import requests for url in ( "https://www.goibibo.com/", "https://www.goibibo.com/hotels/search/", ): response = requests.get(url, impersonate="chrome") title = response.text.partition("")[2].partition("")[0] regional_shell = "Temporarily unavailable for users in your region" in response.text print(response.status_code, len(response.content), regional_shell, title) ``` In our non-India check, both routes returned HTTP 200 with the same 8,538-byte regional availability shell. This test does not exercise the internal hotel listing API. Capture `clientbackend-gi/cg/listing/DESKTOP/` from an India browser session before documenting the API's live rejection status. Goibibo is served through Akamai: the response carries `Server: AkamaiNetStorage`, and `www.goibibo.com` resolves through `akamaiedge.net`. Check the response body as well as its status, because non-India requests can receive a regional availability shell with HTTP 200. Akamai is common in retail, airlines, and finance. The [Scrapfly Akamai bypass page](https://scrapfly.io/bypass/akamai) puts it on about 30 percent of Fortune 500 sites. ### Goibibo, MakeMyTrip, and the Shared Akamai Backend MakeMyTrip owns Goibibo (acquired via the ibibo Group in January 2017), and the two share a backend and Akamai deployment. Akamai issues `_abck` and `ak_bmsc` under `.goibibo.com` on goibibo.com, and under `.makemytrip.com` on makemytrip.com. The Goibibo flights flow can redirect onto makemytrip.com under some session conditions. A live scraper run from an India session stayed on goibibo.com throughout instead. Plan for two cookie jars regardless. A `.makemytrip.com` cookie is never sent to goibibo.com, so a cross-domain redirect forces Akamai to mint and validate a fresh `_abck` on the new host. This also answers two questions that come up regularly. Yes, MakeMyTrip owns Goibibo, and no, they are not the same site. They share enough backend that a Goibibo scraper must plan for cross-domain redirects on flight queries. Budget for a second Akamai session if one fires. ### Why Your Page Loads but the Search API Returns 403 The page load earns temporary Akamai cookies with low trust. The search API requires a validated session. That means Akamai has already seen a browser-consistent TLS fingerprint and behavior telemetry from that same session. A plain HTTP client never produces this browser telemetry, so the search API returns 403 on every attempt. The full mechanics are in the Akamai bypass guide rather than here, but the key points are: - The `_abck` cookie lifecycle and the sensor POST sequence must complete before the search API trusts the session. - A 403 and a 200 carrying an "Access Denied" or "Pardon Our Interruption" body are both rejections in Akamai's response model. The bypass guide covers how to tell a block page from a real result. - You cannot replay the XHR from DevTools in isolation. The session needs to start exactly as a real browser would. [How to Bypass Akamai when Web Scraping in 2026In this article we'll take a look at a popular anti bot service Akamai Bot Manager. How does it detect web scrapers and bots and what can we do to prevent our scrapers from being detected?](https://scrapfly.io/blog/posts/how-to-bypass-akamai-anti-scraping) The next step is to identify the internal calls that carry the hotel and flight results. ## Where Does Goibibo Hotel and Flight Data Live? Goibibo's hotel and flight results come from two internal calls the rendered page makes after boot. Hotels come from a listing API at `clientbackend-gi/cg/listing/DESKTOP/`. Flights come from a server-sent-events stream at `search-stream-dt`. Don't replay either call by hand. Reverse engineering and replaying those calls directly would mean reproducing Akamai's full session state on every request. The working approach instead lets a real browser make the call for you, then reads the response straight back out. Scrapfly's `wait_for_selector` parameter accepts an `xhr:` prefix that pauses the scrape until a matching network request completes. The response then includes that captured call in `browser_data.xhr_call`. Point it at the listing path and Scrapfly hands back the exact JSON body the page itself received. The flight stream needs a `js_scenario` that dismisses the interstitial CTA first. The same `browser_data.xhr_call` array then holds the `search-stream-dt` event body. Here's what locating the listing call looks like once the page has rendered: python```python import json # `page` is the ScrapeApiResponse returned by the SCRAPFLY.scrape() call in the next section LISTING_API = "clientbackend-gi/cg/listing/DESKTOP/" calls = [ call for call in page.scrape_result["browser_data"]["xhr_call"] if LISTING_API in call["url"] and (call.get("response") or {}).get("body") ] data = json.loads(calls[-1]["response"]["body"])["response"] ``` This pulls the same structured JSON the Goibibo frontend renders from, without you rebuilding the request or its headers. The flight search reads from the same captured-call array, against a gzip-compressed, base64-encoded event stream instead of a plain JSON body. Install the Scrapfly SDK before running the capture code. ## Project Setup The code below uses the [scrapfly-sdk](https://pypi.org/project/scrapfly-sdk/) Python package to call the Scrapfly Web Scraping API. bash```bash pip install "scrapfly-sdk[all]" ``` Set your Scrapfly API key as the `SCRAPFLY_KEY` environment variable before running any of the code that follows. The first rendered request captures Goibibo's listing response and stores its session state. ## How to Scrape Goibibo with Scrapfly Let ASP solve the Akamai challenge. Then reuse a single named session so the validated cookies and exit IP carry from the initial render into every paginated request. That session continuity pattern is the fix. ASP and Scrapfly sessions build exactly this handoff. Scrapfly signs the `sensor_data` payload under a real browser fingerprint, which mints the `_abck` cookie and keeps it valid across the session. The [Scrapfly Web Unblocker](https://scrapfly.io/products/unblocker) applies the same approach across Akamai, Cloudflare, DataDome, and PerimeterX. Scrapfly's Akamai bypass page publishes a 97% success rate on Akamai-protected targets. The official `goibibo-scraper` implements both flows. Its committed examples contain 48 Delhi hotel records and 101 Delhi-to-Mumbai flight records. Use the Cloud Browser fallback covered below when a single-fetch pattern is not enough for a given search flow. ### Bootstrapping a Validated Akamai Session with ASP and Sessions The first request does two things at once. It clears Akamai's challenge and captures the listing data. Scrapfly waits for the browser to fire the listing API call, then hands back that response. The linked official scraper reuses the same named session for each listing API POST. The shortened block below captures only the first hotel response. python```python import json from datetime import date, timedelta from uuid import uuid4 from scrapfly import ScrapeConfig, ScrapflyClient SCRAPFLY = ScrapflyClient(key="YOUR_SCRAPFLY_KEY") LISTING_API = "clientbackend-gi/cg/listing/DESKTOP/" session = uuid4().hex checkin = (date.today() + timedelta(days=1)).isoformat() checkout = (date.today() + timedelta(days=7)).isoformat() url = ( "https://www.goibibo.com/hotels/hotel-listing/" f"?checkin={checkin}&checkout={checkout}" "&roomString=1-2-0&searchText=Delhi&locusId=CTDEL&locusType=city" ) page = SCRAPFLY.scrape( ScrapeConfig( url, asp=True, country="IN", render_js=True, proxy_pool="public_residential_pool", rendering_wait=10000, wait_for_selector=f"xhr:{LISTING_API}", session=session, ) ) calls = [ call for call in page.scrape_result["browser_data"]["xhr_call"] if LISTING_API in call["url"] and (call.get("response") or {}).get("body") ] data = json.loads(calls[-1]["response"]["body"])["response"] ``` `wait_for_selector="xhr:..."` blocks the scrape until Goibibo's listing call fires. `session=` pins the resulting Akamai cookies, navigation history, and residential exit IP to that session name. Pagination also needs the captured API URL, request headers, POST body, and cursor. See `scrape_hotel_search()` in the linked repository for the follow-up request that reuses `session=` with `render_js=False`. ### Setting Country and Currency for India (INR) Prices Set `country="in"` to keep the proxy exit, locale, and currency consistent. A live run confirmed both hotel and flight prices return in INR with an India exit node active. Without it, you get USD pricing or a mismatched locale, making results unreliable for India-market analysis. Record country, locale, currency, and a UTC timestamp with every result you save. Goibibo prices shift with demand, season, and session locale. Without those metadata fields, a result from one run cannot be meaningfully compared to a result from a different session. Parse the captured listing response into flat hotel records. Scrapfly #### Scale your web scraping effortlessly Scrapfly handles proxies, browsers, and anti-bot bypass — so you can focus on data. [Try Free →](https://scrapfly.io/register)## How to Extract Goibibo Hotel and Flight Fields Once you have a validated listing response, parse each hotel card into a flat record. The listing JSON nests price, rating, and location under separate keys, so pull each field out individually: python```python def parse_hotels(data): hotels = [] for section in data.get("personalizedSections") or []: for item in section.get("hotels") or []: price = item.get("priceDetail") or {} review = item.get("reviewSummaryUgc") or {} location = item.get("locationDetail") or {} hotels.append({ "id": item.get("id"), "name": item.get("name"), "star_rating": item.get("starRating"), "city": location.get("name"), "price": price.get("discountedPrice", price.get("price")), "currency": data.get("currency"), "rating": review.get("hotelRating"), "review_count": review.get("reviewCount"), "amenities": item.get("facilityHighlights") or [], }) return hotels ``` The function walks every section in the listing response. For each hotel card it pulls the nested price, review, and location objects up into one flat dictionary. A live run against Delhi hotel search produced records like this one: json```json { "id": "201403191129397088", "name": "ibis New Delhi Aerocity - An Accor Brand", "star_rating": 4, "city": "Delhi", "price": 9370.0, "currency": "INR", "rating": 3.7, "review_count": 521, "amenities": ["Swimming Pool", "Gym", "Restaurant", "Indoor Games", "Room Service", "Lounge", "Bar"] } ``` The `parse_flights()` example below expects decoded JSON. The linked scraper's `scrape_flight_search()` captures `search-stream-dt`, while `parse_flight_stream_call()` base64-decodes and decompresses the SSE response before passing it to this parser. Each flight card links to an entry in `journeyMap` by key, so resolve that reference before reading the times and fare: python```python def parse_flights(data): flights = [] journey_map = data.get("journeyMap") or {} currency = ((data.get("meta") or {}).get("locale") or {}).get("currCode") for group in data.get("cardList") or []: for card in group: key = (card.get("journeyKeys") or [None])[0] journey = journey_map.get(key) or {} flights.append({ "flight_number": card.get("flightNumber"), "airline_name": (card.get("simpleAirlineHeading") or {}).get("nm"), "origin_code": journey.get("depCityCd"), "destination_code": journey.get("arrCityCd"), "departure_time": journey.get("depTime"), "stops": journey.get("stops"), "fare": card.get("fare"), "currency": currency, }) return flights ``` Both parsers return plain dicts you can write straight to a JSONL file or load into a dataframe for analysis. ### Goibibo Hotel Fields to Extract The table below covers the main fields the official scraper returns for each hotel result. | Field | Description | |---|---| | id | Goibibo's internal hotel identifier | | name | Property name as listed on Goibibo | | property\_type | Listing type, for example Hotel or Apartment | | star\_rating | Official star rating of the property | | area | Neighborhood or locality within the city | | city | City where the property sits | | price | Lowest discounted rate for the search dates | | price\_with\_tax | Lowest rate including taxes and fees | | currency | Currency of the returned price, INR for India sessions | | rating | Average guest rating | | review\_count | Total number of guest reviews | | amenities | Highlighted amenities for the property | | sold\_out | Whether the property has no rooms left for the search dates | | url | Deep link to the property's Goibibo listing page | ### Goibibo Flight Fields to Extract The table below covers the main fields the official scraper returns for each flight result. | Field | Description | |---|---| | flight\_number | Flight number, or numbers for a connecting itinerary | | airline\_name | Carrier name | | origin\_code | IATA code for the departure airport | | destination\_code | IATA code for the arrival airport | | departure\_time | Scheduled local departure time | | arrival\_time | Scheduled local arrival time | | duration | Total itinerary duration | | stops | Number of stops on the itinerary | | layover\_cities | IATA codes of any layover airports | | legs | Per-leg detail: flight number, airline, aircraft, and city and time pairs | | fare | Displayed fare for the itinerary | | currency | Currency of the returned fare, INR for India sessions | The Booking.com guide linked above covers a fully built extraction example over the same field categories. Compare it against how hotel field extraction works on a global OTA. Use Cloud Browser when the search requires form interaction instead of a known result URL. ## When to Use Scrapfly Cloud Browser for the Goibibo Search Flow A single fetch is not always enough. Sometimes you need to fill the search form, pick dates, and wait for results to render. Run a Scrapfly Cloud Browser session instead of a one-shot request for that. The single-fetch workflow with the Web Scraping API is simpler for a known search URL built from query parameters. Cloud Browser is the reliable path for the interactive, multi-step hotel or flight search flow on Goibibo. The date picker, the traveler count controls, and the results paginator all require real browser interactions that a single HTTP call cannot handle. The trade-offs are: - **Cost:** Web Scraping API bills per request and enabled features, while Cloud Browser bills active time and bandwidth. Compare both against the actual flow duration and transferred data. - **When to use it:** Reach for Cloud Browser when the single-fetch path fails on a specific search flow or when session dependent pagination makes a static URL unreliable. When you run a Cloud Browser session against Goibibo, set the proxy country to India in the WebSocket URL. That keeps the locale, prices, and currency consistent throughout the session. A US-exit Cloud Browser session pointed at goibibo.com returns USD pricing or a locale mismatch instead. python```python # Cloud Browser WebSocket URL with India residential proxy # Use this when driving the Goibibo search form interactively with Playwright BROWSER_WS = ( "wss://browser.scrapfly.io?api_key=YOUR_API_KEY" "&proxy_pool=residential&country=in&os=windows" "&target_url=https://www.goibibo.com/" ) ``` Pass this URL to Playwright's `connect_over_cdp` and your script drives a Scrapfly-managed browser instead of a local one. The query string fixes the exit country, the proxy pool, and the fingerprint profile for the whole session. If a session stalls, enable debug recording and inspect the replay, network requests, and console output in the Scrapfly dashboard. Confirm that the target page loaded and each form action completed before debugging the parser. For full Cloud Browser setup, Playwright integration, and session parameter reference, see the [Cloud Browser getting started docs](https://scrapfly.io/docs/cloud-browser-api/getting-started). ## Running Goibibo Scrapers in Production Everything above depends on one thing, a browser session Akamai already trusts before your scraper calls the search API. ScrapFly's [Web Scraping API](https://scrapfly.io/products/web-scraping-api) combines the Unblocker, browser rendering, geo-targeted proxies, and sessions through one endpoint. - [Unblocker](https://scrapfly.io/docs/scrape-api/unblocker) - detects anti-bot vendors and tunes browser, proxy, header, and retry settings for the target. - [Smart proxy rotation](https://scrapfly.io/docs/scrape-api/proxy) - residential and datacenter pools with country and ASN level geo-targeting. - [JavaScript rendering](https://scrapfly.io/docs/scrape-api/javascript-rendering) - render SPAs and dynamic pages through real cloud browsers. - [Browser automation scenarios](https://scrapfly.io/docs/scrape-api/javascript-scenario) - scroll, click, fill forms, and wait for elements without managing a browser fleet. - [Format conversion](https://scrapfly.io/docs/scrape-api/getting-started#api_param_format) - return pages as HTML, JSON, clean text, or LLM ready Markdown. - [Session management](https://scrapfly.io/docs/scrape-api/session) - keep cookies, headers, and IPs consistent across multi step flows. - [Smart caching](https://scrapfly.io/docs/scrape-api/getting-started#api_param_cache) - cache successful responses to cut cost on repeat scraping jobs. - [Python](https://scrapfly.io/docs/sdk/python), [TypeScript](https://scrapfly.io/docs/sdk/typescript), [Scrapy](https://scrapfly.io/docs/sdk/scrapy), and [no-code integrations](https://scrapfly.io/docs/integration/getting-started) including [Make](https://scrapfly.io/integration/make), [n8n](https://scrapfly.io/integration/n8n), [Zapier](https://scrapfly.io/integration/zapier), [LangChain](https://scrapfly.io/integration/langchain), and [LlamaIndex](https://scrapfly.io/integration/llamaindex). For the Goibibo workflow above, ASP clears the Akamai challenge and `session=` keeps the cleared state alive across every paginated listing call. ### Web Scraping API Scrape any website with our powerful API. Anti-bot bypass, JavaScript rendering, and rotating proxies built-in. [Try Web Scraping API](https://scrapfly.io/docs/scrape-api/getting-started) ## FAQ Does Goibibo have a public API for hotel or flight data?Not a usable one. Goibibo's old developer/affiliate API is no longer available, so most teams collect public search data instead, which means dealing with Akamai. Is Goibibo owned by MakeMyTrip?Yes, via the ibibo Group in January 2017. They share a platform and an Akamai backend but not a cookie jar, and Goibibo flights can redirect onto makemytrip.com. Do I need India residential proxies to get INR Goibibo prices?An India exit (`country="in"`) helps you see INR and India-market offers, but it is not sufficient on its own. The request still needs a validated Akamai session (cookies, fingerprint, and IP all coherent) or the search API returns 403. Can BeautifulSoup scrape Goibibo hotel rates?[BeautifulSoup](https://scrapfly.io/blog/posts/web-scraping-with-python-beautifulsoup) can parse the HTML once you have it, but it cannot get past Akamai on its own. You need a validated session first, then parse the response. Is scraping Goibibo legal?Scraping publicly available data is generally permissible, but Goibibo's terms of service, rate limits, and local law still apply. Keep request rates reasonable, avoid login-gated or personal data, and see the disclaimer below. ## Summary Scraping Goibibo is a session-validation problem, not a headers problem. The page loads. The listing and flight search APIs need a validated Akamai session before they deliver anything useful. The workflow this guide covers: 1. Identify where the data lives: the internal listing API for hotels, the search-stream API for flights. 2. Establish a validated Akamai session with Scrapfly ASP and `render_js=True`, capturing the listing call with `wait_for_selector="xhr:..."`. 3. Reuse that session for paginated and follow-up requests with `session=` continuity. 4. Set `country="in"` for INR prices and India-market offers. The official `goibibo-scraper` implements that sequence for hotels and flights. Clone it, supply current search dates and routes, and run its live tests against your Scrapfly project before relying on the output. Legal Disclaimer and PrecautionsThis tutorial covers popular web scraping techniques for education. Interacting with public servers requires diligence and respect: - Do not scrape at rates that could damage the website. - Do not scrape data that's not available publicly. - Do not store PII of EU citizens protected by GDPR. - Do not repurpose *entire* public datasets which can be illegal in some countries. Scrapfly does not offer legal advice but these are good general rules to follow. For more you should consult a lawyer. [ Add as a preferred source ](https://google.com/preferences/source?q=scrapfly.io) Table of Contents Table of Contents- [Key Takeaways](#key-takeaways) - [Why Scrape Goibibo Hotel and Flight Data?](#why-scrape-goibibo-hotel-and-flight-data) - [Why Is Goibibo Hard to Scrape?](#why-is-goibibo-hard-to-scrape) - [Goibibo, MakeMyTrip, and the Shared Akamai Backend](#goibibo-makemytrip-and-the-shared-akamai-backend) - [Why Your Page Loads but the Search API Returns 403](#why-your-page-loads-but-the-search-api-returns-403) - [Where Does Goibibo Hotel and Flight Data Live?](#where-does-goibibo-hotel-and-flight-data-live) - [Project Setup](#project-setup) - [How to Scrape Goibibo with Scrapfly](#how-to-scrape-goibibo-with-scrapfly) - [Bootstrapping a Validated Akamai Session with ASP and Sessions](#bootstrapping-a-validated-akamai-session-with-asp-and-sessions) - [Setting Country and Currency for India (INR) Prices](#setting-country-and-currency-for-india-inr-prices) - [How to Extract Goibibo Hotel and Flight Fields](#how-to-extract-goibibo-hotel-and-flight-fields) - [Goibibo Hotel Fields to Extract](#goibibo-hotel-fields-to-extract) - [Goibibo Flight Fields to Extract](#goibibo-flight-fields-to-extract) - [When to Use Scrapfly Cloud Browser for the Goibibo Search Flow](#when-to-use-scrapfly-cloud-browser-for-the-goibibo-search-flow) - [Running Goibibo Scrapers in Production](#running-goibibo-scrapers-in-production) - [FAQ](#faq) - [Summary](#summary) Join the Newsletter Get monthly web scraping insights Scale Your Web Scraping Anti-bot bypass, browser rendering, and rotating proxies, all in one API. Start with 1,000 free credits. No credit card required 1,000 free API credits Anti-bot bypass included [Start Free](https://scrapfly.io/register) [View Docs](https://scrapfly.io/docs/onboarding) Not ready? Get our newsletter instead. ## Related Articles [ ### How to Bypass Akamai when Web Scraping in 2026 In this article we'll take a look at a popular anti bot service Akamai Bot Manager. How does it detect web scrapers and ... ](https://scrapfly.io/blog/posts/how-to-bypass-akamai-anti-scraping) [ http python ### How to Fix 403 Forbidden Errors When Web Scraping Learn why web scrapers get 403 Forbidden errors and how to fix them with 7 Python solutions, from headers to TLS fingerp... ](https://scrapfly.io/blog/posts/403-forbidden-web-scraping) [ python scrapeguide ### How to Scrape Marriott Hotel Prices and Availability Learn how to scrape Marriott hotel prices and room availability with Python in 2026, including search inputs, the JSON b... ](https://scrapfly.io/blog/posts/how-to-scrape-marriott) ## Related Questions - [ Q How to capture background requests and responses in Playwright? ](https://scrapfly.io/blog/answers/how-to-capture-xhr-requests-playwright) - [ Q How to capture background requests and responses in Puppeteer? ](https://scrapfly.io/blog/answers/how-to-capture-xhr-requests-puppeteer) Scale your web scraping effortlessly, **1,000 free credits** [Start Free](https://scrapfly.io/register)