NodeJS Knowledgebase

NodeJS is a powerful JavaScript server runtime that allows developers to use javascript to create variety of programs. As Javascript is a big language in data and web development NodeJS carries a lot of libraries and tools that can be used for web scraping and general data programming.

NodeJS is particularly useful for web scraping because of its non-blocking I/O model, which allows for efficient handling of multiple requests. The NPM (Node Package Manager) ecosystem provides a wide range of libraries and tools specifically designed for web scraping, such as Puppeteer, Cheerio, and Axios.

Web Scraping With NodeJS and Javascript

In this article we'll take a look at scraping using Javascript through NodeJS. We'll cover common web scraping libraries, frequently encountered challenges and wrap everything up by scraping etsy.com

See below for more on NodeJS in the context web scraping and data programming 👇

How to take screenshots in NodeJS?

Learn how to screenshot in Node.js using Playwright & Puppeteer. Includes installation, concepts, and customization tips.

How to use proxies with NodeJS axios?

To use proxies with axios and nodejs the proxy parameter of get and post methods can be used. Here's how.

#nodejs

#http

How to find HTML elements by text with Cheerio and NodeJS?

To find HTML elements by text in NodeJS we can use cheerio library and special ":contains()" selectors. Here's how to do it.

#nodejs

How to use CSS selectors in NodeJS when web scraping?

There are many ways to execute CSS selectors on HTML text in NodeJS but cheerio and osmosis libraries are the most popular ones. Here's how to use them.

#nodejs

#data-parsing

#css-selectors

How to use XPath selectors in NodeJS when web scraping?

To parse HTML using XPath in Nodejs we can use one of two popular libraries like osmosis or xmldom. Here's how.

#nodejs

#xpath

#data-parsing

Articles Related to NodeJS

How to Capture and Convert a Screenshot to PDF

Quick guide on how to effectively capture web screenshots as PDF documents

SCREENSHOTS

PYTHON

NODEJS

How to Capture and Convert a Screenshot to PDF

Playwright Examples for Web Scraping and Automation

Learn Playwright with Python and JavaScript examples for automating browsers like Chromium, WebKit, and Firefox.

PLAYWRIGHT

PYTHON

NODEJS

Playwright Examples for Web Scraping and Automation

Web Scraping with Playwright and JavaScript

Learn about Playwright - a browser automation toolkit for server side Javascript like NodeJS, Deno or Bun.

PLAYWRIGHT

HEADLESS-BROWSER

NODEJS

Web Scraping with Playwright and JavaScript

Guide to Axios Headers

Learn about Javascript's Axios headers. How to configure, update, inspect headers in request and responses, how to set defaults and useful tips

HTTP

NODEJS

Axios vs Fetch: Which HTTP Client to Choose in JS?

Explore the differences between Fetch and Axios - two essential HTTP clients in JavaScript - and discover which is best suited for your project.

HTTP

NODEJS

API

Axios vs Fetch: Which HTTP Client to Choose in JS?

Concurrency vs Parallelism

Learn the key differences between Concurrency and Parallelism and how to leverage them in Python and JavaScript to optimize performance in various computational tasks.

SCALING

NODEJS

PYTHON

How to Scrape Forms

Learn how to scrape forms through a step-by-step guide using HTTP clients and headless browsers.

How to Scrape With Headless Firefox

Discover how to use headless Firefox with Selenium, Playwright, and Puppeteer for web scraping, including practical examples for each library.

How to use Headless Chrome Extensions for Web Scraping

In this article, we'll explore different useful Chrome extensions for web scraping. We'll also explain how to install Chrome extensions with various headless browser libraries, such as Selenium, Playwright and Puppeteer.

How to Scrape Sitemaps to Discover Scraping Targets

Usually to find scrape targets we look at site search or category pages but there's a better way - sitemaps! In this tutorial, we'll be taking a look at how to find and scrape sitemaps for target locations.

Web Scraping With Node-Unblocker

Tutorial on using Node-Unblocker - a nodejs library - to avoid blocking while web scraping and using it to optimize web scraping stacks.

NODEJS

PROXIES

BLOCKING

Web Scraping With NodeJS and Javascript

In this article we'll take a look at scraping using Javascript through NodeJS. We'll cover common web scraping libraries, frequently encountered challenges and wrap everything up by scraping etsy.com

How to Web Scrape with Puppeteer and NodeJS in 2025

Introduction to using Puppeteer in Nodejs for web scraping dynamic web pages and web apps. Tips and tricks, best practices and example project.