Web Scraping For Beginners Series
NodeJS Introduction
How To Minimize Web Scraping Costs With Node.js
In this guide, we will dive into various approaches for minimizing web scraping costs with Node.js.
Extracting & Parsing Data
How to Download Images with NodeJS
In this guide, we will dive into various approaches for downloading images using NodeJS and provide detailed steps and examples for each method.
Proxies, User-Agents & Avoiding Bans
NodeJs Fake User-Agents - How to Manage User Agents When Scraping
In this guide we show you how to create and manage fake user agents when scraping in NodeJs so you don't get blocked.
NodeJs Proxy Rotation - How to Use & Rotate Proxies
Learn proxy use in Node-Fetch, Got, Request-Promise, Axios & SuperAgent. Rotate proxies, use gateways & scrape APIs with Node.js
Got, Fetch, Axios, SuperAgent - Retry Failed Requests
Guide to setting up retries for failed requests using Got, Node Fetch, Axios, SuperAgent & Request-Promise to build a more reliable NodeJS system.
Node-Fetch, Axios, SuperAgent, Got, Request-Promise - Make Concurrent Requests
Learn to configure Node-Fetch, Axios, SuperAgent, Request-Promise & Got to make concurrent requests and boost the speed of your scrapers.
Node Unblocker - Build Your Own Proxy Server
Node Unblocker is an open source library that allows you to easily build and deploy your own proxy server as a VPN or for web scraping.
How To Solve CAPTCHAs with NodeJS
In this guide, we will explore various strategies and techniques for efficiently bypassing CAPTCHA challenges with NodeJS.
How To Bypass Anti-Bots With NodeJS
This guide will outline various methods for bypassing anti-bot measures during web scraping using NodeJS.
Best NodeJS Stealth & Bypassing Solutions
This guide will explore various strategies that can be used to bypass such defenses using NodeJS.
Navigation & Logging In
How to Scroll a Page with NodeJS
In this article, we'll walk through the scrolling techniques using Puppeteer and Playwright.
How To Submit a Form With NodeJS
In this guide, we will dive into various approaches for submitting forms using NodeJS and provide detailed steps and examples for each method.
NodeJS Headless Browsers
The Best Node.js Headless Browsers for Web Scraping
In this guide, we will cover the top Node.js headless browsers used for web scraping today, explaining their key features and providing code examples.
The NodeJS Puppeteer Guide
In this guide, we show you how to use Puppeteer, a Node.js library that offers a high-level, user-friendly API for automating tasks and interacting with dynamic web pages.
The NodeJS Playwright Guide
In this guide, we’ll introduce you to the fundamental functionality of Node.js Playwright and how to use it in your own projects.
HTML Parsing Libraries
The 5 Best NodeJs HTML Parsing Libraries Compared
We compare the 5 best NodeJs HTML parsing libraries available in 2023 - Cheerio, JSDOM, Parse5, htmlparser2, and xml2js.
CheerioJS Guide - Scraping HTML Pages With NodeJs
In this guide, we walk through how to extract valuable data from HTML pages effortlessly, leveraging the robust capabilities of Cheerio for efficient data parsing and manipulation in NodeJS.
Send Post Requests
Node.js (Got, SuperAgent, Axios & More) - How to Send POST Requests
Learn how to send POST requests with Node.js libraries: Got, SuperAgent, Node-Fetch, Axios, and Request Promise, including posting form data and JSON.