Stay Up To Date
Get notified of the latest NodeJS Web Scraping news, guides, extensions, and spiders as soon as they are released. Also, suggest new guides and extensions for the NodeJS Web Scraping Playbook then signup here.
Request-Promise
NodeJs Request-Promise: How to Use & Rotate Proxies
In this guide, we walk through how to use proxies with Nodejs Request-Promise. Including how to rotate proxies in a list, use proxy gateways, and proxy APIs with our Nodejs Request-Promise scraper.
NodeJs Request Promise: How to Send POST Requests
In this guide, we walk through how to send POST requests with NodeJs Request Promise. Including how to POST form data and JSON data.
NodeJs Request Promise: Setting Fake User-Agents
In this guide, we walk through how to use fake user-agents with NodeJs Request Promise to avoid your scrapers from getting blocked.
Axios
NodeJs Axios: Make Concurrent Requests
In this guide, we walk through how to configure NodeJs Axios to make concurrent requests so that you can increase the speed of your scrapers.
NodeJs Axios: How to Send POST Requests
In this guide, we walk through how to send POST requests with NodeJs Axios. Including how to POST form data and JSON data.
NodeJs Axios: Setting Fake User-Agents
In this guide, we walk through how to use fake user-agents with NodeJs Axios to avoid your scrapers from getting blocked.
NodeJs Axios: Retry Failed Requests
In this guide, we walk through how to configure NodeJs Axios to retry failed requests so you can build a more reliable system.
HTML Parser Libraries
The 5 Best NodeJs HTML Parsing Libraries Compared
We compare the 5 best NodeJs HTML parsing libraries available in 2023 - Cheerio, JSDOM, Parse5, htmlparser2, and xml2js.