The
Puppeteer Web Scraping
Playbook
Your guide to becoming a Puppeteer Web Scraping Pro!
Puppeteer Introduction
The NodeJS Puppeteer Guide
In this guide, we show you how to use Puppeteer, a Node.js library that offers a high-level, user-friendly API for automating tasks and interacting with dynamic web pages.
How To Optimize Puppeteer for Web Scraping
In this guide, we show you how to optimize Puppeteer for web scraping, incorporating efficient configurations, best practices, and strategic implementation.
Extracting & Parsing Data
Puppeteer Guide - How to Find Elements by CSS Selectors with Puppeteer
In this comprehensive guide, we'll delve into the art of finding elements using CSS selectors with Puppeteer.
Puppeteer Guide - How To Find Elements by XPath
In this guide, we'll explore how to precisely locate and interact with DOM elements using XPath in Puppeteer.
Puppeteer Guide - How to Capture Background XHR Requests
Blocking unnecessary resources, such as images, can enhance test performance by speeding up page loading and minimizing data usage.
Puppeteer Guide - Waiting For Page or Element To Load
Managing the timing differences between script execution and the varying speeds at which web pages load is crucial. In this Puppeteer guide, we focus on the nuanced strategies of waiting for pages or elements to load.
Puppeteer Guide - How To Take Screenshots
In this guide, we will explore how to capture web page screenshots efficiently using Puppeteer.
Customizing Puppeteer
Puppeteer Guide - How to Block Images and Resources using Puppeteer
In this guide, we'll cover the essential steps to selectively block the loading of images and other resources using Puppeteer.
Puppeteer Guide - Downloading A File
In this guide, we'll delve into various methods for downloading files from websites using Puppeteer.
Puppeteer Environments
Puppeteer Guide - Run Using Jupyter Notebook
Jupyter Notebook allows you to run code in an interactive environment that combines code execution, rich text, equations, visualizations, and more. This guide will walk through how to set up and utilize Puppeteer within a Jupyter Notebook.
Navigation & Logging In
Puppeteer Guide - Logging Into Websites With NodeJS Puppeteer
In this guide, we walk through how to login to websites with NodeJS Puppeteer. Including, dealing with anti-bots and CAPTCHAs.
Puppeteer Guide - How to Scroll Pages
The ability to scroll pages is an important skill to learn when using Puppeteer. In this article you will learn a variety of ways to scroll pages in Puppeteer and how to use them.
Puppeteer Guide - Submitting A Form
In this guide, we'll cover various form input types and capturing responses after form submission using Puppeteer.
Managing Cookies & Sessions
Puppeteer Guide - Managing Cookies
In this comprehensive guide, we'll delve into the intricacies of cookie management in Puppeteer, emphasizing its effectiveness in the domains of automation and web scraping.
Avoiding Bans & Anti-Bots With Puppeteer
Using Proxies With NodeJS Puppeteer
In this guide, we walk through how to use proxies with NodeJS Puppeteer.
Bypass CAPTCHAs With Puppeteer
In this article, we're going to explore the techniques to bypass CAPTCHAs during web scraping.
Puppeteer Guide - Using Fake User Agents
User agents play a pivotal role in shaping the interaction between browsers and websites and allows developers to emulate different browsers and devices seamlessly. This guide will explore various methods to change the user-agent with Puppeteer.
Bypassing Anti-Bots
Puppeteer Guide - How to Bypass DataDome with Puppeteer
In this article, we'll explore how Puppeteer can be utilized to bypass DataDome's security defenses.
Puppeteer Guide - How to Bypass PerimeterX with Puppeteer
In this article, we'll explore how Puppeteer can be utilized to bypass PerimeterX's security defenses.
Puppeteer Plugins
What is Puppeteer Extra - A Web Scrapers Guide
In this guide, we show you how to use Puppeteer Extra and its plugins, including the best plugins for web scraping, debugging, and other valuable purposes, as well as advanced integrations.
Puppeteer-Extra-Stealth Guide - Bypass Anti-Bots With Ease
In this guide, we will introduce the Puppeteer-Extra-Stealth Plugin, helps users bypass bot-detection systems.