ScrapeOps
ScrapeOps Playbook · 31 guidesPuppeteer Web Scraping Guides and Tutorials
Puppeteer guides for scraping JavaScript sites: extracting data, navigation, cookies, environments, and getting past anti-bot checks.
Guides by topic
Browse the Playbook
01
Puppeteer Introduction
2 guides
The NodeJS Puppeteer GuideIn this guide, we show you how to use Puppeteer, a Node.js library that offers a high-level, user-friendly API for automating tasks and interacting with dynamic web pages.→How To Optimize Puppeteer for Web ScrapingIn this guide, we show you how to optimize Puppeteer for web scraping, incorporating efficient configurations, best practices, and strategic implementation.→
02
How to Scrape With Puppeteer Series
5 guides
How to Scrape Google Search With PuppeteerIn this guide, we'll take you through how to scrape Google search results using Puppeteer→How to Scrape Indeed With PuppeteerIn this guide, we'll take you through how to scrape Indeed using Puppeteer→How to Scrape Quora With PuppeteerIn this guide, we'll take you through how to scrape Quora using Puppeteer→How to Scrape Walmart With PuppeteerIn this guide, we'll take you through how to scrape Walmart using Puppeteer→How to Scrape Target With PuppeteerIn this guide, we'll take you through how to scrape Target using Puppeteer→
03
Extracting & Parsing Data
5 guides
Puppeteer Guide - How to Find Elements by CSS Selectors with PuppeteerIn this comprehensive guide, we'll delve into the art of finding elements using CSS selectors with Puppeteer.→Puppeteer Guide - How To Find Elements by XPathIn this guide, we'll explore how to precisely locate and interact with DOM elements using XPath in Puppeteer.→Puppeteer Guide - How to Capture Background XHR RequestsBlocking unnecessary resources, such as images, can enhance test performance by speeding up page loading and minimizing data usage.→Puppeteer Guide - Waiting For Page or Element To LoadManaging the timing differences between script execution and the varying speeds at which web pages load is crucial. In this Puppeteer guide, we focus on the nuanced strategies of waiting for pages or elements to load.→Puppeteer Guide - How To Take ScreenshotsIn this guide, we will explore how to capture web page screenshots efficiently using Puppeteer.→
04
Customizing Puppeteer
2 guides
Puppeteer Guide - How to Block Images and Resources using PuppeteerIn this guide, we'll cover the essential steps to selectively block the loading of images and other resources using Puppeteer.→Puppeteer Guide - Downloading A FileIn this guide, we'll delve into various methods for downloading files from websites using Puppeteer.→
08
Avoiding Bans & Anti-Bots With Puppeteer
5 guides
Using Proxies With NodeJS PuppeteerIn this guide, we walk through how to use proxies with NodeJS Puppeteer.→Bypass CAPTCHAs With PuppeteerIn this article, we're going to explore the techniques to bypass CAPTCHAs during web scraping.→Using Fake User AgentsUser agents play a pivotal role in shaping the interaction between browsers and websites and allows developers to emulate different browsers and devices seamlessly. This guide will explore various methods to change the user-agent with Puppeteer.→Puppeteer Real Browser GuideIn this guide, we will walk you through using Puppeteer Real Browser, which is designed to help you overcome bot detection and CAPTCHA challenges in web scraping.→How To Make Puppeteer UndetectableIn this guide, we’ll explore how to overcome this limitation by making adjustments and applying patches to render Puppeteer undetectable to bot detectors. →
09
Bypassing Anti-Bots
3 guides
Puppeteer Guide - How to Bypass Cloudflare with PuppeteerIn this article, we'll explore how Puppeteer can be utilized to bypass Cloudflare's security defenses.→Puppeteer Guide - How to Bypass DataDome with PuppeteerIn this article, we'll explore how Puppeteer can be utilized to bypass DataDome's security defenses.→Puppeteer Guide - How to Bypass PerimeterX with PuppeteerIn this article, we'll explore how Puppeteer can be utilized to bypass PerimeterX's security defenses.→
10
Puppeteer Plugins
2 guides
What is Puppeteer Extra - A Web Scrapers GuideIn this guide, we show you how to use Puppeteer Extra and its plugins, including the best plugins for web scraping, debugging, and other valuable purposes, as well as advanced integrations.→Puppeteer-Extra-Stealth Guide - Bypass Anti-Bots With EaseIn this guide, we will introduce the Puppeteer-Extra-Stealth Plugin, helps users bypass bot-detection systems.→
Need an easy way to monitor your scrapers?
Sign up for a free ScrapeOps account today.