The
Playwright Web Scraping
Playbook

In Part 1 of the series, we go over the basics of how to build a scraper using NodeJS Playwright.

In Part 2 of the series, we're going to show you how to make your scraper more robust and reliable.

In Part 3 of the series, we'll explore several different ways we can store the data and talk about their pros, and cons and in which situations you would use them.

In Part 4 of the series, we make our scraper more robust and scalable by handling failed requests and using concurrency.

In Part 5 of the series, we make our scraper production ready by using fake user agents & browser headers to make our scrapers look more like real users.

In Part 6 of the series, we'll explore how to use proxies to bypass anti-bot systems by hiding your real IP address and location.

In this guide, we’ll introduce you to the fundamental functionality of Node.js Playwright and how to use it in your own projects.

In this comprehensive guide, we'll delve into the art of finding elements using CSS selectors with Playwright.

In this guide, we'll explore how to precisely locate and interact with DOM elements using XPath in Playwright.

Whether you're looking to block requests from a server, or figure out which endpoints a webapp makes queries to, capturing HTTP requests is a super useful skill to have in your toolbox.

Managing the timing differences between script execution and the varying speeds at which web pages load is crucial. In this Playwright guide, we focus on the nuanced strategies of waiting for pages or elements to load.

In this guide, we will explore how to capture web page screenshots efficiently using Playwright.

In this guide, we'll cover the essential steps to selectively block the loading of images and other resources using Playwright.

In this guide, we'll delve into various methods for downloading files from websites using Playwright.

Jupyter Notebook allows you to run code in an interactive environment that combines code execution, rich text, equations, visualizations, and more. This guide will walk through how to set up and utilize Playwright within a Jupyter Notebook.

In this guide, we walk through how to login to websites with NodeJS Playwright. Including, dealing with anti-bots and CAPTCHAs.

In this guide, we'll explore how to use Playwright to scroll pages effectively. By the end, you'll have a solid understanding of how to leverage Playwright's scrolling functionality to enhance your web automation scripts.

In this guide, we'll cover various form input types and capturing responses after form submission using Playwright.

In this comprehensive guide, we'll delve into the intricacies of cookie management in Playwright, emphasizing its effectiveness in the domains of automation and web scraping.

In this guide, we walk through how to use proxies with NodeJS Playwright.

User agents play a pivotal role in shaping the interaction between browsers and websites and allows developers to emulate different browsers and devices seamlessly. This guide will explore various methods to change the user-agent with Playwright.

In this guide, we’ll explore how to overcome this limitation by making adjustments and applying patches to render Playwright undetectable to bot detectors.

In this article, we'll explore how Playwright can be utilized to bypass Cloudflare's security defenses.

In this article, we'll explore how Playwright can be utilized to bypass PerimeterX's security defenses.

In this guide, we show you how to use Playwright Extra and its plugins, including the best plugins for web scraping, debugging, and other valuable purposes, as well as advanced integrations.