The
Playwright Web Scraping
Playbook
Your guide to becoming a Playwright Web Scraping Pro!
Playwright Introduction
The NodeJS Playwright Guide
In this guide, we’ll introduce you to the fundamental functionality of Node.js Playwright and how to use it in your own projects.
Extracting & Parsing Data
Playwright Guide - How to Find Elements by CSS Selectors with Playwright
In this comprehensive guide, we'll delve into the art of finding elements using CSS selectors with Playwright.
Playwright Guide - How To Find Elements by XPath
In this guide, we'll explore how to precisely locate and interact with DOM elements using XPath in Playwright.
Playwright Guide - Capturing Background XHR Requests
Whether you're looking to block requests from a server, or figure out which endpoints a webapp makes queries to, capturing HTTP requests is a super useful skill to have in your toolbox.
Playwright Guide - Waiting For Page or Element To Load
Managing the timing differences between script execution and the varying speeds at which web pages load is crucial. In this Playwright guide, we focus on the nuanced strategies of waiting for pages or elements to load.
Playwright Guide - How To Take Screenshots
In this guide, we will explore how to capture web page screenshots efficiently using Playwright.
Customizing Playwright
Playwright Guide - How to Block Images and Resources using Playwright
In this guide, we'll cover the essential steps to selectively block the loading of images and other resources using Playwright.
Playwright Guide - Downloading A File
In this guide, we'll delve into various methods for downloading files from websites using Playwright.
Playwright Environments
Playwright Guide - Run Using Jupyter Notebook
Jupyter Notebook allows you to run code in an interactive environment that combines code execution, rich text, equations, visualizations, and more. This guide will walk through how to set up and utilize Playwright within a Jupyter Notebook.
Navigation & Logging In
Playwright Guide - Logging Into Websites
In this guide, we walk through how to login to websites with NodeJS Playwright. Including, dealing with anti-bots and CAPTCHAs.
Playwright Guide - How to Scroll Pages with Playwright
In this guide, we'll explore how to use Playwright to scroll pages effectively. By the end, you'll have a solid understanding of how to leverage Playwright's scrolling functionality to enhance your web automation scripts.
Playwright Guide - Submitting A Form
In this guide, we'll cover various form input types and capturing responses after form submission using Playwright.
Managing Cookies & Sessions
Playwright Guide - Managing Cookies
In this comprehensive guide, we'll delve into the intricacies of cookie management in Playwright, emphasizing its effectiveness in the domains of automation and web scraping.
Avoiding Bans & Anti-Bots With Playwright
Using Proxies With NodeJS Playwright
In this guide, we walk through how to use proxies with NodeJS Playwright.
Playwright Guide - Using Fake User Agents
User agents play a pivotal role in shaping the interaction between browsers and websites and allows developers to emulate different browsers and devices seamlessly. This guide will explore various methods to change the user-agent with Playwright.
How To Make Playwright Undetectable
In this guide, we’ll explore how to overcome this limitation by making adjustments and applying patches to render Playwright undetectable to bot detectors.
Bypassing Anti-Bots
Playwright Guide - How to Bypass Cloudflare with Playwright
In this article, we'll explore how Playwright can be utilized to bypass Cloudflare's security defenses.
Playwright Guide - How to Bypass PerimeterX with Playwright
In this article, we'll explore how Playwright can be utilized to bypass PerimeterX's security defenses.
Playwright Plugins
What is Playwright Extra - A Web Scrapers Guide
In this guide, we show you how to use Playwright Extra and its plugins, including the best plugins for web scraping, debugging, and other valuable purposes, as well as advanced integrations.