The
Selenium Web Scraping
Playbook

In this guide we show you how to use Python Selenium to render, automate and scrape Javascript heavy websites.

XPath is an extremely powerful tool for locating elements. In this guide we will deep dive into using XPath to find elements in Selenium.

Managing the timing differences between script execution and the varying speeds at which web pages load is crucial.In this Selenium guide, we focus on the nuanced strategies of waiting for pages or elements to load.

Should you use Python Selenium or Python Requests? In this guide we compare both options and tell you when you should use each.

Should you use Python Selenium or Python Scrapy? In this guide we compare both options and tell you when you should use each.

Should you use Python Selenium or NodeJS Playwright? In this guide we compare both options and tell you when you should use each.

In this guide, we walk through how to disable Python Selenium from loading images to speed up your scrapers and reduce bandwidth usage.

In this guide, we walk through how to use proxies with Python Selenium.

In this guide, we walk through how to setup and use Python Selenium's Undetected Chromedriver to bypass anti-bot solutions like Cloudflare, DataDome, etc.

In this guide, we'll explore the fake user agents, their implementation in Selenium scripts and provide practical insights to elevate your web scraping endeavors.

In this Selenium guide, we explore the challenges posed by DataDome and delve into a practical solution using Selenium to bypass its protections.

In this Selenium guide, we explore the challenges posed by PerimeterX and delve into a practical solution using Selenium to bypass its protections.

In this guide, we walk through Selenium Wire a extension for Python Selenium that gives you more control over requests & responses.