Skip to main content

The
Selenium Web Scraping
Playbook

Your guide to becoming a Selenium Web Scraping Pro!

Web Scraping Community:
Web Scraping Reddit Community
Web Scraping Discord Community

Intro to Selenium

The Python Selenium Guide - Web Scraping With Selenium

In this guide we show you how to use Python Selenium to render, automate and scrape Javascript heavy websites.

Python Selenium Guide - How To Find Elements by XPath

XPath is an extremely powerful tool for locating elements. In this guide we will deep dive into using XPath to find elements in Selenium.

Python Selenium Guide - Waiting For Page or Element To Load

Managing the timing differences between script execution and the varying speeds at which web pages load is crucial.In this Selenium guide, we focus on the nuanced strategies of waiting for pages or elements to load.

Comparison of Selenium To Other Web Scraping Libraries

Python Selenium VS Python Requests Compared

Should you use Python Selenium or Python Requests? In this guide we compare both options and tell you when you should use each.

Python Selenium VS Python Scrapy Compared

Should you use Python Selenium or Python Scrapy? In this guide we compare both options and tell you when you should use each.

Python Selenium vs NodeJS Playwright Compared

Should you use Python Selenium or NodeJS Playwright? In this guide we compare both options and tell you when you should use each.

Customizing Selenium

Disable Images Loading In Python Selenium

In this guide, we walk through how to disable Python Selenium from loading images to speed up your scrapers and reduce bandwidth usage.

Avoiding Bans & Anti-Bots

Using Proxies With Python Selenium

In this guide, we walk through how to use proxies with Python Selenium.

Selenium Undetected Chromedriver: Bypass Anti-Bots With Ease

In this guide, we walk through how to setup and use Python Selenium's Undetected Chromedriver to bypass anti-bot solutions like Cloudflare, DataDome, etc.

Python Selenium Guide - Using Fake User Agents

In this guide, we'll explore the fake user agents, their implementation in Selenium scripts and provide practical insights to elevate your web scraping endeavors.

Python Selenium Guide - How to Bypass Datadome with Selenium

In this Selenium guide, we explore the challenges posed by DataDome and delve into a practical solution using Selenium to bypass its protections.

Python Selenium Guide - How to Bypass PerimeterX with Selenium

In this Selenium guide, we explore the challenges posed by PerimeterX and delve into a practical solution using Selenium to bypass its protections.

Selenium Extensions

Selenium Wire Guide: Extending Python Selenium

In this guide, we walk through Selenium Wire a extension for Python Selenium that gives you more control over requests & responses.

Need an easy way to monitor your scrapers?

Sign up for a free ScrapeOps account today.