AWS Server Integration

Using ScrapeOps SSH integration, you can easily integrate the ScrapeOps job scheduling and management functionality into a AWS server.

This functionality will allow you to:

• Deploy your spiders (Python, NodeJs, Scrapy, etc.) from GitHub to your AWS server using the ScrapeOps dashboard.
• Schedule & run spiders from the ScrapeOps dashboard without having to touch your server.

Job Monitoring:

To use the stats, graphs and alerts functionality of ScrapeOps, you need to install the ScrapeOps SDK in your scrapers.

📋 Prerequisites

To integrate with a AWS you first must have a AWS server setup.

Python Scrapy Integration