Skip to main content

AWS Server Integration

Using ScrapeOps SSH integration, you can easily integrate the ScrapeOps job scheduling and management functionality into a AWS server.

This functionality will allow you to:

  • Deploy your spiders (Python, NodeJs, Scrapy, etc.) from GitHub to your AWS server using the ScrapeOps dashboard.
  • Schedule & run spiders from the ScrapeOps dashboard without having to touch your server.
Job Monitoring:

To use the stats, graphs and alerts functionality of ScrapeOps, you need to install the ScrapeOps SDK in your scrapers.

📋 Prerequisites

To integrate with a AWS you first must have a AWS server setup.

Python Scrapy Integration