Using ScrapeOps SSH integration, you can easily integrate the ScrapeOps job scheduling and management functionality into a AWS server.
This functionality will allow you to:
- Deploy your spiders (Python, NodeJs, Scrapy, etc.) from GitHub to your AWS server using the ScrapeOps dashboard.
- Schedule & run spiders from the ScrapeOps dashboard without having to touch your server.
To use the stats, graphs and alerts functionality of ScrapeOps, you need to install the ScrapeOps SDK in your scrapers.
To integrate with a AWS you first must have a AWS server setup.