Using ScrapeOps SSH integration, you can easily integrate the ScrapeOps job scheduling and management functionality into a Digital Ocean droplet.
This functionality will allow you to:
- Deploy your spiders (Python, NodeJs, Scrapy, etc.) from GitHub to your Digital Ocean droplet using the ScrapeOps dashboard.
- Schedule & run spiders from the ScrapeOps dashboard without having to touch your server.
To use the stats, graphs and alerts functionality of ScrapeOps, you need to install the ScrapeOps SDK in your scrapers.
To integrate with a Digital Ocean you first must have a Digital Ocean droplet setup. If don't have one setup already, then you can use this link and get $100 in free Digital Ocean credits that you can use.