Monitoring - Product Updates
Here you will find the latest updates to ScrapeOps Monitoring. This page tracks new features, integrations, improvements, and bug fixes.
Full Documentation
For complete Monitoring documentation, see the Monitoring docs.
What is ScrapeOps Monitoring?
ScrapeOps Monitoring provides real-time visibility into your web scrapers. Track job stats, health, and performance in one dashboard.
Key features:
- Job stats & visualization - Track pages scraped, items parsed, response codes, and more
- Health checks & alerts - Custom spider health checks with Slack notifications
- Daily reports - Automated scraping reports delivered to your inbox
- Historical comparison - Compare current jobs versus historical performance
Supported Frameworks
| Framework | Integration | Status |
|---|---|---|
| Python Scrapy | SDK | ✅ Available |
| Python Requests | SDK | ✅ Available |
| Node.js | — | 🗓️ Roadmap |
| Go | — | 🗓️ Roadmap |
Tracked Metrics
| Metric | Description | Status |
|---|---|---|
| Pages Scraped & Missed | Track successful and failed page requests | ✅ Available |
| Items Parsed & Missed | Monitor data extraction success | ✅ Available |
| Item Field Coverage | Ensure data completeness | ✅ Available |
| Runtimes | Job duration tracking | ✅ Available |
| Response Status Codes | HTTP response analysis | ✅ Available |
| Success Rates & Latencies | Performance metrics | ✅ Available |
| Errors & Warnings | Exception tracking | ✅ Available |
| Bandwidth | Data transfer monitoring | ✅ Available |
Changelog
No recent changes.
Get Started
Ready to monitor your scrapers?