Scrapingdog
Scrapingdog provides a web scraping API to extract data from any website in HTML, JSON, or PDF format using a pool of millions of proxies.
Summary
Scrapingdog is a web scraping API that manages proxy rotation, CAPTCHA bypasses, and headless browser rendering. You can extract data from JavaScript-heavy sites using headless Chrome or target specific regions with residential proxies. The API supports custom headers, sticky sessions, and AI-driven data extraction. It provides dedicated scrapers for search engines and social media platforms.
Scrapingdog’s Products
Scrapingdog User Reviews
Scrapingdog offers a comprehensive range of web scraping and data collection products, from proxies to data sets and data APIs.
User Review Summary
Scrapingdog provides a web scraping API that can be used for scraping data from any website in HTML, JSON, pdfs, etc form. We use pool of millions of proxies to create a seamless data pipeline from any website. Scrapingdog also supports JS rendering which can be used for scraping websites that needs multiple API calls to load the website completely. Our headless chrome architecture is fast and accurate.
Trustscore 4.6 | 587 reviews
Signed up and the API was non…
Signed up and the API was non functional for about a week. Poor communication from support and they refused to refund me my subscription fee. I was not able to make a single successful API call.
Super friendly and awesome support
Super friendly and awesome support. I've tried contacting support for 3-4 different companies about questions on their API's, I was left in the dark with no response, scrapingdog responded AND even gave me a discount. 5/5 support. Thank you scrapingdog!
I've been using them for several years
I've been using them for several years. They had issues back then, but the bugs have been fixed starting the last year ago, and now it's great. Whenever issues have popped up, the founder was in the chat and fixed them on the spot. The platforms available has also grown a lot. Price is unbeatable as far as I know. Great platform.
Scrapingdog
Scrapingdog is a web scraping API that manages proxy rotation, CAPTCHA solving, and headless browser rendering. Developers access the service via a single API endpoint to retrieve data from public webpages, e-commerce sites, and social media platforms.
Ideal Use Cases
Scrapingdog is a web scraping API accessed via GET or POST requests to a central endpoint. It handles proxy rotation and browser rendering for public data extraction.
Ideal Use Cases
- E-commerce & price monitoring: Built-in rotating proxies for difficult retail targets
- Search engine results (SERP): Dedicated Google Search API at 5-10 credits per request
- JavaScript-heavy sites & SPAs: Headless Chrome rendering available at 5 credits
- Social media data: Dedicated scrapers for LinkedIn, X (Twitter), and TikTok
Poor Use Cases
- Real-time, low-latency lookups: Headless browser rendering adds significant processing time
- Large-scale crawling: Multi-credit costs for JS or premium IPs increase total expense
- Multi-step flows & logged-in sessions: Sessions expire quickly (60s) after last use
- Financial & stock data: Strict rate limits on exchanges may require custom infrastructure
Performance
Assuming average page size is 250kb
| Domain | Feature | Success Rate | Avg. Success Latency | API Credits | Provider Plan | CPM |
|---|---|---|---|---|---|---|
| aliexpress.com | - | 93% | 10.5s | 1 credit | Standard ($90/month) | $90 |
| amazon.com | JS Rendering | 90% | 11.1s | 5 credits | Pro ($200/month) | $335 |
| apple.com | JS Rendering | 91% | 8.6s | 5 credits | Pro ($200/month) | $335 |
| costco.com | - | 87% | 12.7s | 1 credit | Standard ($90/month) | $90 |
| etsy.com | - | 50% | 15.4s | 0 credits | Pro ($200/month) | $67 |
| homedepot.com | - | 60% | 18.1s | 1 credit | Standard ($90/month) | $90 |
| petco.com | - | 50% | 17.5s | 0 credits | Pro ($200/month) | $67 |
| target.com | JS Rendering | 91% | 11.5s | 5 credits | Pro ($200/month) | $335 |
| walmart.com | - | 100% | 6.5s | 6 credits | Premium ($350/month) | $348 |
| zalando.co.uk | - | 91% | 11.9s | 1 credit | Standard ($90/month) | $90 |
Features
| Feature | API Credit | Description |
|---|---|---|
Renderingdynamic | 5 | Render the page in a headless browser. |
Residentialpremium | 10 | Route the request via residential IPs. |
Rendering + Residentialpremium | 25 | Residential IPs plus browser rendering. |
Countrycountry | 10 | Pick the exit country by ISO code. |
Sticky Sessionssession_number | 1 | Reuse the same proxy across requests. |
Ultra Premiumstealth_mode | 10 | Stealth mode to bypass bot protection. |
Browser Waitwait | - | Wait N ms before returning the page. |
Geotargeting
Geotargeting is implemented using the country parameter with ISO 3166-1 alpha-2 codes. It is supported by both datacenter and residential proxy pools. Each geotargeted request costs 10 credits, and there is no additional documented flat cost.
The provider publishes no country list; see its geotargeting documentation for the codes it accepts.
Scrapingdog Plans
Free
- 200 API credits
- 1 concurrent requests
Free
- 100 API credits
- 1 concurrent requests
LITE
- 200,000 API credits
- 5 concurrent requests
STANDARD
- 1,000,000 API credits
- 50 concurrent requests
PRO
- 3,000,000 API credits
- 100 concurrent requests
PREMIUM
- 6,000,000 API credits
- 150 concurrent requests
BUSINESS
- 9,000,000 API credits
- 200 concurrent requests
BUSINESS PLUS
- 19,000,000 API credits
- 250 concurrent requests
BUSINESS PRO
- 29,000,000 API credits
- 300 concurrent requests
CORPORATE
- 42,000,000 API credits
- 350 concurrent requests
CORPORATE PLUS
- 55,000,000 API credits
- 400 concurrent requests
CORPORATE PRO
- 65,000,000 API credits
- 450 concurrent requests
ENTERPRISE STARTER
- 90,000,000 API credits
- 500 concurrent requests
ENTERPRISE PLUS
- 120,000,000 API credits
- 600 concurrent requests
ENTERPRISE PRO
- 150,000,000 API credits
- 650 concurrent requests
GLOBAL STARTER
- 185,000,000 API credits
- 700 concurrent requests
GLOBAL PLUS
- 220,000,000 API credits
- 800 concurrent requests
GLOBAL PRO
- 255,000,000 API credits
- 850 concurrent requests
GLOBAL ELITE
- 295,000,000 API credits
- 900 concurrent requests
ULTRA STARTER
- 360,000,000 API credits
- 1,000 concurrent requests
Integrating Scrapingdog
Developers connect to the service via the api-endpoint at api.scrapingdog.com/scrape. Authentication is performed by passing the apikey as a query parameter in GET or POST requests.
curl "https://api.scrapingdog.com/scrape?api_key=APIKEY&url=https://www.scrapingdog.com&dynamic=false"
The same service is reachable as a rotating proxy gateway at proxy.scrapingdog.com:8081 with username scrapingdog and the API key as the password (http://scrapingdog:APIKEY@proxy.scrapingdog.com:8081), where options are appended to the username as dotted directives such as scrapingdog.dynamic=true.country=us.stealth or sent as X-Sd-* headers.
curl -x "http://scrapingdog:APIKEY@proxy.scrapingdog.com:8081" "http://www.google.com/search?q=coffee"
import requestsurl = "https://api.scrapingdog.com/scrape"params = {"api_key": "YOUR_API_KEY","url": "https://www.scrapingdog.com","dynamic": "false"}response = requests.get(url, params=params)print(response.text)
Examples