Scrapingbee
ScrapingBee is a web scraping API that handles proxies and headless browsers so developers can focus on extracting the data they need.
Summary
ScrapingBee is a web scraping API that manages headless browsers and rotates proxies to bypass anti-bot protections. A developer can render JavaScript, capture page screenshots, and use residential proxies for geotargeting across supported countries. Integration is available through a REST API endpoint or a proxy gateway, supporting custom extraction rules and dedicated search engine endpoints.
Scrapingbee’s Products
Scrapingbee User Reviews
Scrapingbee offers a comprehensive range of web scraping and data collection products, from proxies to data sets and data APIs.
User Review Summary
Reviewers consistently praise the service for its reliability, ease of integration, and helpful customer support. They report that the API effectively handles proxy rotation and bot protection, which saves significant development time. However, users frequently criticize the credit system, noting that advanced features like JavaScript rendering consume credits quickly. Some reviewers also mention that concurrency limits on lower plans can bottleneck large projects, while others find the documentation for certain edge cases or specific programming languages lacking.
4.9 out of 5 stars | 141 reviews
Golden review
Customer service is truly responsive ! They support us in the success of our projects. If you get stuck, don't hesitate to reach out to them; they will be able to help you get unblocked.
No thing beacause the customer service is truly responsive ! The difficulty of being familiar with all the different data extraction methods, as well as their uses and differences.
Effortless Web Scraping API: Handles JavaScript, Proxies, and CAPTCHAs with Ease
ScrapingBee is a reliable, time-saving tool for web developers, data engineers, and growth marketers needing data extraction at scale without the headache of building and maintaining infrastructure. By outsourcing proxy rotation, headless browser automation, and CAPTCHA handling, it allows teams to focus entirely on parsing data. Despite the credit system requiring careful management for high-volume JS rendering, the product delivers outstanding value and stability.
Hassle-free Proxy & CAPTCHA Management: Completely eliminates the need to manage residential IP pools or bypass anti-bot mechanisms like Cloudflare. Headless Browser & JS Rendering: Simple render_js=true parameter allows seamless extraction of dynamic single-page applications (SPAs) like React or Vue. Great Documentation & Dev Experience: Clear API documentation paired with fast, responsive customer support when troubleshooting edge cases.
Credit Consumption on Heavy Requests: Advanced features (like JavaScript rendering, premium proxies, or screenshots) consume multiple API credits per request, which can burn through lower-tier plans quickly. Concurrency Limits on Entry Plans: Lower-tier plans have concurrency caps that may bottleneck large-scale parallel scraping jobs unless upgraded.
Solved the part of web scraping I never wanted to maintain
Good. I am a one-person company and my rule is that a tool either removes work or it goes. This one removed a category of work I was never going to be good at — keeping proxies alive and browsers from breaking. It runs unattended and I have not had to think about it since I set it up, which is the highest compliment I can give a piece of infrastructure.
I also had one question for their support team and got a working answer in about 20 minutes, which is not something I expected from an API product at this price.
I run a small ecommerce operation by myself, so anything I add has to work without me babysitting it. ScrapingBee replaced the whole proxy-rotation-and-headless-browser stack with a single API call. I send a URL, tell it whether I need JavaScript rendered, and I get clean HTML back. Setup took an afternoon. The documentation is straightforward and the credit system is transparent enough that I can estimate what a job will cost before I run it. For pulling public product specs and images to enrich my catalog, it has been reliable.
Honestly not much to complain about. The only thing I would tell someone evaluating it: this is an API, not a dashboard product. There is no built-in scheduler or UI for recurring jobs, so you plug it into whatever automation you already have. That was fine for me, but if you are looking for a no-code tool out of the box, adjust your expectations. Same with credits — JavaScript rendering uses more of them, which makes sense, you just want to be intentional about when you turn it on.
ScrapingBee API
Tired of getting blocked while scraping the web? ScrapingBee API handles headless browsers and rotates proxies for you.
Ideal Use Cases
ScrapingBee API is a web scraping tool that manages headless browsers and proxy rotation. It is accessed via a REST API or proxy gateway to bypass anti-bot protections on retail sites, social networks, and single-page applications.
Ideal Use Cases
- JavaScript-heavy sites & SPAs: JS rendering at 5 credits covers client-side pages
- Search engine results (SERP): Dedicated Google Search API provides real-time result pages
- E-commerce & price monitoring: Premium proxies at 10-25 credits bypass retail anti-bots
- Screenshots & visual monitoring: Rendered page captures available via the screenshot parameter
Poor Use Cases
- Real-time, low-latency lookups: Large-scale headless browser management impacts response time
- Large-scale crawling: High credit costs for JS (5) or Stealth (75) tiers
- Sneaker & ticket purchasing bots: Acceptable Use Policy restricts automated checkout activities
- Multi-step flows & logged-in sessions: IP persistence is limited to 5-minute sessions
Performance
Assuming average page size is 250kb
| Domain | Feature | Success Rate | Avg. Success Latency | API Credits | Provider Plan | CPM |
|---|---|---|---|---|---|---|
| aliexpress.com | Ultra Premium | 97% | 10.8s | 75 credits | Enterprise 41 ($2399/month) | $4,425 |
| amazon.com | Ultra Premium | 87% | 16.6s | 75 credits | Enterprise 69 ($3599/month) | $3,900 |
| apple.com | Ultra Premium | 100% | 6.4s | 75 credits | Enterprise 41 ($2399/month) | $4,425 |
| costco.com | - | 69% | 19.4s | 1 credit | Startup ($99/month) | $99 |
| target.com | - | 90% | 16.8s | 1 credit | Startup ($99/month) | $99 |
| zalando.co.uk | Ultra Premium | 92% | 14.5s | 75 credits | Enterprise 41 ($2399/month) | $4,425 |
Features
| Feature | API Credit | Description |
|---|---|---|
Renderingrender_js | 5 | Renders the page in a headless browser |
Residentialpremium_proxy | 10 | Routes the request through residential IPs |
Rendering + Residentialpremium_proxy | 25 | Residential IP and headless browser rendering |
Countrycountry_code | 25 | Picks the exit country of the proxy IP |
Sticky Sessionssession_id | 5 | Same IP for 5 minutes across requests |
Ultra Premiumstealth_proxy | 75 | Stealth proxy pool for hardest sites |
Browser Waitwait | 5 | Waits N ms before returning the HTML |
Geotargeting
Geotargeting uses the country_code parameter with ISO 3166-1 alpha-2 codes. 42 countries are reachable on classic proxies at the normal 1 credit; every other country requires premium_proxy=true at 10 credits per request.
| Standard Countries No extra cost | |
|---|---|
| Argentina | Denmark |
| Australia | Estonia |
| Austria | Finland |
| Belgium | France |
| Brazil | Germany |
| Canada | Greece |
| Chile | Hungary |
| China | India |
| Colombia | Indonesia |
| Croatia | Ireland |
| … and many more countries | |
| Premium Countries Extra cost | |
|---|---|
| Afghanistan | Aruba |
| Albania | Azerbaijan |
| Algeria | Bahama |
| American Samoa | Bahrain |
| Andorra | Bangladesh |
| Angola | Barbados |
| Anguilla | Belarus |
| Antarctica | Belize |
| Antigua & Barbuda | Benin |
| Armenia | Bermuda |
| … and many more countries | |
ScrapingBee API Plans
Freelance
- 250,000 API credits
- 50 concurrent requests
Startup
- 1,000,000 API credits
- 100 concurrent requests
Business
- 3,000,000 API credits
- 200 concurrent requests
Business +
- 8,000,000 API credits
- 400 concurrent requests
Enterprise 14
- 14,000,000 API credits
- 500 concurrent requests
Enterprise 24
- 24,000,000 API credits
- 600 concurrent requests
Enterprise 41
- 41,000,000 API credits
- 700 concurrent requests
Enterprise 69
- 69,000,000 API credits
- 800 concurrent requests
Integrating ScrapingBee API
Developers connect via a REST API endpoint or a standard HTTP proxy gateway. Authentication is handled by providing an API key in the Authorization header as a Bearer token or as a proxy username.
curl "https://app.scrapingbee.com/api/v1?url=YOUR-URL" \
-H "Authorization: Bearer YOUR-API-KEY"The proxy gateway uses the address proxy.scrapingbee.com on port 8886. The API key serves as the username, while URL-encoded API parameters are passed within the password field.
curl -k -x "https://YOUR-API-KEY:render_js=False&premium_proxy=True@proxy.scrapingbee.com:8887" 'https://httpbin.org/anything?json' -v
import requestsresponse = requests.get(url="https://app.scrapingbee.com/api/v1",params={"url": "https://httpbin.org/anything"},headers={"Authorization": "Bearer YOUR-API-KEY"})print(response.status_code)print(response.content)
Examples