Headless Browser
The ScrapeOps Proxy API Aggregator enables you to use the headless browser functionality of our underlying proxy providers by adding the render_js=true to your requests.
Using a headless browser is often needed if you want to scrape a Single Page Application built with frameworks such as React.js, Angular.js, JQuery or Vue.
curl -k "https://proxy.scrapeops.io/v1/?api_key=YOUR_API_KEY&url=http://httpbin.org/anything&render_js=true"
Using the Headless Browser functionality will consume 10 API Credits.
Advanced Functionality​
You can control the headless browser by using the API's JS Scenario functionality or the following shortcut query parameters:
- Wait Time: allows you to wait a specific amount of time before returning the response.
- Wait For Selector: allows you to wait for a specific element on the page before returning the response.
- Scroll: Enables you to scroll the page in the y-axis before returning the response so you can scrape pages with infinite scrolls.