Scroll Page
The ScrapeOps Proxy API Aggregator enables you to tell the headless browser to scroll the page before returning the HTML response.
This is useful if you are scraping websites that use infinite scrolling to load more data onto the page.
To enable the ScrapeOps Proxy's Page Scrolling Functionality, you just need to add the scroll
query parameter to your request, along with the number of pixels you want to scroll down in the y-axis.
For example, adding scroll=2000
to the request will tell the headless browser to scroll down 2,000 pixels before returning the HTML response.
curl -k "https://proxy.scrapeops.io/v1/?api_key=YOUR_API_KEY&url=http://example.com/&scroll=2000"
Adding a scroll
to the request will automatically enable a headless browser (equivalent to adding render_js=true
to the request). Using the Headless Browser functionality will consume 10 API Credits.