Follow Redirects

By default ScrapeOps Proxy API Aggregator follows any redirects the target website uses. However, you can disable this functionality by using the follow_redirects query parameter.

This is useful if you are scraping a website where some pages might redirect to other pages but you don't want to follow the redirect.

To disable Redirect Following, you just need to add follow_redirects=false to your request.

curl -k "https://proxy.scrapeops.io/v1/?api_key=YOUR_API_KEY&url=http://example.com/&follow_redirects=false"

Proxy Selection

Disabling Redirect Following changes which proxy providers and proxy pools that can be used to process your request. If you disable redirect following it might change the selected proxy to one that performs worse than the normally selected proxy. So you should only disable redirect following if you really need to use this functionality.