@Omini yes, I just tried this way too, it still seems to cut-off at 1,000,000 bytes, so it wasn't related to breaking due to content etc, it still seems to be a data length / quota memory problem
@Fox Is there a page with more information on the http redirect checkbox and what it does?
If the server response status implies redirection to another url, for example 302 https://en.wikipedia.org/wiki/HTTP_302 , then the action will load the url from the location header
If anyone has this problem add a HTTP client reset at the beginning of your script. HTTP client seems to get clogged at a certain point. Issue resolved.