We currently mostly use the high level transfer methods from boto3 to download content which only offers to download whole content into memory or filesystem.
It would be very handy to expose a streaming method that would iterate to fetch the data.
This would be done leveraging the Range options of get_object().
Note from the doc: Amazon S3 doesn't support retrieving multiple ranges of data per GET request.
We currently mostly use the high level transfer methods from boto3 to download content which only offers to download whole content into memory or filesystem.
It would be very handy to expose a streaming method that would iterate to fetch the data.
This would be done leveraging the
Rangeoptions ofget_object().Note from the doc: Amazon S3 doesn't support retrieving multiple ranges of data per GET request.