What is the problem you are having with rclone?
I need to optimise the downloads from AWS S3 given I have to copy a little more than 10 thousand files of 10GiB each.
Run the command 'rclone version' and share the full output of the command.
$ rclone version
rclone v1.66.0
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-78-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.1
- go/linking: static
- go/tags: none
$
Which cloud storage system are you using? (eg Google Drive)
AWS S3
The command you were trying to run (eg rclone copy /tmp remote:tmp)
sudo rclone --transfers=5 --config=$HOME/.config/rclone/rclone.conf --log-level INFO copy -P S3_Remote:sourceBucket /mnt/destination/
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
$ rclone config redacted
[S3_Remote]
type = s3
provider = AWS
env_auth = false
access_key_id = XXX
secret_access_key = XXX
region = eu-west-1
endpoint = s3.amazonaws.com
### Double check the config for sensitive info before posting publicly
$
A log from the command that you were trying to run with the -vv flag
Paste log here