What is the problem you are having with rclone?
Slow perfomance when copy / sync from local to on-premise minio
I get 78.8MB/s 00:13 via scp
and mc copy gives me a hard to belive
time /root/mc cp test.img minio:mediacache
test.img: 1.00 GiB / 1.00 GiB ┃▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓┃ 1.75 GiB/s 0s
real 0m0.595s
What is your rclone version (output from rclone version)
rclone v1.52.3
- os/arch: linux/amd64
- go version: go1.14.7
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Linux nas01 4.9.0-4-amd64 #1 SMP Debian 4.9.65-3+deb9u1 (2017-12-23) x86_64 GNU/Linux
Which cloud storage system are you using? (eg Google Drive)
on-premise minio cluster 3 nodes, 18 disks
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copy test.img minio:mediacache/
The rclone config contents with secrets removed.
[minio]
type = s3
env_auth = false
access_key_id = minio
secret_access_key = secret
region = us-east-1
endpoint = http://192.168.252.11:9000
location_constraint =
server_side_encryption =
A log from the command with the -vv flag
2020/08/28 12:40:36 DEBUG : rclone: Version "v1.52.3" starting with parameters ["rclone" "copy" "test.img" "minio:mediacache/" "-v" "-v"]
2020/08/28 12:40:36 DEBUG : Using config file from "/root/.rclone.conf"
2020/08/28 12:40:36 DEBUG : fs cache: adding new entry for parent of "test.img", "/mnt/storage"
2020/08/28 12:40:36 DEBUG : fs cache: renaming cache item "minio:mediacache/" to be canonical "minio:mediacache"
2020/08/28 12:40:36 DEBUG : test.img: Need to transfer - File not found at Destination
2020/08/28 12:40:39 DEBUG : test.img: multipart upload starting chunk 1 size 5M offset 0/1G
2020/08/28 12:40:39 DEBUG : test.img: multipart upload starting chunk 2 size 5M offset 5M/1G
2020/08/28 12:40:39 DEBUG : test.img: multipart upload starting chunk 3 size 5M offset 10M/1G
2020/08/28 12:40:39 DEBUG : test.img: multipart upload starting chunk 4 size 5M offset 15M/1G
2020/08/28 12:40:40 DEBUG : test.img: multipart upload starting chunk 5 size 5M offset 20M/1G
2020/08/28 12:40:41 DEBUG : test.img: multipart upload starting chunk 6 size 5M offset 25M/1G
2020/08/28 12:40:41 DEBUG : test.img: multipart upload starting chunk 7 size 5M offset 30M/1G
2020/08/28 12:40:42 DEBUG : test.img: multipart upload starting chunk 8 size 5M offset 35M/1G
2020/08/28 12:40:42 DEBUG : test.img: multipart upload starting chunk 9 size 5M offset 40M/1G
2020/08/28 12:40:43 DEBUG : test.img: multipart upload starting chunk 10 size 5M offset 45M/1G
...
2020/08/28 12:42:55 DEBUG : test.img: multipart upload starting chunk 170 size 5M offset 845M/1G
2020/08/28 12:42:55 DEBUG : test.img: multipart upload starting chunk 171 size 5M offset 850M/1G
2020/08/28 12:42:56 DEBUG : test.img: multipart upload starting chunk 172 size 5M offset 855M/1G
2020/08/28 12:42:56 DEBUG : test.img: multipart upload starting chunk 173 size 5M offset 860M/1G
2020/08/28 12:42:57 DEBUG : test.img: multipart upload starting chunk 174 size 5M offset 865M/1G
2020/08/28 12:42:58 DEBUG : test.img: multipart upload starting chunk 175 size 5M offset 870M/1G
2020/08/28 12:42:58 DEBUG : test.img: multipart upload starting chunk 176 size 5M offset 875M/1G
2020/08/28 12:43:00 DEBUG : test.img: multipart upload starting chunk 177 size 5M offset 880M/1G
2020/08/28 12:43:02 DEBUG : test.img: multipart upload starting chunk 178 size 5M offset 885M/1G
2020/08/28 12:43:02 DEBUG : test.img: multipart upload starting chunk 179 size 5M offset 890M/1G
2020/08/28 12:43:03 DEBUG : test.img: multipart upload starting chunk 180 size 5M offset 895M/1G
2020/08/28 12:43:03 DEBUG : test.img: multipart upload starting chunk 181 size 5M offset 900M/1G
2020/08/28 12:43:04 DEBUG : test.img: multipart upload starting chunk 182 size 5M offset 905M/1G
2020/08/28 12:43:04 DEBUG : test.img: multipart upload starting chunk 183 size 5M offset 910M/1G
2020/08/28 12:43:07 DEBUG : test.img: multipart upload starting chunk 184 size 5M offset 915M/1G
2020/08/28 12:43:09 DEBUG : test.img: multipart upload starting chunk 185 size 5M offset 920M/1G
2020/08/28 12:43:10 DEBUG : test.img: multipart upload starting chunk 186 size 5M offset 925M/1G
2020/08/28 12:43:13 DEBUG : test.img: multipart upload starting chunk 187 size 5M offset 930M/1G
2020/08/28 12:43:13 DEBUG : test.img: multipart upload starting chunk 188 size 5M offset 935M/1G
2020/08/28 12:43:14 DEBUG : test.img: multipart upload starting chunk 189 size 5M offset 940M/1G
2020/08/28 12:43:15 DEBUG : test.img: multipart upload starting chunk 190 size 5M offset 945M/1G
2020/08/28 12:43:15 DEBUG : test.img: multipart upload starting chunk 191 size 5M offset 950M/1G
2020/08/28 12:43:16 DEBUG : test.img: multipart upload starting chunk 192 size 5M offset 955M/1G
2020/08/28 12:43:16 DEBUG : test.img: multipart upload starting chunk 193 size 5M offset 960M/1G
2020/08/28 12:43:17 DEBUG : test.img: multipart upload starting chunk 194 size 5M offset 965M/1G
2020/08/28 12:43:17 DEBUG : test.img: multipart upload starting chunk 195 size 5M offset 970M/1G
2020/08/28 12:43:18 DEBUG : test.img: multipart upload starting chunk 196 size 5M offset 975M/1G
2020/08/28 12:43:18 DEBUG : test.img: multipart upload starting chunk 197 size 5M offset 980M/1G
2020/08/28 12:43:19 DEBUG : test.img: multipart upload starting chunk 198 size 5M offset 985M/1G
2020/08/28 12:43:19 DEBUG : test.img: multipart upload starting chunk 199 size 5M offset 990M/1G
2020/08/28 12:43:20 DEBUG : test.img: multipart upload starting chunk 200 size 5M offset 995M/1G
2020/08/28 12:43:20 DEBUG : test.img: multipart upload starting chunk 201 size 5M offset 1000M/1G
2020/08/28 12:43:21 DEBUG : test.img: multipart upload starting chunk 202 size 5M offset 1005M/1G
2020/08/28 12:43:21 DEBUG : test.img: multipart upload starting chunk 203 size 5M offset 1010M/1G
2020/08/28 12:43:22 DEBUG : test.img: multipart upload starting chunk 204 size 5M offset 1015M/1G
2020/08/28 12:43:22 DEBUG : test.img: multipart upload starting chunk 205 size 4M offset 1020M/1G
2020/08/28 12:43:25 DEBUG : test.img: MD5 = cd573cfaace07e7949bc0c46028904ff OK
2020/08/28 12:43:25 INFO : test.img: Copied (new)
2020/08/28 12:43:25 INFO :
Transferred: 1G / 1 GBytes, 100%, 6.029 MBytes/s, ETA 0s
Transferred: 1 / 1, 100%
Elapsed time: 2m49.8s
2020/08/28 12:43:25 DEBUG : 11 go routines active