What is the problem you are having with rclone?
Extremely slow download speeds for multiple clients. Had this issue for a good few months now and finally need to make a forum request to help me solve it. These systems, no matter what state they are in operationally, are brand new Ubuntu 20.04 systems.
Someone told me there is a user agent parameter I can do? I don't know how to do this.
The configuration is:
- Rclone configured using remote option 31) OneDrive
- Configuring it with headless, all options default.
- Then going to my PC, running rclone authorize onedrive. Put token in console of headless dedi.
- Finish setup.
- Upload 100GB file - Normal, about 10MB a second, not hugely concerning, and I don't really care. It's for backups so not bothered by it.
- Downloading the file - Oh boy - 1/2MB a second? Seriously? How do I solve this. This is urgent and a client can't get their backup unless they wait 10 hours+.
Run the command 'rclone version' and share the full output of the command.
root@S01:~# rclone version
rclone v1.62.2
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.4.0-146-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.2
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
OneDrive/SharePoint for business.
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy -vv backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969/c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz .
The rclone config contents with secrets removed.
[backups]
type = onedrive
token = {"access_token":"xxxxxx","expiry":"2023-04-12T12:52:43.131815796-04:00"}
drive_id = xxxx
drive_type = documentLibrary
A log from the command with the -vv
flag
root@S01:/var/lib/pterodactyl/volumes/c693131a-d0fa-49ad-9e37-a2ed69e33969# rclone copy -vv backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969/c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz .
2023/04/12 11:29:35 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "copy" "-vv" "backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969/c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz" "."]
2023/04/12 11:29:35 DEBUG : Creating backend with remote "backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969/c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz"
2023/04/12 11:29:35 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/04/12 11:29:37 DEBUG : fs cache: adding new entry for parent of "backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969/c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz", "backups:S01/servers/c693131a-d0fa-49ad-9e37-a2ed69e33969"
2023/04/12 11:29:37 DEBUG : Creating backend with remote "."
2023/04/12 11:29:37 DEBUG : fs cache: renaming cache item "." to be canonical "/var/lib/pterodactyl/volumes/c693131a-d0fa-49ad-9e37-a2ed69e33969"
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: Need to transfer - File not found at Destination
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: Starting multi-thread copy with 4 parts of size 26.255Gi
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: multi-thread copy: stream 4/4 (84572700672-112763543739) size 26.255Gi starting
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: multi-thread copy: stream 3/4 (56381800448-84572700672) size 26.255Gi starting
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: multi-thread copy: stream 2/4 (28190900224-56381800448) size 26.255Gi starting
2023/04/12 11:29:38 DEBUG : c693131a-d0fa-49ad-9e37-a2ed69e33969_12-04-23.tgz: multi-thread copy: stream 1/4 (0-28190900224) size 26.255Gi starting
2023/04/12 11:30:37 INFO :
Transferred: 188.406 MiB / 105.019 GiB, 0%, 2.998 MiB/s, ETA 9h56m51s
Transferred: 0 / 1, 0%
Elapsed time: 1m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 0% /105.019Gi, 2.998Mi/s, 9h56m51s
2023/04/12 11:31:37 INFO :
Transferred: 366.672 MiB / 105.019 GiB, 0%, 2.938 MiB/s, ETA 10h7m57s
Transferred: 0 / 1, 0%
Elapsed time: 2m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 0% /105.019Gi, 2.938Mi/s, 10h7m57s
2023/04/12 11:32:37 INFO :
Transferred: 549.016 MiB / 105.019 GiB, 1%, 2.935 MiB/s, ETA 10h7m34s
Transferred: 0 / 1, 0%
Elapsed time: 3m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 0% /105.019Gi, 2.935Mi/s, 10h7m34s
2023/04/12 11:33:37 INFO :
Transferred: 725.500 MiB / 105.019 GiB, 1%, 2.927 MiB/s, ETA 10h8m10s
Transferred: 0 / 1, 0%
Elapsed time: 4m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 0% /105.019Gi, 2.927Mi/s, 10h8m10s
2023/04/12 11:34:37 INFO :
Transferred: 904.203 MiB / 105.019 GiB, 1%, 2.945 MiB/s, ETA 10h3m29s
Transferred: 0 / 1, 0%
Elapsed time: 5m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 0% /105.019Gi, 2.945Mi/s, 10h3m29s
2023/04/12 11:35:37 INFO :
Transferred: 1.057 GiB / 105.019 GiB, 1%, 2.926 MiB/s, ETA 10h6m28s
Transferred: 0 / 1, 0%
Elapsed time: 6m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 1% /105.019Gi, 2.926Mi/s, 10h6m28s
2023/04/12 11:36:37 INFO :
Transferred: 1.234 GiB / 105.019 GiB, 1%, 2.997 MiB/s, ETA 9h51m5s
Transferred: 0 / 1, 0%
Elapsed time: 7m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 1% /105.019Gi, 2.997Mi/s, 9h51m5s
2023/04/12 11:37:37 INFO :
Transferred: 1.413 GiB / 105.019 GiB, 1%, 3.118 MiB/s, ETA 9h27m6s
Transferred: 0 / 1, 0%
Elapsed time: 8m2.5s
Transferring:
* c693131a-d0fa-49ad-9e3…d69e33969_12-04-23.tgz: 1% /105.019Gi, 3.118Mi/s, 9h27m6s
ETC, 10 hours or so.