What is the problem you are having with rclone?
I started using rclone for a corporate backup on Google Drive of roughly 300GB made of a ton of small files. The problem regarding upload speed is not new in the community; I already identified several topics discussing the issue like this, this, this, and tried accordingly to:
- increase the number of
As a result for these, speed has increased in the upload of large files, but the problem of small files is still painfully there, showing years in ETA.
Further suggestions like increasing
--max-backlog and setting
--fast-list don't seem to apply to my case, as I have a problem in pushing a single file of a few bytes in less than 30 seconds.
Therefore, I'm asking if anyone could recommend any specific cloud provider that can increase the thoughput of files in upload. The only pointer to this issue seems calisro's post (@calisro I summon you!), but I'm unsure whether the problem is addressed properly.
What is your rclone version (output from
rclone v1.54.0 - os/arch: windows/amd64 - go version: go1.15.7
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Windows 10, 64 bits
Which cloud storage system are you using? (eg Google Drive)
The command you were trying to run (eg
rclone copy /tmp remote:tmp)
rclone sync Z:/path/to/local/folder remote:/backup/folder --transfers=40 --checkers=40 --tpslimit=10 --bwlimit=9M