Hello,
I am pretty new to linux, trying to automate daily backups. I've been successful using this tool, thank you very much for providing it. My question is if I can improve the transfer speed somehow.
...
Transferred: 1.085 GiB / 1.085 GiB, 100%, 12.533 KiB/s, ETA 0s
Transferred: 4056 / 4056, 100%
Elapsed time: 38m11.6s
...
If I just do a standard copy paste, command from my windows pc, from server mapped drive, to linked google drive desktop, it takes about 60 seconds.
Google Drive and small files is horrific. You can only create about 2 per second so it's going to be not great. Best bet is to compress/zip/tar things prior to transferring or if you have a ton a of files, you can't do anything else other than wait it out as it's a limit of the API.
As the other poster said, maybe group and compress files.
Seeing as you could do the same thing in 60sec on another environment.... Maybe try adding --transfers 96 and --checkers 96. I found that the defaults of 4 are very conservative when dealing with small files.
rclone is not a backup software. You will have much better experience (including speed) using more appropriate tools like restic or kopia - both actually use rclone for some cloud providers. They deduplicate, compress and aggregate small files into bigger chunks - something rclone does not. Rclone is fantastic and very capable tool to transfer files to/from/between clouds/local.