Any config recommendation for massive copy from GDrive to Dropbox (encrypted). Cache is killing me

Help and Support
1

Hi!

I'm copying all my stuff from GDrive to an encrypted drive linked to Dropbox. I'm using RCLONE in Windows 10. The thing is that i have a small HDD, i have only 100Gb to cache any content locally. I tried many caching options but the cache continues filing up until runs out of space the computer, no matter which option i use. I tried also disabling the cache but i got many IO Errors and corrupted files in this case.

I'm using this config:

--vfs-cache-mode=writes --vfs-cache-max-age=10m --vfs-cache-max-size=1G --vfs-read-chunk-size=32M --dir-cache-time=12m --buffer-size=16M --cache-dir C:\rclone_temps_DB101_CRYPT

any suggestion to make the transfer smoothly between units? I'm getting tired of clear cache manually after 150-200gb transfers :frowning:

Thanks

2

use rclone copy instead of rclone mount

rclone copy does not use cache, so does not use HDD.

1 Like
3

Thanks, i'm just trying this method now, i'll post later how's going

4

can test using --dry-run

5

rclone copy is the way to go, I'm currently doing the same. I'm also doing the copy between the raw remotes, rather than the crypt, I don't know if it makes any difference to throughput but figured that way I wouldn't waste CPU cycles on decrypting/encrypting during the copy process.

root@localhost:/# rclone -P copy gdrive:crypt/fnge5pt8ld4gqfogdn05m9kpoc dropbox:crypt/fnge5pt8ld4gqfogdn05m9kpoc
Transferred:        5.829 TiB / 5.829 TiB, 100%, 20.388 MiB/s, ETA 0s
Transferred:         2731 / 2731, 100%
Elapsed time:  1d3h13m33.0s
6

yeah, good it is working out for you.

that is the way to do it.

should use exact remote specified in your config file, which you never posted?
tho, not saying what you did will not work

7

Thanks, this is what i was looking for.

8

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.