Omitted
(Omitted)
1
I’m running a VM for rclone and have 6cores/8gb ram on 10gb HDD provisioned. I run the following command:
rclone copy /mnt/foldera crypt:folderb --transfers=10 --drive-chunk-size=1G --drive-upload-cutoff=1G --drive-use-trash --stats=15s -vv
After running for a bit I get an error saying Killed. Nothing more in the log.
Here is the last transfer log:
Transferred: 6.499 GBytes (69.570 MBytes/s)
Errors: 0
Checks: 131
Transferred: 1
Elapsed time: 1m35.6s
And here is what it says right afterwards
2017/04/08 20:49:27 INFO : fileaaaa.gz: Copied (new)
Killed
Does anyone know why it dies. I guess I’m not understanding the drive chunk / upload cutoff? If I set it lower to 512M or 256M it doesn’t occur.
KaMoS
2
I’ve had this before. Reduce your transfers to 5 or use the default (4).
Omitted
(Omitted)
3
Do you know what the issue is? Why does it happen. Is it related to transfer numbers or the drive-chunk / upload-cutoff settings?
ncw
(Nick Craig-Wood)
4
This is the size of chunks buffered in memory before uploading. So setting this to 1G will use --transfers
* 1G of memory at least!
Set it much smaller would be my advice.[quote=“Omitted, post:1, topic:1672”]
–drive-upload-cutoff=1G
[/quote]
What you are saying here is don’t used chunked upload for files < 1 GB. I wouldn’t bother changing this particularly.
Omitted
(Omitted)
5
Thanks, that explains it very clearly!