Bulk copying leading to fulldisk

Help and Support
1

What is the problem you are having with rclone?

I'm am copying 7TB's of data from GSuite over to MEGA. After a few hours of copying, I end up with a full disk that I believe is due to the RCLONE cache (but maybe not).

If it is the cache, how can I turn-off caching while I'm copying/moving files around to prevent this?
Thanks.

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0

  • os/version: ubuntu 20.04 (64 bit)

Which cloud storage system are you using? (eg Google Drive)

Google Drive moving over to MEGA

2

hi,

hard to know without the exact command(s) you are running?
i assume rclone mount?

mega, as with onedrive, does not support stream uploads, perhaps, perchance, maybe forcing the use of temp files?

this will list the directories that rclone uses
rclone config paths

3

and at some point, might try
rclone selfupdate

4

I understand what you are saying with no stream uploads to MEGA. The rclone mount string is below.

rclone mount --allow-other --vfs-cache-mode full --vfs-cache-max-size 5000M mega: /mnt/mega/ &

5

can use something like, rclone copy /source mega:

otherwise, if you must use rclone mount, in theory, this needs to be tested

  1. based on rclone docs, some webdav servers can support stream uploads
  2. megacmd can emulate a webdav server and maybe it supports steam uploads

so could test:

  1. create a rclone remote pointing to the megacmd webdav server
  2. rclone mount to that remote or most operating systems can mount webdav to a local mountpoint or drive letter.
6

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.