What is the problem you are having with rclone?
I'm am copying 7TB's of data from GSuite over to MEGA. After a few hours of copying, I end up with a full disk that I believe is due to the RCLONE cache (but maybe not).
If it is the cache, how can I turn-off caching while I'm copying/moving files around to prevent this?
Thanks.
Run the command 'rclone version' and share the full output of the command.
rclone v1.57.0
os/version: ubuntu 20.04 (64 bit)
Which cloud storage system are you using? (eg Google Drive)
Google Drive moving over to MEGA
asdffdsa
(jojothehumanmonkey)
July 20, 2023, 8:21pm
2
hi,
mahjohn:
but maybe not
hard to know without the exact command(s) you are running?
i assume rclone mount
?
mega, as with onedrive, does not support stream uploads, perhaps, perchance, maybe forcing the use of temp files?
this will list the directories that rclone uses
rclone config paths
your rclone mount command is not using cache. your logs show that.
the cache is the not problem.
the problem is that rclone does not support streamed uploads for onedrive, so rclone needs to create a temp file.
note: rclone copy does not that have problem.
gdrive supports streamed uploads, onedrive does NOT support streamed uploads.
basically, when you copy a file into the mount without using cache, rclone does not know the file size,
so this is the sequence of events.
you copy source f…
asdffdsa
(jojothehumanmonkey)
July 20, 2023, 8:22pm
3
and at some point, might try
rclone selfupdate
asdffdsa:
rclone selfupdate
I understand what you are saying with no stream uploads to MEGA. The rclone mount string is below.
rclone mount --allow-other --vfs-cache-mode full --vfs-cache-max-size 5000M mega: /mnt/mega/ &
asdffdsa
(jojothehumanmonkey)
July 24, 2023, 8:03pm
5
can use something like, rclone copy /source mega:
otherwise, if you must use rclone mount
, in theory, this needs to be tested
based on rclone docs, some webdav servers can support stream uploads
megacmd
can emulate a webdav server and maybe it supports steam uploads
so could test:
create a rclone remote pointing to the megacmd webdav server
rclone mount
to that remote or most operating systems can mount webdav to a local mountpoint or drive letter.
system
(system)
Closed
August 23, 2023, 8:04pm
6
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.