I'm using Windows 10 and rclone, rclone mount with Google drive. The remote and mount seem to work fine, I can browse and open files. But when I copy files to the mounted drive, the speed is good at first, then slows down to barely anything, then I get file copy errors e.g access denied.
I'm using my own client id. I see no 'ERROR' lines in the log file.
2020/01/04 16:48:01 INFO : Cleaned the cache: objects 6 (was 6), total size 4.367G (was 4.367G)
2020/01/04 16:48:08 INFO : Media/Movies/Journey To Le Mans (2014)/Journey To Le Mans (2014).nfo: Copied (new)
2020/01/04 16:48:11 INFO : Media/Movies/Journey To Le Mans (2014)/Journey To Le Mans (2014).nfo: Copied (replaced existing)
2020/01/04 16:49:01 INFO : Cleaned the cache: objects 9 (was 9), total size 13.064G (was 4.367G)
which I assume is normal? This is on initial copy.
Didn't help. Still getting errors. I'd put those lines in an effort to rate limit the calls, should I use a different value.
I got a reply on reddit which says rclone mount is unstable and shouldn't be used.
Since my current solution clearly isn't working, what do you recommend for copying data to the remote?
The error I get is in Windows Explorer and its usually 'error 5 access denied', its a dialog box that has to be acted on. I chose retry and it seems to work.
I have a lot of data to copy and I'm doing it in batches. rclone won't even create directories so its a major pain to use rclone copy, esp on Windows since you can't script it. I like the idea of mount - and it has a built in cache, retry mechanisms etc. But if mount is only recommended for reads then shouldn't this be documented?
What is the recommended way to use rclone copy to copy a large amount of data and making it work with retires/reboots etc.
e.g. I did 'rclone copy --dry-run xxxx' for a folder that exists and it didn't tell me that nothing would be copied, which I'd assumed it would.
i do not use rclone mount for copying files, i always use rclone copy or rclone sync.
but when i do use mount and copy files, i use a very simple command such as rclone.exe mount wasabieast2:en07 b:\mount\test\
and i get reliable, fast uploads
you can see the upload speed increases over time, does not decrease.
if you use rclone copy and the machine reboots or something happens, just re-run the command.
each time rclone copy is run, it compares the local file system to the cloud and only uploads files that are not already uploaded.
I've started using rclone copy from command prompt. Still don't like it as much as rclone mount which gives a drive letter that you can then use with many utilities, but I never got the mount to work reliably with writes. I don't know if this is a Windows specific issue.
Also I had to ignore mod times in the rclone copy flags as otherwise files always get copied.
sure you can script rclone, very easy to do.
what makes you think you cannot script rclone on windows?
if you want to copy files from local to cloud using a mount, have you tried my suggestion, to remove ALL flags. as i demonstrated, no flags are needed for simple file copying
as another test,
using rclone.exe mount wasabieast2:zztest02 b:\mount\test\
i used secondcopy to copy 1.3GB to a folder named vdib on wasabi.
i set secondcopy to do a byte-for-byte verification of all files.
did the same with doublecommander, to a folder named vdib2, with verification.
then i used dummy file creater to create a 4GB file.
then i create .md5 checksum files on the local and compared that to the mount.
then i ran wiztree
in all cases, no problems at all
keep in mind that if you if you using rclone to backup files to cloud and use a mount.
if your computer is infected with ransomware, then that ransomware will see the mount and encrypt all those files.