Solutions for SAFE and STABLE Uploading? - Windows

C:\rclone>rclone lsd onedrive-crypt: -vv
2024/03/19 16:49:48 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "lsd" "onedrive-crypt:" "-vv"]
2024/03/19 16:49:48 DEBUG : Creating backend with remote "onedrive-crypt:"
2024/03/19 16:49:48 DEBUG : Using config file from "C:\rclone\rclone.conf"
2024/03/19 16:49:48 DEBUG : Creating backend with remote "J:myfolder"
2024/03/19 16:49:48 DEBUG : fs cache: renaming cache item "J:myfolder" to be canonical "//?/J:/myfolder"
-1 2023-07-09 15:47:38 -1 mov
-1 2023-09-23 17:52:41 -1 mu
-1 2023-09-10 17:46:12 -1 pt
-1 2024-01-02 15:17:39 -1 Backup
-1 2023-07-09 15:47:43 -1 show
2024/03/19 16:49:48 DEBUG : 2 go routines active

that does not look good.
post the output of rclone lsd J:/myfolder -vv

C:\rclone>rclone lsd J:/myfolder -vv
2024/03/19 17:04:03 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "lsd" "J:/myfolder" "-vv"]
2024/03/19 17:04:03 DEBUG : Creating backend with remote "J:/myfolder"
2024/03/19 17:04:03 DEBUG : Using config file from "C:\\rclone\\rclone.conf"
2024/03/19 17:04:04 DEBUG : fs cache: renaming cache item "J:/myfolder" to be canonical "//?/J:/myfolder"
          -1 2023-07-09 15:47:38        -1 mov
          -1 2023-09-23 17:52:41        -1 mu
          -1 2023-09-10 17:46:12        -1 pt
          -1 2024-01-02 15:17:39        -1 Backup
          -1 2023-07-09 15:47:43        -1 show
2024/03/19 17:04:04 DEBUG : 3 go routines active

I added //?/J:/myfolder to the rclone.conf file and now that fs cache renaming no longer appears

for now, do not use rclone mount, need to KILL all mount commands.

for onedrive-crypt, the config is wrong
you are telling rclone to save crypt files to local drive letter J:

onedrive-crypt should point to a folder inside onedrive
remote = onedrive:crypt

yes, I needed to keep only that folder encrypted, and not everything on disk J (onedrive)

KILL all

need to kill all mount commands

after that, post the output of rclone lsd onedrive: -vv

C:\rclone>rclone lsd onedrive: -vv
2024/03/19 17:18:28 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "lsd" "onedrive:" "-vv"]
2024/03/19 17:18:28 DEBUG : Creating backend with remote "onedrive:"
2024/03/19 17:18:28 DEBUG : Using config file from "C:\rclone\rclone.conf"
-1 2024-02-02 19:38:20 0 App
-1 2023-07-09 15:51:45 5 myfolder
2024/03/19 17:18:28 DEBUG : 4 go routines active

ok, we are making good progress

try this remote

[onedrive-crypt]
type = crypt
remote = onedrive:myfolder
filename_encryption = obfuscate
directory_name_encryption = false
password = PASSS
password2 = PASSS

and post the output of
rclone lsd onedrive-crypt: -vv

C:\rclone>rclone lsd onedrive-crypt: -vv
2024/03/19 17:23:01 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "lsd" "onedrive-crypt:" "-vv"]
2024/03/19 17:23:01 DEBUG : Creating backend with remote "onedrive-crypt:"
2024/03/19 17:23:01 DEBUG : Using config file from "C:\rclone\rclone.conf"
2024/03/19 17:23:01 DEBUG : Creating backend with remote "onedrive:myfolder"
-1 2023-07-09 15:47:38 11 mov
-1 2023-09-23 17:52:41 5 mu
-1 2023-09-10 17:46:12 6 pt
-1 2024-01-02 15:17:39 14 Backup
-1 2023-07-09 15:47:43 121 show
2024/03/19 17:23:01 DEBUG : 4 go routines active

ok, good, we found the files and fixed the config of onedrive-crypt:

now, let's try a mount command, post the output of
rclone onedrive-crypt: H: --vfs-cache-mode=full --vfs-cache-max-age=4h --vfs-cache-max-size=12G --cache-dir c:\rclone\temp --log-level=DEBUG

since it is encrypted it is not necessary to also start onedrive: ?

no need for that.

now, run that mount command and post the full output

C:\rclone>rclone mount onedrive-crypt: H: --vfs-cache-mode=full --vfs-cache-max-age=4h --vfs-cache-max-size=12G --cache-dir c:\rclone\temp --log-level=DEBUG
2024/03/19 17:29:40 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "mount" "onedrive-crypt:" "H:" "--vfs-cache-mode=full" "--vfs-cache-max-age=4h" "--vfs-cache-max-size=12G" "--cache-dir" "c:\\rclone\\temp" "--log-level=DEBUG"]
2024/03/19 17:29:40 DEBUG : Creating backend with remote "onedrive-crypt:"
2024/03/19 17:29:40 DEBUG : Using config file from "C:\\rclone\\rclone.conf"
2024/03/19 17:29:40 DEBUG : Creating backend with remote "onedrive:myfolder"
2024/03/19 17:29:40 DEBUG : OneDrive root 'myfolder': Next delta token is: TOOOKEN
2024/03/19 17:29:40 DEBUG : vfs cache: root is "c:\\rclone\\temp"
2024/03/19 17:29:40 DEBUG : vfs cache: data root is "\\\\?\\c:\\rclone\\temp\\vfs\\onedrive-crypt"
2024/03/19 17:29:40 DEBUG : vfs cache: metadata root is "\\\\?\\c:\\rclone\\temp\\vfsMeta\\onedrive-crypt"
2024/03/19 17:29:40 DEBUG : Creating backend with remote "c:/rclone/temp/vfs/onedrive-crypt/"
2024/03/19 17:29:40 DEBUG : fs cache: renaming cache item "c:/rclone/temp/vfs/onedrive-crypt/" to be canonical "//?/c:/rclone/temp/vfs/onedrive-crypt"
2024/03/19 17:29:40 DEBUG : Creating backend with remote "c:/rclone/temp/vfsMeta/onedrive-crypt/"
2024/03/19 17:29:40 DEBUG : fs cache: renaming cache item "c:/rclone/temp/vfsMeta/onedrive-crypt/" to be canonical "//?/c:/rclone/temp/vfsMeta/onedrive-crypt"
2024/03/19 17:29:40 DEBUG : Network mode mounting is disabled
2024/03/19 17:29:40 DEBUG : Mounting on "H:" ("onedrive-crypt")
2024/03/19 17:29:40 DEBUG : Encrypted drive 'onedrive-crypt:': Mounting with options: ["-o" "attr_timeout=1" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "-o" "volname=onedrive-crypt"]
2024/03/19 17:29:40 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2024/03/19 17:29:40 DEBUG : Encrypted drive 'onedrive-crypt:': Init:
2024/03/19 17:29:40 DEBUG : Encrypted drive 'onedrive-crypt:': >Init:
2024/03/19 17:29:40 DEBUG : /: Statfs:
2024/03/19 17:29:40 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:1342177280 Bfree:0 Bavail:0 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Readlink:
2024/03/19 17:29:40 DEBUG : /: >Readlink: linkPath="", errc=-40
2024/03/19 17:29:40 DEBUG : /: Getxattr: name="non-existant-a11ec902d22f4ec49003af15282d3b00"
2024/03/19 17:29:40 DEBUG : /: >Getxattr: errc=-40, value=""
The service rclone has been started.
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Opendir:
2024/03/19 17:29:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:40 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:40 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:40 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:40 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:40 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:40 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Opendir:
2024/03/19 17:29:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:40 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:40 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:40 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:40 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:40 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:40 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:40 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:40 DEBUG : /: Opendir:
2024/03/19 17:29:40 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:40 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:40 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:40 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:40 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:40 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:40 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:43 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/03/19 17:29:43 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/03/19 17:29:43 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Opendir:
2024/03/19 17:29:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:43 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:43 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:43 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:43 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Opendir:
2024/03/19 17:29:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:43 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:43 DEBUG : /: Statfs:
2024/03/19 17:29:43 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:1342177280 Bfree:0 Bavail:0 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/03/19 17:29:43 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:43 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Opendir:
2024/03/19 17:29:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:43 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:43 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Opendir:
2024/03/19 17:29:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:43 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:43 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:29:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:29:43 DEBUG : /: >Getattr: errc=0
2024/03/19 17:29:43 DEBUG : /: Opendir:
2024/03/19 17:29:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:29:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:29:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:29:43 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:29:43 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:29:43 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:29:43 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:30:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:30:14 DEBUG : /: >Getattr: errc=0
2024/03/19 17:30:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:30:14 DEBUG : /: >Getattr: errc=0
2024/03/19 17:30:14 DEBUG : /: Opendir:
2024/03/19 17:30:14 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:30:14 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:30:14 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:30:14 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:30:14 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:30:14 DEBUG : /: Statfs:
2024/03/19 17:30:14 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:1342177280 Bfree:0 Bavail:0 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/03/19 17:30:14 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:30:14 DEBUG : /: >Releasedir: errc=0
2024/03/19 17:30:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:30:14 DEBUG : /: >Getattr: errc=0
2024/03/19 17:30:14 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/03/19 17:30:14 DEBUG : /: >Getattr: errc=0
2024/03/19 17:30:14 DEBUG : /: Opendir:
2024/03/19 17:30:14 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/03/19 17:30:14 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/03/19 17:30:14 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/03/19 17:30:14 DEBUG : /: Getpath: Getpath fh=0
2024/03/19 17:30:14 DEBUG : /: >Getpath: errc=0, normalisedPath=""
2024/03/19 17:30:14 DEBUG : /: Releasedir: fh=0x0
2024/03/19 17:30:14 DEBUG : /: >Releasedir: errc=0

ok, good, everything should be working now.

1 Like

Great, now it seems that Sync via "rclone browser" is working.
A little slow considering that the server has 10gbps and is downloading at only 80mbps with peaks at 180mbps.

Alright, I'm not looking at this for now (if you have a solution, welcome)

Can I still use the double disc?
Or do you have better ideas for good optimization between streaming (cache) and upload (no cache)?

I'm waiting for the upload to finish... I'll update you

Update:

Upload done perfectly.
At the end it does not continue to send data...
I checked the /temp/ folder and there don't appear to be any cache files. Very good!

So is the streaming mount I had before OK for me?

To be sure, I'll also try using Windows file explorer, I want to see if there are any differences.

Update:

He tells me I have no space on the disk (onedrive).
Actually now I don't see the occupied space.
Is there any way to solve it?

Delete some files - probably thrash. Problem with OneDrive Business is that thrash content counts against your quota so from time to time you have to clear it manually.

I'm sorry, it doesn't work.
it still gives me 0 bytes.
Now I try to restart the server, but I still have 2 terabytes free.

what is the output of rclone about onedrive: -vv ?

what is He?
rclone, onedrive website or what?

C:\rclone>rclone about onedrive: -vv
2024/03/19 17:54:23 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "about" "onedrive:" "-vv"]
2024/03/19 17:54:23 DEBUG : Creating backend with remote "onedrive:"
2024/03/19 17:54:23 DEBUG : Using config file from "C:\rclone\rclone.conf"
Total: 5 TiB
Used: 5.160 TiB
Free: 0 B
Trashed: 0 B
2024/03/19 17:54:23 DEBUG : 4 go routines active

not correct...

log into the onedrive website and check the total size.