Possible performance similar to Veracrypt?

Ubergine · November 14, 2024, 4:51am

What is the problem you are having with rclone?

Compared to mounting a Veracrypt volume, mounting a local crypt remote feels different, from directory listing, File Explorer hanging and files taking time to load and open.
Also I noticed that some times copying files to a rclone remote will give me a warning that the file will lose its properties.

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.1

os/version: Microsoft Windows 11 Pro 23H2 (64 bit)
os/kernel: 10.0.22631.4317 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.23.1
go/linking: static
go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Local crypt

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount photos: X:\ --vfs-cache-mode full --vfs-cache-max-size 1G

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[photos]
type = crypt
remote = D:Backup/photos
password = XXX
password2 = XXX

A log from the command that you were trying to run with the `-vv` flag

2024/11/13 23:47:42 DEBUG : rclone: Version "v1.68.1" starting with parameters ["C:\\Windows\\system32\\rclone.exe" "mount" "photos:" "X:\\" "--vfs-cache-mode" "full" "--vfs-cache-max-size" "1G" "-vv"]
2024/11/13 23:47:42 DEBUG : Creating backend with remote "photos:"
2024/11/13 23:47:42 DEBUG : Using config file from "C:\\Users\\xxx\\AppData\\Roaming\\rclone\\rclone.conf"
2024/11/13 23:47:42 DEBUG : Creating backend with remote "D:/Backup/photos"
2024/11/13 23:47:42 DEBUG : fs cache: renaming cache item "D:/Backup/photos" to be canonical "//?/D:/Backup/photos"
2024/11/13 23:47:42 INFO  : Encrypted drive 'photos:': poll-interval is not supported by this remote
[REDACTED - files freed, etc]
2024/11/13 23:47:43 INFO  : vfs cache: cleaned: objects 7 (was 53) in use 0, to upload 0, uploading 0, total size 0 (was 770.282Mi)
2024/11/13 23:47:43 DEBUG : Encrypted drive 'photos:': Init:
2024/11/13 23:47:43 DEBUG : Encrypted drive 'photos:': >Init:
2024/11/13 23:47:43 DEBUG : /: Statfs:
2024/11/13 23:47:43 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:976750079 Bfree:191808839 Bavail:191808839 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: Readlink:
2024/11/13 23:47:43 DEBUG : /: >Readlink: linkPath="", errc=-40
2024/11/13 23:47:43 DEBUG : /: Getxattr: name="non-existant-a11ec902d22f4ec49003af15282d3b00"
2024/11/13 23:47:43 DEBUG : /: >Getxattr: errc=-40, value=""
The service rclone has been started.
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: Opendir:
2024/11/13 23:47:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:43 DEBUG : /: Statfs:
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:976750079 Bfree:191808839 Bavail:191808839 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: Releasedir: fh=0x0
2024/11/13 23:47:43 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: Opendir:
2024/11/13 23:47:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:43 DEBUG : /: Releasedir: fh=0x0
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:43 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:43 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:43 DEBUG : /: Opendir:
2024/11/13 23:47:43 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:43 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:43 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:43 DEBUG : /: Releasedir: fh=0x0
2024/11/13 23:47:43 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:46 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/11/13 23:47:46 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/11/13 23:47:46 DEBUG : /autorun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /autorun.inf: >Getattr: errc=-2
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Opendir:
2024/11/13 23:47:46 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:46 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:46 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:46 DEBUG : /: Releasedir: fh=0x0
2024/11/13 23:47:46 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:46 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Opendir:
2024/11/13 23:47:46 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:46 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:46 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: Statfs:
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:976750079 Bfree:191808839 Bavail:191808839 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2024/11/13 23:47:46 DEBUG : /: Opendir:
2024/11/13 23:47:46 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:46 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:46 DEBUG : /: >Opendir: errc=0, fh=0x1
2024/11/13 23:47:46 DEBUG : /: Releasedir: fh=0x0
2024/11/13 23:47:46 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:46 DEBUG : /: Releasedir: fh=0x1
2024/11/13 23:47:46 DEBUG : /: >Releasedir: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Opendir:
2024/11/13 23:47:46 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:46 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:46 DEBUG : /: >Opendir: errc=0, fh=0x0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2024/11/13 23:47:46 DEBUG : /: >Getattr: errc=0
2024/11/13 23:47:46 DEBUG : /: Opendir:
2024/11/13 23:47:46 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2024/11/13 23:47:46 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2024/11/13 23:47:46 DEBUG : /: >Opendir: errc=0, fh=0x1
The service rclone has been stopped.
2024/11/13 23:48:04 DEBUG : Encrypted drive 'photos:': Destroy:
2024/11/13 23:48:04 DEBUG : Encrypted drive 'photos:': >Destroy:
2024/11/13 23:48:04 DEBUG : Not calling host.Unmount as mount already Destroyed
2024/11/13 23:48:04 DEBUG : Unmounted successfully
2024/11/13 23:48:04 DEBUG : vfs cache: cleaner exiting
2024/11/13 23:48:04 ERROR : X:\: Unmounted rclone mount
2024/11/13 23:48:04 DEBUG : rclone: Version "v1.68.1" finishing with parameters ["C:\\Windows\\system32\\rclone.exe" "mount" "photos:" "X:\\" "--vfs-cache-mode" "full" "--vfs-cache-max-size" "1G" "-vv"]```

asdffdsa · November 14, 2024, 12:50pm

try --vfs-refresh

did not see that in the debug log?

pretty sure that should be D:/Backup/photos

keep in mind, that files in the cache, are stored decrypted.

Ubergine · November 14, 2024, 9:32pm

Sorry, about the warning I meant to say that it was File Explorer that showed it to me sometimes when I try to copy files to an rclone remote.

As for --vfs-refresh, I don't feel a big difference.
To be clear, I am talking about loading thumbnails and being able to scroll in a folder in File Explorer without hitches.
With a Veracrypt drive, the performance feels native and snappy if that makes sense.

asdffdsa · November 14, 2024, 9:38pm

the crypt is local, not sure a cache is needed.
try without --vfs-cache-mode full --vfs-cache-max-size 1G

Ubergine · November 14, 2024, 10:16pm

Yea this helped a bit.
It takes about the same time to thumbnails if not better.

system · December 14, 2024, 10:17pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.