Accessing file metadata via Rclone Mount is extremely slow (both Windows Explorer and PowerShell)

I tried the VFS cache preload via --rc, and it did not make a difference.

Also tried an Ubuntu Linux 21.10 Impish Indri VM, same problem.

Can you post a debug log from the machine? You haven't been able to share a log that didn't have some explorer action in it so not quite sure what the same problem would be since there isn't an explorer on Linux.

Here's the log from Impish ... snipped because these messages are just repeating for all the files.

2022/02/04 15:44:47 DEBUG : rclone: Version "v1.53.3-DEV" starting with parameters ["rclone" "mount" "--config=rclone.config" "filebase:trevor" "data" "-vv" "--log-file" "log.log"]
2022/02/04 15:44:47 DEBUG : Creating backend with remote "filebase:trevor"
2022/02/04 15:44:47 DEBUG : Using config file from "/home/ubuntu/rclone.config"
2022/02/04 15:44:47 INFO  : S3 bucket trevor: poll-interval is not supported by this remote
2022/02/04 15:44:47 DEBUG : S3 bucket trevor: Mounting on "data"
2022/02/04 15:44:47 DEBUG : : Root: 
2022/02/04 15:44:47 DEBUG : : >Root: node=/, err=<nil>
2022/02/04 15:44:51 DEBUG : /: Attr: 
2022/02/04 15:44:51 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/02/04 15:44:51 DEBUG : /: ReadDirAll: 
2022/02/04 15:44:53 DEBUG : /: >ReadDirAll: item=381, err=<nil>
2022/02/04 15:44:53 DEBUG : /: Lookup: name="P1000853.JPG"
2022/02/04 15:44:53 DEBUG : /: >Lookup: node=P1000853.JPG, err=<nil>
2022/02/04 15:44:53 DEBUG : P1000853.JPG: Attr: 
2022/02/04 15:44:53 DEBUG : P1000853.JPG: >Attr: a=valid=1s ino=0 size=6154752 mode=-rw-rw-r--, err=<nil>
2022/02/04 15:44:53 DEBUG : /: Lookup: name="P1000868.JPG"
2022/02/04 15:44:53 DEBUG : /: >Lookup: node=P1000868.JPG, err=<nil>
2022/02/04 15:44:53 DEBUG : P1000868.JPG: Attr: 
2022/02/04 15:44:54 DEBUG : P1000868.JPG: >Attr: a=valid=1s ino=0 size=5761024 mode=-rw-rw-r--, err=<nil>
2022/02/04 15:44:54 DEBUG : /: Lookup: name="P1000869.JPG"
2022/02/04 15:44:54 DEBUG : /: >Lookup: node=P1000869.JPG, err=<nil>
2022/02/04 15:44:54 DEBUG : P1000869.JPG: Attr: 
2022/02/04 15:44:54 DEBUG : P1000869.JPG: >Attr: a=valid=1s ino=0 size=5517824 mode=-rw-rw-r--, err=<nil>
2022/02/04 15:44:54 DEBUG : /: Lookup: name="P1000870.JPG"
2022/02/04 15:44:54 DEBUG : /: >Lookup: node=P1000870.JPG, err=<nil>
2022/02/04 15:44:54 DEBUG : P1000870.JPG: Attr: 
2022/02/04 15:44:54 DEBUG : P1000870.JPG: >Attr: a=valid=1s ino=0 size=5567488 mode=-rw-rw-r--, err=<nil>
2022/02/04 15:44:54 DEBUG : /: Lookup: name="P1000871.JPG"
2022/02/04 15:44:54 DEBUG : /: >Lookup: node=P1000871.JPG, err=<nil>

That's some ancient version of rclone as well.

Rclone downloads

Is the install for Linux.

For S3, there are a number of extra requests that happen unless you tweak it to get mod time:

@asdffdsa shared that earlier -> Amazon S3 (rclone.org)

So a mount will require calls for the attributes and iterate through each one making quite the number of calls unless you tweak it.

and keep in mind, that --fast-list does not work on a rclone mount

That's unfortunate. Seems like that would solve the problem, at least on Linux. I don't know that it would solve the Windows problem.

I just installed the version that was included in the Impish Indri repositories. Good point though.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.