What options do I have to speed up s3 modtime HEAD request?

Iguana9999 · December 9, 2021, 2:27am

Any ETA on that? Seems that feature would be helpful for those using S3 based storage.

Animosity022 · December 9, 2021, 2:29am

You can follow this issue:

github.com/rclone/rclone

vfs: option to cache metadata only

opened 01:42PM - 13 Mar 21 UTC

ivandeex

enhancement VFS / mount metadata

#### What is your current rclone version (output from `rclone version`)? 1.54… #### What problem are you are trying to solve? Requested by @Dibbyo456 in https://github.com/rclone/rclone/issues/4097#issuecomment-798190622 Can we cache metadata only in VFS? #### How do you think rclone should be changed to solve that? Proposed by @ncw in https://forum.rclone.org/t/how-to-cache-only-metadata-on-cache-remote/14846/7 - Enable async writeback in a secure way - Enable `--vfs-cache-mode full` not to download the entire file immediately - Persistent metadata caching (needs a bit more work but isn't nearly as tricky!) @ivandeex As an option, consider new `--vfs-cache-mode metadata` ?? #### Informative references - https://forum.rclone.org/t/how-to-cache-only-metadata-on-cache-remote/14846/5 - https://rclone.org/commands/rclone_mount/#vfs-file-caching - https://github.com/rclone/rclone/blob/v1.54.1/vfs/file.go

kayakingpingpong · December 10, 2021, 8:22am

does the plan also include ability for metadata pre-caching?

Animosity022 · December 10, 2021, 11:40am

Click on the issue and take a look.

system · January 9, 2022, 11:40am

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.