VFS Directory Cache vs VFS File Caching

I'm creating a "--vfs-cache-mode full" with google cloud storage,
but I am in doubt with the following items...

--dir-cache-time duration
--vfs-write-back duration

--poll-interval duration
--vfs-cache-poll-interval duration

whats is the really difference between the two couple of itens?

I'm reading the docs https://rclone.org/commands/rclone_mount

1 Like

This is how long the directory and file structure stay in memory.

This depends on the remote and if the remote supports it, it's how long it polls the remote for changes/new files and that will invalidate the previous item and get a new listing.

Both of those have really nothing to do with vfs-cache-mode.

This really only comes into play if you are not using writes/full.

That is for writes/full cache modes and it's how often it checks the cache to remove files if it hits the max size.

1 Like

and what does it do when using off/minimal ?

and other doubt. the --attr-timeout has any relation with this other caches? whats does it really does?

It's documented on that page:

Note that files are written back to the remote only when they are closed and if they haven't been accessed for --vfs-write-back second. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.

     --attr-timeout duration                  Time for which file/directory attributes are cached. (default 1s)

That's how long it keeps file attributes in memory when it gets a listing of them, which is normally 1 second.

Best bet is to use defaults and if you want to change something, understand what the flag does and why you are changing it.

I can't figure out what you are really trying to get to so I wish I could be more helpful as you seem to have a random stream of questions that are all unrelated.

ok. I get it. But you say is not used with write/full.

I wold need to send to cloud storage only 24hours the file is created and not more edited....

So what is the use case?

  1. Write a file to a mount
  2. Wait 24hours
  3. Upload file from mount -> cloud

?

yes. its a rclone mount.
send files to it.

--cache-dir /var/cache/test
--vfs-cache-mode full (ok)
--vfs-cache-max-age off (ok)
--vfs-cache-max-size 1024G (ok)
--vfs-cache-poll-interval 6h (ok)
--vfs-write-back 24h (??)

--dir-cache-time (??)
--poll-interval 1h (ok)

--attr-timeout (??)

So if you the use case you have above is what you are trying to do, there is not a flag to do that yet.

That issue is for delayed uploads which isn't done yet.

You'd want to follow that issue for when it's done.

None of the flags you have there have any impact on what you are asking.

like they talk here

seens the --vfs-write-back does the job

That works if you are using vfs-cache-mode writes or full.

I thought before we confirmed you are not using a cache mode? I'm confused I guess as on what flags you are using or not using at this point.

as the first message. I'm using cache "full"
and I'm sending again.

--cache-dir /var/cache/test
--vfs-cache-mode full (ok)
--vfs-cache-max-age off (ok)
--vfs-cache-max-size 1024G (ok)
--vfs-cache-poll-interval 6h (ok)
--vfs-write-back 24h (ok)

--dir-cache-time (??)
--poll-interval 6h (ok)

--attr-timeout (??)

with ?? I'm doubt what to use yet.

If you aren't sure, use the defaults and remove it.

Not sure why you are setting half the items you are setting.

Lots of details are missing like what backend you are using, what OS etc so it's hard to guess, which is why we have a help and support template that guides a user to fill out all the details up front.

ubuntu 20.04 lts server
rclone v1.55.0

Poll interval is only useful if you are using a polling remote.

What remote provider are you using?

google cloud storage
Google Drive
Amazon S3
Microsoft Azure Blob Storage

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.