File missing from mount visible with rclone ls

[H4v0k]

What is the problem you are having with rclone?

Newly added content to the remote is not being shown under the mounted directory on another machine. I have one machine which fetches and uploads media to uloz. This is working fine and can see from the vfs/transferred that it has uploaded.

On my other machine, where plex runs, I can see the file if I manually run an rclone ls for the file, but the file does not appear in the mounted directory.

I use the same rclone.conf file and mount commands on both machines, so everything should be identical.

This worked fine when I was only using dropbox, but I'm trying out uloz and have moved only my Movies library so far, so am using a combine to keep the existing folder structure that plex was expecting.

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-117-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.4
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

uloz / dropbox with combine
Though the issue seems to be with either uloz or the combine, as it worked fine before when only using dropbox.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

From uploader machine:
rclone rc core/transferred
{
	"transferred": [
		{
			"bytes": 6543451576,
			"checked": false,
			"completed_at": "2024-08-21T20:07:44.203646453Z",
			"dstFs": "combine:",
			"error": "",
			"group": "global_stats",
			"name": "Movies/The Place Beyond the Pines (2013)/The Place Beyond the Pines 2013.mkv",
			"size": 6541854408,
			"srcFs": "/tmp/vfs/combine",
			"started_at": "2024-08-21T19:43:42.894827869Z"
		}
	]
}

From plex machine:
rclone ls uloz-crypt:Movies/The\ Place\ Beyond\ the\ Pines\ \(2013\)
6541854408 The Place Beyond the Pines 2013.mkv

ls /mnt/media/Movies/The\ Place\ Beyond\ the\ Pines\ \(2013\)
ls: cannot access '/mnt/media/Movies/The Place Beyond the Pines (2013)': No such file or directory

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[combine]
type = combine
upstreams = Backup=dropbox-crypt:/Backup Movies=uloz-crypt:/Movies TV=dropbox-crypt:/TV UFC=dropbox-crypt:/UFC

[dropbox]
type = dropbox
client_id = XXX
client_secret = XXX
token = XXX

[dropbox-crypt]
type = crypt
remote = dropbox:crypt
password = XXX

[uloz]
type = ulozto
app_token = XXX
username = XXX
password = XXX

[uloz-crypt]
type = crypt
remote = uloz:crypt
password = XXX

rclone mount command

/usr/bin/rclone mount \
        --allow-other \
        --vfs-cache-mode full \
        --dir-cache-time 12h \
        --cache-dir /tmp \
        --vfs-cache-max-size 20G \
        --vfs-fast-fingerprint \
        --vfs-cache-max-age 12h \
        --vfs-cache-poll-interval 30m \
        --tpslimit 4 \
        --tpslimit-burst 0 \
        --bwlimit off:off \
        --log-file /var/log/rclone/rclone.log \
        --log-level DEBUG \
        --rc-no-auth \
        combine: /mnt/media \
        --user-agent="XXX" \
        --rc

A log from the command that you were trying to run with the -vv flag

I can't find anything useful in the logs for the mount.
The rclone ls command works, so there's nothing to log from that and the ls for the mount directory doesn't generate any log output.

[asdffdsa (jojothehumanmonkey)]

@H4v0k

Though the issue seems to be with either uloz or the combine, as it worked fine before when only using dropbox.

that is correct and expected behavior.

1. uloz is not a polling remote, a debug log should show that poll-interval is not supported by this remote.
   whereas, dropbox is a polling remote.
2. changes made directly on the cloud storage by the web interface or a different copy of rclone will only be picked up once the directory cache expires if the backend configured does not support polling for changes

@H4v0k

--dir-cache-time 12h

for uloz, rclone mount will not notice changes for 12 hours.

@H4v0k

where plex runs

1. rclone rc vfs/refresh recursive=true
2. run plex scan

and can check out my summary of the two rclone vfs caches

@kapitainsky, i do not use combine remotes much and never with mount.
could dir= be used just on uloz, something like
rclone rc vfs/refresh recursive=true dir=Movies
or
rclone rc vfs/refresh recursive=true dir=uloz-crypt:/Movies

[H4v0k]

@asdffdsa

uloz is not a polling remote

Ah, that makes sense. Thanks

Is there a command I can issue to rclone via the remote control api to tell it to fetch and add a single new directory to the cache?
I tried adding the path of the missing directory to the vfs/refresh command but it just told me it doesn't exist.

A recursive vfs/refresh takes way too long and gives a 503 if i don't give it the _async=true flag, and while vfs/forget sort of solves the problem quickly it seems like a pretty nuclear way of doing it.

[asdffdsa (jojothehumanmonkey)]

@H4v0k

Is there a command I can issue to rclone via the remote control api to tell it to fetch and add a single new directory to the cache?
I tried adding the path of the missing directory to the vfs/refresh command but it just told me it doesn't exist.

i did comment on that.
my bad, i was re-editing my last post at the same time you were replying.

can reduce --dir-cache-time 12h at the cost of more api calls.

[kapitainsky]

@asdffdsa

@kapitainsky, i do not use combine remotes much and never with mount.
could dir= be used just on uloz, something like
rclone rc vfs/refresh recursive=true dir=Movies
or
rclone rc vfs/refresh recursive=true dir=uloz-crypt:/Movies

The former should work.

@H4v0k

I tried adding the path of the missing directory to the vfs/refresh command but it just told me it doesn't exist.

I assume that you do not refresh all "Movies" but maybe some new directory? In such case it is correct as VFS dir cache does not know about this directory existence... hence you can not refresh it. In such case refresh parent directory.