Library scan works well right after mounting, but after time, some movies suddenly disappear randomly.
Taking a look into the folders of the disappeared movies, all folders and subfolders are still there, only the movie-files (.mp4) are gone.
If I remount with --cache-db-purge, everything works fine again… for a few hours, then the movies start to disappear randomly again.
rclone ls cde:tv/Brooklyn.Nine-Nine.S02.1080p.WEB-DL.x264 --cache-db-purge
will list the entire contents of the folder (23 files) however the mount of this folder only shows the first file. This is occurring on several different folders.
I have been running into this behavior on a variety of folders since using the rclone cache mount vs. plexdrive.
Using the following:
rclone v1.39
os/arch: linux/amd64
go version: go1.9.2
Here’s what I know about this behavior (so far):
Have only ever observed this when mounting a remote that is a decrypt of an existing cache remote in rclone
Using rclone ls against the SAME REMOTE that I’m using to setup my mount, I see all files in the folder listed as expected
Using ls against the mount, I get some sub-set of the files that exist in the folder…there does not appear to be a pattern to which files show and which do not.
Performing a server-side rename of the folder (using the “moveto” command completely outside the context of any rclone cache mount) produces some interesting (maybe helpful?) results:
a. Rebuilding the cache usually now picks up all the files that were missing before in the NEW directory
b. The OLD DIRECTORY that I tried to rename still sticks around
c. The files that showed up in the OLD DIRECTORY (when using ls against the mount - point 3 above) are the only files left - it’s as if they did not move with the server-side move
d. All files show in the newly created directory (even the ones that “refused” to move - they now exist in both places)
But I still see the same behavior. The same files are missing from the same folders when looking at the decrypted rclone cache mount. Plexdrive sees them fine, rclone sees them fine with an “ls” against the (non-cached) remote.
Happy to provide more info if it will help…this seems like a tricky issue to find.
Same here, although it seems to be much more predictible in my case.
I’ve created a new cache remote for my existing Gdrive remote that is wrapped into a crypting remote, so the order is GDrive -> GDCache -> GDCrypt. With nothing currently mounted, i can run the usual commands like ‘ls’ and ‘lsd’ which would deliver expected results.
but after 5 minutes (the interval seems to be pretty exact as i’ve done it three times now) all files and folders disappear except one single file that is located in the root folder of my GDcrypt remote (all the other stuff is nested in sub-folders).
this status remains until a --cache-db-purge command is sent with ac ls or lsd command to the GDcrypt remote which brings back all the content for another five minutes.
The GDcache remote shows the same contents every single time. It shows a bunch of encrypted directories and files as expected.
runnint the GDcrypt mount with -vv, tons of debugging info shows up but no errors.
a Re-Read takes place after about 5m and after this action, there is only one item remaining.
Initially every item of my GDcrypt remote is listed in the way like
I’ve been experiencing a very similar issue with all versions since the OP had and am still getting it with v1.42 - hoping someone else has experienced this as well?
Similar situation to the above, a gdrive-cache-crypt mount with Plex (which gets 'rclone synce’d elsewhere) is randomly ‘losing’ a bunch of directories whilst they are present in a ‘rclone lsd’ - doing a SIGHUP or rc/expire magically brings them back.
I am however struggling to replicate it in a predictable manner to have such a recipe to raise a bugreport with.
Hoping someone else has observed this with possible trigger-points.
EDIT: Thanks to others - it appears this is related to bug #2354