Plex with Google Drive not Updating

I recently moved from Google File Stream to Rclone. So far, my issue is that the Plexdrive (my rclone) is not updating from the Google Drive. I copy the files into Google Drive directly on another computer and run Plex and rclone on another computer. The first few hours it works but then no new content is shown in Plex or the rclone mount. I have to restart my Plex/rclone computer and then it will see the new files in rclone and Plex will see it. I am using the following mount
--dir-cache-time 12h --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit 2G --buffer-size 512M --vfs-cache-mode writes --log-level INFO --log-file ~/rclone.log --timeout=1h --vfs-cache-max-age 5m --rc

Any ideas? I have setup my api in Google Drive. Is it something to do with my dir--cache time? Many thanks.

What version are you running?
Can you put it in debug -vv and grab a log of the issue?
What does your rclone.conf look like without keys/passwords?

Polling happens every 1 minute so any changes are picked up via that.

I am running a Mac with rclone version 1.47.0 Here is my config file:

[PlexDrive]
type = drive
client_id = XX
client_secret = XX
scope = drive
token = XXX

I changed my mount and remounted it to : rclone mount PlexDrive: "/Volumes/GoogleDrive/My Drive" --rc --dir-cache-time 12h --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit 2G --buffer-size 512M --vfs-cache-mode writes --log-level DEBUG --log-file ~/rclone.log --timeout=1h --vfs-cache-max-age 5m --rc

Once it stops finding the new files in my Google Drive, I will post the log.

Here is the portion of my log when I had the issue. I copied files to Google Drive directly and Plex is set to scan every two hours, no new files appear. I need to restart rclone and then the new files are then found. When I restart it, it takes a bit of time to scan Google Drive but then it works for about 24 hours.

2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Barry/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Barry (2018)/: Lookup: name=".localized"
2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Barry (2018)/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Bartlett/: Lookup: name=".localized"
2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Bartlett/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:40 DEBUG : Plex/TV Shows/Baskets/: Lookup: name=".localized"
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Baskets/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Battlestar Galactica (2003)/: Lookup: name=".localized"
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Battlestar Galactica (2003)/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Battlestar Galactica Blood & Chrome/: Lookup: name=".localized"
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Battlestar Galactica Blood & Chrome/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Be Cool Scooby-Doo/: Lookup: name=".localized"
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Be Cool Scooby-Doo/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:41 DEBUG : Plex/TV Shows/Beach Hunters/: Lookup: name=".localized"
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Beach Hunters/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Beachfront Bargain Hunt/: Lookup: name=".localized"
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Beachfront Bargain Hunt/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Beachfront Bargain Hunt - Renovation/: Lookup: name=".localized"
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Beachfront Bargain Hunt - Renovation/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Being Erica/: Lookup: name=".localized"
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Being Erica/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:42 DEBUG : Plex/TV Shows/Being Human US/: Lookup: name=".localized"
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Being Human US/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Belief/: Lookup: name=".localized"
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Belief/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Believe/: Lookup: name=".localized"
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Believe/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:43 DEBUG : Plex/TV Shows/Bellevue/: Lookup: name=".localized"
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Bellevue/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Below Deck/: Lookup: name=".localized"
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Below Deck/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Below Deck Mediterranean/: Lookup: name=".localized"
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Below Deck Mediterranean/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Benched/: Lookup: name=".localized"
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Benched/: >Lookup: node=, err=no such file or directory
2019/05/25 09:03:44 DEBUG : Plex/TV Shows/Beowulf Return To The Shieldlands/: Lookup: name=".localized"
2019/05/25 09:03:45 DEBUG : Plex/TV Shows/Beowulf Return To The Shieldlands/: >Lookup: node=, err=no such file or directory

I copied some files to Google Drive directly and waited a few minutes and the rclone.log showed this:

2019/05/25 11:41:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:42:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:43:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:44:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:45:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:46:09 DEBUG : /: Attr:
2019/05/25 11:46:09 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/25 11:46:09 DEBUG : : Statfs:
2019/05/25 11:46:09 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:46:09 DEBUG : : Statfs:
2019/05/25 11:46:09 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:46:49 DEBUG : /: Attr:
2019/05/25 11:46:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/25 11:46:49 DEBUG : : Statfs:
2019/05/25 11:46:49 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:46:49 DEBUG : : Statfs:
2019/05/25 11:46:49 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:46:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:47:11 DEBUG : /: Attr:
2019/05/25 11:47:11 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/25 11:47:11 DEBUG : : Statfs:
2019/05/25 11:47:11 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:47:11 DEBUG : : Statfs:
2019/05/25 11:47:11 DEBUG : : >Statfs: stat={Blocks:4294967295 Bfree:4294967295 Bavail:4294967295 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=
2019/05/25 11:47:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 11:48:23 DEBUG : /: Attr:
2019/05/25 11:48:23 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/25 11:48:49 DEBUG : Google drive root '': Checking for changes on remote

2019/05/25 12:10:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:11:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:12:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:13:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:14:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:15:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:16:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:17:49 DEBUG : Google drive root '': Checking for changes on remote
2019/05/25 12:17:49 DEBUG : PlexDrive: Loaded invalid token from config file - ignoring
2019/05/25 12:17:49 DEBUG : PlexDrive: Saved new token in config file

Can you share the whole log? The parts make it hard to tell what's going on or how the mount was started and missing the version from the start of the log too.

So the flow you are using is another machine does something like a rclone copy/move to your GD and this mount should pick it up.

OK, the log is 435 MB so here is the link.
The mount is on the Plex server computer (Mac mini). I use another computer that has the films. I manually copy them into Google Drive using the web-interface. My understanding is the rclone mount will poll Google Drive for the new files and pop them into my mount (PlexDrive). The mount is used by Plex Server to find the new TV shows/Movies. I checked Google Drive and the files are there but the mount does not always show the new files.

When did you upload the files ? Trying to narrow down the spots in the log. I'd like to check a few things too. If you can start it with --rc as that gives us a few options to test.

Once we have a file that should be there, I'd like to:

rclone ls remote:filenamemissing

run a ls on the mount so that should generate a log for that dir.

We can force a directory cache refresh:

rclone rc vfs/refresh recursive=true

and we can check again.

Well, so far, the error has not come back. Not sure what caused it but will let you know if it happens again. Many thanks for your help. :slight_smile:

I spoke too soon. I copied a file to Google this morning (8-9 AM) and a few hours later, it still does not show up in rclone. I tried running rclone ls remote:filenamemissing and it came back saying "ls directory not found."I tried it with the slash just in case. Here is the rclone log so you can see what happened. I know if I restart it, the files will be found again. Any ideas?

04

How did you 'copy' to Google?

And you need to put the full path on the remote to the file so something probably like this from your log:

rclone ls PlexDrive:Plex/TV Shows/Riviera/Season 02/riviera.s02e05.internal.1080p.ahdtv.x264-failed.mkv

I'm not sure what the path of the file is.

OK, I see. I use another computer and copy it directly into Google Drive via the web interface. I ran ils command again and it gave me the following output:

49

However, when I run the scan in Plex, it does not find and no new files are added to the library.

Can you share the output of:

rclone ls "PlexDrive:Plex/TV Shows/Private Eyes/Season 03"

and show the same ls -al on the mounted directory and grab the debug log of that ls command?

I tried the first one and here is the output. rclone ls -al "PlexDrive:Plex/TV Shows/Private Eyes/Season 03" and it said it was a bad command. Now, It is showing up in Plex after it ran other scan (Plex is setup to do it every 4 hours). Weird..

019/05/30 14:03:31 DEBUG : Plex/TV Shows/Private Eyes/: Lookup: name=".localized"
2019/05/30 14:03:31 DEBUG : Plex/TV Shows/Private Eyes/: >Lookup: node=, err=no such file or directory
2019/05/30 14:06:34 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:06:34 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 14:06:42 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:06:42 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 14:06:45 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:06:45 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 14:26:36 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:26:36 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 14:38:39 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:38:39 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 14:38:47 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 14:38:47 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 15:33:47 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 15:33:47 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 16:07:55 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 16:07:55 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/: Attr:
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/: ReadDirAll:
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/: >ReadDirAll: item=1, err=
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/Season 02/: Attr:
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/Season 02/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/Season 02/: ReadDirAll:
2019/05/30 16:10:05 DEBUG : Plex/TV Shows/Private Eyes/Season 02/: >ReadDirAll: item=18, err=

Unless you tell Plex to scan, Plex would never know a new file is there.

Your mount will have the file show up within ~1 minute.

We were trying to validate the file is there and the rclone ls output matches the directory contents.

You didn't seem to include either of those though.

If the command didn't run, you'd have to share what you typed and the output as saying "it didn't run" doesn't help at all.

Sorry I did not include the files. OK, when I ran the command, I got the same output as before:
51

When I ran "rclone ls "PlexDrive:Plex/TV Shows/Private Eyes/Season 03" and show the same ls -al on the mounted directory and grab the debug log of that ls command?", I had the following error:

35

I copied the file this morning and ran the Plex scanner multiple times and it did not find any new files. I ran the commands you suggested at 3:10 but there is nothing in the log at that time. I did click on the mount on my Mac server and look for the folder and it was not there. I checked again now after lunch and the folder is there.

The command in the terminal prompt would be without the rclone and on your mount point.

ls -al "/mountpoint/TV Shows/Private Eyes/Season 03"

OK, here is the result.

13

So the part that seems odd as if you uploaded the file at 3AM, the file wasn't created based on that modtime until 8:33 AM.

Something doesn't quite line up unless you are a time traveler :slight_smile: