Exclude Plex library from being cached, only cache directories & filenames

Help and Support
1

What is the problem you are having with rclone?

I have vfs-cache enabled, every time Plex scans my media (stored on Google Drive), I think it caches all the media, because my download usage spikes very high, and the cache keeps building up. And then it randomly (as in, not always, only when I scan my Plex Library) exceeds the vfs-cache-max-size limit which is set to 40G. It builds up to 70-90GBs of cache.

I searched on the forum before posting this, it was said that open files aren't removed from the cache.

I suspect this is because I seed files (torrent) that are stored on Google Drive, so maybe their cache never gets deleted. And then Plex adds up to that, and it keeps on increasing forever.

What am I willing to achieve?

  1. Exclude Plex media files directory from being cached
    1.1 I have gdrive:/files/ and gdrive:/media/, I want to avoid gdrive:/media/ from being cached, but:
    1.2 Optional: Is it possible to only cache Plex's directories and not the media files? Like the folders get cached, and filenames, so when I scan my library, it only goes after the filenames and folders. And not read the whole files because then it would be downloading my whole library (I assume - based on the very high spikes that show in internet usage when scanning media library).
  2. Are there any tips on seeding from Google Drive (configuration changes I may want so that I improve it)? Besides not doing that, of course.

What is your rclone version (output from rclone version)

v1.57.0

Which cloud storage system are you using? (eg Google Drive)

Google Drive

Kind regards,
Thank you.

2

No mount command.
No log.
No rclone.conf.

4

rclone.conf, pretty much nothing:

[gdrive]
type = drive
client_id = REMOVED
client_secret = REMOVED
scope = drive
token = {"access_token":"REMOVED","token_type":"Bearer","refresh_token":"REMOVED","expiry":"2021-12-04T19:43:36.557173254Z"}
team_drive = REMOVED
root_folder_id =

mount command, using rclone-mount docker image:

--allow-other --allow-non-empty --log-level INFO --log-file=/config/logs/rclone.log --cache-dir=/blockvolumes/main/cache --vfs-cache-mode full --vfs-cache-max-size 40G --vfs-cache-max-age 96h --vfs-read-chunk-size 256M --vfs-read-chunk-size-limit off --buffer-size 256M

logs, I didn't find anything that would tell what's going on, and also I have file names I shouldn't be sharing, and it's really huge, the logs, so, here's a look, please tell me if I should be looking for something specific.

2021/12/04 19:35:38 INFO  : Cleaned the cache: objects 388 (was 388), total size 69.854G (was 67.911G)
2021/12/04 19:36:28 INFO  : files/FILENAME: Multi-thread Copied (new)
2021/12/04 19:36:38 INFO  : files/FILENAME: Removed from cache
2021/12/04 19:36:38 INFO  : files/FILENAME: Removed from cache
2021/12/04 19:36:39 INFO  : files/FILENAME: Removed from cache
2021/12/04 19:36:39 INFO  : Cleaned the cache: objects 371 (was 392), total size 60.852G (was 69.854G)
2021/12/04 19:36:47 INFO  : files/FILENAME: Multi-thread Copied (new)
2021/12/04 19:37:05 INFO  : files/FILENAME: Multi-thread Copied (new)
2021/12/04 19:37:23 INFO  : files/FILENAME: Multi-thread Copied (new)
2021/12/04 19:37:38 INFO  : Cleaned the cache: objects 374 (was 374), total size 63.344G (was 60.852G)

Thank you.

5

You really want a debug log and it's easy to explain what's going on.

Just share a link the log as the full log is the most helpful.

1 Like
6

For privacy reasons, I sent you the logs through a private message. Please take a look if you have time, and then if you want to copy a part which helped you tell the problem's reason and paste it here for others when they see this post.

Or if you don't want, you can just tell me the solution/cause here without the logs and I'll be very thankful.

Thank you.

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.