See this article for more details on some testing that was done:
so, it has no role in playing files but only if uploading files from the mount?
Hi @Animosity022,
Iāve been getting my server sorted out for a while now and found massive performance improvements switching to using VFS. Thanks for that.
However, one area Iām still struggling with is uploading files. Files will upload and initially appear in Radarr, then can end up disappearing days later. Iām not really sure why/how itās happening. Any ideas?
Iām using a VFS mount with rclone crypt and no cache, using the same arguments youāre using.
Cheers
Iām sorry but I donāt write directly to the mount with Sonarr/Radarr. I user mergerfs and upload at night.
What type of issue are you seeing? Is there something in the logs on those files?
I got things working and mounted but I noticed with vfs it is a little slower, and in some cases will download the entire file to local disk before playing it. What am I doing wrong that doesnāt seem like an efficient method.
Whatās your mount command? What version are you using? What are some logs when the issue actually happens?
ExecStart=/opt/rclone/rclone --config=/opt/rclone/rclone.conf mount --allow-other --buffer-size 1G --dir-cache-time 72h --drive-chunk-size 32M --fast-list --log-level INFO --log-file /home/plex/logs/rclone.log --umask 002 --vfs-cache-mode full kickcrypt: /mnt/plxcrypt
Here is the mount command.
Which logs do you want? I had to take the mount down and move back to plexdrive. I can redo it just want to know what logs you want before I mount it etc.
I am encypted so some logs are encrypted as I had stated previously.
Yeah, you arenāt using my config so thatās your issue.
āvfs-cache-mode full
that downloads the file completely.
Ok thank you let me turn that off can give it a go again. Thanks for the help again.
change it to āwritesā mode.
Please check the wiki to understand:
https://rclone.org/commands/rclone_mount/#vfs-cache-mode-writes
Thank you now it is working and I can properly test it versus plexdrive. Appreciate you help and patience man.
I copied your command from github and removed the bind and running with that, for testing.
I have been trying to figure out how to get the API results to show up in google. I created my own keys and enabled them in the config file but no data ever shows up in the API dashboard. Is there something else magical that I need to do to see this data? Yes Iām a data whore.
Nope. If you are sure you are using the key, it shows up the console.
1 Like
Iām having very slow mediainfo times, ~ 25-60s each. If I run the command again, then it takes a fraction of a second. That said, my Plex movie start times are what Iād consider very reasonable ā 5-7 seconds to load a movie, then 3-5 seconds to start after hitting play. Plex server status shows āDirect Playā.
i7-4785t, 16GB RAM, 1TB Evo 850 SSD, 100Mbit FIOS
Proxmox host is running the rclone services, bind-mounting the MergerFS pool into an unprivileged LXC container running Plex. (mediainfo takes a long time no matter what mount itās run on). Iām using an rclone version built with cmount.
Relevant section of my rclone service:
ExecStart=/usr/bin/rclone mount gcrypt_username:/media /mnt/bind/gd/username/media \ --allow-other \ --buffer-size 1G \ --dir-cache-time 72h \ --drive-chunk-size 32M \ --fast-list \ --log-level INFO \ --log-file /home/rclone/logs/rclone.log \ --umask 002 \ --vfs-read-chunk-size 128M \ --vfs-read-chunk-size-limit off ExecStop=/bin/fusermount -uz /mnt/bind/gd/username/media
Relevant section of my mount service:
[Mount] What = /mnt/bind/data/local/username:/mnt/bind/gd/username/media Where = /mnt/bind/gmedia/username Type = fuse.mergerfs Options = use_ino,hard_remove,auto_cache,sync_read,allow_other,category.action=all,category.create=ff
Unlikely to be relevant, but for completeness, the lxc mount command:
lxc.mount.entry: /mnt/bind/gmedia/username plex none bind,create=dir 0 0
Should I just disregard the mediainfo times if Plex is working within a few seconds?
Iād probably want to know why if it was me. You can turn the logs up to debug and run the first mediainfo and post that.
Some may take a bit longer but if all are taking 25-60 seconds, that seems odd.
The last few weeks I observe the same issue
Without any specifics or logs or details, I canāt offer any advice. Iām not seeing that so it would be something with your setup.
What are your thoughts on this presentation? I started using direct io and saw some decent improvement. For my setup, Iām on a VPS connected to the cloud and point directly to the fuse mount
Apologies for the slow response. Busy week.
Had a bunch of files ādeleteā yesterday. I donāt know when the files were actually deleted as Radarr only displays when it couldnāt find the file, so when it did a library scan. My debug logs for my VFS mount are set to INFO level and didnāt display anything over the weekend. Seems thereās at least 10 movies that have just disappeared at some point.
Hereās my mount options, if you see anything glaringly wrong?
rclone mount crypt: /home/files/crypt \
--allow-other \
--buffer-size=512M \
--dir-cache-time=72h \
--drive-chunk-size=128M \
--fast-list \
--log-level INFO \
--log-file /home/logs/rclone.log \
--vfs-cache-mode=writes \
--vfs-read-chunk-size=128M \
--vfs-read-chunk-size-limit=off \
Iām now thinking Iāll make the switch to mergerfs if itās more reliable. One thing Iām not really clear on is how that interacts with the VFS cache. My understanding is that Radarr will copy the files into mergerfs, then at night you have it so that the VFS cache layer will upload it to your remote mount.
Is it possible for the file appear to stay in the same location to other programs like Plex and Radarr?
Cheers for your time and wisdom on this.
I donāt think they disappear per se, but unionfs uses some .hidden files and such and I really didnāt like that/found odd things happened here/there with it which is why I switched to mergerfs instead.
I use that to copy locally first and my script uploads at night whatever is local. The path name never changes for Sonarr/Radarr/Plex so it all thinks it is the same path/location.
I do not see anything odd/wrong in your mount and never had an issue with files just disappearing. Usually, Iād see an error in the logs about Radarr having issues moving a file or something so Iād see a file ending with ~partial hanging around.
1 Like