Guide to replaceing plexdrive/unionfs with rclone cache


#21

Mostly by sonarr/radarr on any upgrades etc. But sometimes may need to delete manually too. So, I will need to run rclone delete on the mount or the cache?


#22

Nope just mount the remote at a path and point sonarr at it, it’s read/write rather than readonly. Sonarr can delete stuff off of gdrive transparently now as if it’s local.


#23

CLI takes priority.
But if I remember correctly there isn’t an option in the conf file for it. It doesn’t matter anyway, it will be ignored.


#24

And yeah, switching chunk sizes will require to purge the entire cache. There’s no way to retain cached data with different chunk sizes. My suggestion is to experiment, clear the data every run and when you find the configs right for you, run with those.


#25

Yeah looks like it’s a relic from a really early build when it was set there and I’ve not removed it since!


#26

Another question, possible to clear the cache via rc for the root of the mount? Got a pesky folder that’s not there anymore constantly causing logging entries but can’t seem to get rid of it without a full cache rebuild.


#27

It should be working but that would be identical to a full purge too (if you specify withData)


#28

Yeah looking to do directory tree data without withData, what’s the syntax? I tried rclone rc cache/expire remote="" and "/" and just a plain empty remote= and it doesn’t seem to work.


#29

Thanks, @spicypixel

One last question, with my current setup I hard link the post-processed files from Sonarr/Radarr to avoid double usage of the disk. Is this still possible with the cache or do I need to do something else?


#30

No it’s not possible as it’s crossing a filesystem boundary. It’ll be duplicated till uploaded based on your timer.


#31

Does it mean that even if I hardlink, it will instead copy to the tmp-upload-path and keep it there till its removed due to the time limit? Or, do you mean that hardlink will simply fail to work and I need to specify copy?


#32

conversation about it is happening here, from what I understand from it though is though even though it’s local to local behind the scenes, it’s still technically crossing a filesystem boundary, the cache is behind the scenes so what’s represented to the userspace is a remote FUSE filesystem with all the limitations that entails.


#33

I don’t know if anyone has had this problem?
My setup is all done with a cache remote > Gdrive > Cache > Crypt, I have updated my entire plex library no issues and imported all the existing series into Sonarr. Both Radarr & Sonarr pointing directly at the cache mount.
With Radarr, It started off ok, but now I’m getting errors such as : -

 ParsingService Unable to parse movie info from path /home/***/***/GdriveCache/MOVIE.mkv
 SkyHookProxy Couldn’t map movie Movie to a movie on The Movie DB. It will not be added :frowning:
 SkyHookProxy Couldn’t map movie Movie to a movie on The Movie DB. It will not be added :frowning:
 SkyHookProxy Couldn’t map movie Movie to a movie on The Movie DB. It will not be added :frowning:
 SkyHookProxy Couldn’t map movie Movie to a movie on The Movie DB. It will not be added :frowning:
ParsingService|Unable to parse movie info from path /home/***/***/GdriveCache/MOVIE.mkv

The above happened the other day and after waiting a day, I was able to start re-importing again.

It looks like gdrive is blocking it, unless I’m mistaken.

My mount is mounted with
rclone mount GdriveCache: /movies
–allow-other
–dir-cache-time=120h
–cache-chunk-size=15M
–cache-info-age=168h
–cache-workers=5
–buffer-size=1G
–umask 002
–rc
–cache-tmp-upload-path /rclone/movies
–cache-tmp-wait-time 60m
-v

and I have a second mount same as above pointing to series on gdrive.


#34

What’s the file name specifically of the movie?


#35

Parse error is from movies/Carry on films/20 - Carry On Loving.avi
Skyhook proxy error, same movie + Basket Case 3 seem to make radar crap out

Wait… guessing this is a Radarr issue with no date being on the movie?


#36

That’s what I was thinking. If you turn up the Radarr logs to debug, you can get more detail.

This was the Radarr item I saw:


#37

I’m bookmarking this topic to further study your settings, which seem to be great.

My actual setup has a cache remote inside a folder in the encrypted remote folder, and I mount the cache one. I’m doing this wrong, then?

Should I have a cache remote pointed to a media folder in drive, then encrypt the whole cache remote and mount the enccrypted remote?


#38

I have my GD -> Cache (GD:) -> Encrypted folder inside the Cache (GD:media) for me and I mount the last item, which is the crypt.


#39

I see.
So if I mount only the crypt remote, which refers to a folder inside the cache remote, it’s the same as if the cache remote refered to that same folder?

In other words, the caching will only occur/matter to the mounted crypted parts?


#40

Well, I can’t see what the issue is, after bulk importing the debug logs seem normal, but Radarr spins and spins until eventually saying there are no media files in the selected location.

the debug log:
18-4-24 21:47:24.7|Debug|Parser|Movie Parsed. Casino Royale - 2006
18-4-24 21:47:24.7|Debug|Parser|Language parsed: English
18-4-24 21:47:24.7|Debug|QualityParser|Trying to parse quality for Casino Royale (2006)
18-4-24 21:47:24.7|Debug|Parser|Quality parsed: Unknown v1
18-4-24 21:47:24.7|Debug|Parser|Release Group parsed:
18-4-24 21:47:24.7|Debug|DiskScanService|Scanning ‘/home/***/***/movies/Casino Royale (2006)’ for video files
18-4-24 21:47:24.8|Debug|DiskScanService|1 video files were found in /home/***/***/movies/Casino Royale (2006)
18-4-24 21:47:24.9|Debug|ImportDecisionMaker|Analyzing 1/1 files.
18-4-24 21:47:24.9|Debug|Parser|Parsing string ‘Casino Royale (2006).mkv’
18-4-24 21:47:24.9|Debug|Parser|Movie Parsed. Casino Royale - 2006
18-4-24 21:47:24.9|Debug|Parser|Language parsed: English
18-4-24 21:47:24.9|Debug|QualityParser|Trying to parse quality for Casino Royale (2006).mkv
18-4-24 21:47:24.9|Debug|Parser|Quality parsed: HDTV-720p v1
18-4-24 21:47:24.9|Debug|Parser|Release Group parsed:
18-4-24 21:47:24.9|Debug|ImportDecisionMaker|Size: 8239430547
18-4-24 21:47:24.9|Debug|VideoFileInfoReader|Getting media info from /home/******/movies/Casino Royale (2006)/Casino Royale (2006).mkv
18-4-24 21:47:28.0|Debug|ImportDecisionMaker|Checking quality for this video file to make sure nothing mismatched.
18-4-24 21:47:28.0|Debug|ImportDecisionMaker|Checking quality for this video file to make sure nothing mismatched.
18-4-24 21:47:28.0|Debug|ImportDecisionMaker|Quality (HDTV-1080p v1) of the file is different than the one we have (HDTV-720p v1)
18-4-24 21:47:28.0|Debug|SameFileSpecification|No existing movie file, skipping
18-4-24 21:47:28.0|Debug|FreeSpaceSpecification|Skipping free space check when importing
18-4-24 21:47:28.0|Debug|SameFileSpecification|No existing movie file, skipping
18-4-24 21:47:28.0|Debug|VideoFileInfoReader|Getting media info from /home/***/***/movies/Casino Royale (2006)/Casino Royale (2006).mkv
18-4-24 21:47:28.0|Debug|FreeSpaceSpecification|Skipping free space check when importing

Even when selecting the minimum 15 at a time

The above repeats the same for each movie.