If you are like me having big library encfs encrypted and would like to mount drive directly without the need of additional encfs folders, show your support here: https://github.com/ncw/rclone/issues/651 (buy +1 posting something )
That could probably also ix the current issue where you cant copy/move files over encfs drive connected to rclone mount.
So instead of @ncw trying to solve that bug he could maybe implement native support to encfs.
p.s. @ncw is that something that would require a lot of work ?
encfs has quite a lot of options, so would be quite a lot of work. However it is the kind of work that some people enjoy doing (interesting crypto, defined end point).
I would not hold my breath on this since it would be a lot of work to implement it, eg it wont be done by ncw but maybe someone will go for it.
Personally Iam more fond of rclone crypt method now ( iam reencrypting my 40TB lib from encfs to crypt ) mainly:
cleaner setup you dont hold any encrypted files on disk
the encryption is done on the fly on upload eg a lot less disk I/O’s
with encfs the disks really slow down if you have multiple apps copying/moving files to encfs folder eg if my sonarr and CP start moving files to encfs folder it can take 10 minutes and more per file as its being encrypting. With rclone that 10 minutes its instant eg normal move so its much better for it.
usage of rclone fliter flag that you cant use for upload as you are uploading already encrypted files.
And not to forget ncw is working hard on optimizing it crypt performance, while with encfs is what it is, dont expect much/any updates there.
My suggestion would be that you switch to crypt for longevity.
Well I actually use the crypt method but I’m still facing some issues with Sickrage and Couchpotato. Dealing with nzb is ok as I use some post-process scripts with NZBget but it’s harder to use such scripts for rtorrent (to get some tv shows).
I mean, for personal backups I crypt on my side and then “rclone move” so it’s ok. My prob is only for files I DL.
Hmm i dont get it, what kind of issues you have with SR and CP ?
Dont think encfs would solve anything for it eg copying files directly on mount with read/write method does not work with either crypt or encfs.
Well, yeah my question about encFS depends on the rw ability for rClone.
Despite CP is quite ok (no rename but Plex/Emby can deal with the folders name) I failed to use SR with nzbget/rtorrent because SickRage needs to rename and place it in the right path /Shows/Name/Season. And I didn’t find out how to rClone move/copy the file into its final dir. I actually do it for movies but it’s easier because I rClone move /home/mike/Movies to Enc_ACD:/Movies.
BTW I still need to work on it but I feel a bit lost at the moment about how/what to do.
Now you set your CP,SR etc… to move files directly to unionfs folder eg /unionfs/movies/ those files will be actually saved in your /upload/movies/ folder.
The reason for unionfs is so CP always see completed content regardless if its local or on cloud, it will always be available on same path. ( also set Plex to read from it )
All you need to do now is run in cron, rclone move from upload to cloud.
If you are using ENCFS then your overlay it over your upload eg upload-encrypted/ and set rclone move source there.
Writing large files directly on mount atm is not good idea its better to use rclone move.
Ok, just to be sure I understand it right: I should mount my /home/mike/Movies (rw) with /Enc_ACD/Movies ®, /home/mike/Shows (rw) with /Enc_ACD/Shows ® etc so that CP & SR only see one dir. And then set an inotify script, for example, to rClone move/copy files from /home/mike/Dir to /Enc_ACD/dir.
Is that right?
Seems to be the best setup option at this moment so CP & SR could work on their own.
So as you can see all encrypted files are stored on acd in backup folder ( and inside you have subfolders for movies and series )
The Plex Library is set to /home/plex/union-acd-upload/ , the CP / SR destination is also set to /home/plex/union-acd-upload/ ( eg union of acd and upload folder )
The rclone is moving encrypted files directly to acd/backup folder.
All you need to do now is translate to your folder names.
I suggest you switch to crypt as its much much cleaner not to mention better to use since it can take ages if CP and SR are moving files at same time as those need to be encrypted on the fly on disk.
With crypt those files would be moved instantly and crypt would encrypt them on the fly during upload.
Convert from ECFS to CRYPT
To convert your current library, do rclone config and make new crypt remote pointing to your existing acd remote with added folder eg acd:/encrypted
Make a copy script from your unencrypted encfs folder to new crypt mount /usr/bin/rclone copy /storage/acd/ acdcrypt: -c --no-traverse --no-update-modtime --transfers=30 --checkers=30 --min-age 180m --log-file=/var/log/encfs2crypt.log
As you can see the whole setup its much simpler not to mention better performance wise when it comes to moving files to upload folder.
@Ajki
Hey… your posts are always very informative. Thanks for sharing for data mining with the rest of us.
I was just wondering if you have narrowed down your rClone mount settings/flags to the ones in this thread?
Have you determined that these are the ‘best’ flags for the smoothest Plex playback?
I ask because they are much different then the ones that you were using in your other threads.
@Ajki thanks for posting your encfs to rclone crypt conversion guide. I’m presently running acd with encfs. I would like to rclone everything over to my google drive account and convert to rclone crypt there. Could you post a best settings sript for that? I don’t want to get banned on either side.
