Possibility of decrypting the log entries in realtime?

Feature
1

Would it be possible to run a flag on rclone to handle transparently looking up paths and decrypting them?

Mar 23 03:00:09 plex rclone[25175]: 2018/03/23 03:00:09 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4: put: cache expired
Mar 23 03:00:12 plex rclone[25175]: 2018/03/23 03:00:12 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4: move: cache expired
Mar 23 03:00:13 plex rclone[25175]: 2018/03/23 03:00:13 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4: move: cache expired
Mar 23 03:10:06 plex rclone[25175]: 2018/03/23 03:10:06 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4/pjv5v0nbbcv5s3mr36i4k7sfk87k1ofa1p3civegbvtndjh62fi0298b7np1bubulbueh6935j0de: background upload: started upload
Mar 23 03:10:08 plex rclone[25175]: 2018/03/23 03:10:08 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4/pjv5v0nbbcv5s3mr36i4k7sfk87k1ofa1p3civegbvtndjh62fi0298b7np1bubulbueh6935j0de: Copied (new)
Mar 23 03:10:08 plex rclone[25175]: 2018/03/23 03:10:08 INFO  : ktmmsql1nabd7fr5oeqbpk4sls/mv4abbtpih5sakubjgm6c2o2s4/pjv5v0nbbcv5s3mr36i4k7sfk87k1ofa1p3civegbvtndjh62fi0298b7np1bubulbueh6935j0de: Deleted

Flicking through logs like this, while accurate as that’s what was uploaded/deleted, is harder to track as human readable.

Was just wondering if it was something that could be done now that I noticed when you do rc commands it will interact with crypted files using their optional human readable filenames.

2

Doing this on the fly in rclone would be tricky as the crypt layer is above the remote layers so by the time the remote logs the crypted name we’ve lost the original filename. It wouldn’t be impossible to do though with a bit of thought.

A log post processor would be pretty easy though where you could do one of these maybe

rclone cryptdecode --stdin remote: <rclone.log
rclone copy .... 2>&1 | rclone cryptdecode --stdin remote:
rclone cryptdecode --file remote: rclone.log

And that decodes all the crypted names it can find.

What do you think - would that be useful?

3

Yeah realistically the contents of the log file can remain as it is, just how it’s displayed.

So with that in mind I guess the issue would be how well this would work with something like tail -F or journalctl printing it rather than a static file.

As it stands now I have a tmux window with journalctl -fu rclonemount running to monitor the logs.
Would rclone cryptdecode --stdin remote: be able to take an updating pipe or will it process it all and finish the task?

4

It would take the data as it comes so it should work perfectly in a pipeline.

If you like this idea can you please make a new issue on github and we can have a go implementing it.