Struggling to decrypt encrypted files with rclone

Help and Support
1

What is the problem you are having with rclone?

I am unable to figure out how to decrypt files from my cloud service (Backblaze) with rclone and back onto my server in a specific path.

In the below command, musou-isshin is the encrypted remote, shelter is the folder it's uploading to, and root/shared-media/Media/retriever is where I'm trying to get it to put the newly unencrypted files.

server:ServerName is my functioning upload encryption command.

It seems to save the files but not where I intended them to go, and I can't find them or interact with them because of that. I'd prefer they went into the one I'm trying to get it to, root/shared-media/Media/retriever.

Thank you for any and all help!

Run the command 'rclone version' and share the full output of the command.

rclone v1.63.1
- os/version: debian 12.1 (64 bit)
- os/kernel: 6.1.0-10-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.6
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Backblaze b2.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy  musou-isshin:/shelter /root/shared-media/Media/retriever --progress -vv

The rclone config contents with secrets removed.

Paste config here

Name                 Type
====                 ====
server            b2
musou-isshin         crypt

A log from the command with the -vv flag

2023/07/27 13:14:16 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "copy" "musou-isshin:/shelter" "/root/shared-media/Media/" "--progress" "-vv"]
2023/07/27 13:14:16 DEBUG : Creating backend with remote "musou-isshin:/shelter"
2023/07/27 13:14:16 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/07/27 13:14:16 DEBUG : Creating backend with remote "server:ServerName/shelter/247.tifmufs"
2023/07/27 13:14:17 DEBUG : Couldn't decode error response: EOF
2023/07/27 13:14:17 DEBUG : Creating backend with remote "/root/shared-media/Media/"
2023/07/27 13:14:17 DEBUG : fs cache: renaming cache item "/root/shared-media/Media/" to be canonical "/root/shared-media/Media"
2023-07-27 13:14:17 DEBUG : rclone.conf: Need to transfer - File not found at Destination
2023-07-27 13:14:18 DEBUG : Local file system at /root/shared-media/Media: Waiting for checks to finish
2023-07-27 13:14:18 DEBUG : shelter/rclone.conf: Size and modification time the same (differ by 0s, within tolerance 1ms)
2023-07-27 13:14:18 DEBUG : shelter/rclone.conf: Unchanged skipping
2023-07-27 13:14:18 DEBUG : Local file system at /root/shared-media/Media: Waiting for transfers to finish
2023-07-27 13:14:18 DEBUG : rclone.conf.zabewog3.partial: renamed to: rclone.conf
2023-07-27 13:14:18 INFO  : rclone.conf: Copied (new)
Transferred:            331 B / 331 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         2.0s
2023/07/27 13:14:18 INFO  :
Transferred:            331 B / 331 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         2.0s
2

run:

rclone config show

and post output here. Redact passwords etc.

3 
[server]
type = b2
account = redacted
key = redacted

[musou-isshin]
type = crypt
remote = server:ServerName/shelter
filename_encryption = obfuscate
password = redacted
password2 = redacted

Thank you!

4

let's see but I think your copy command should be:

rclone copy musou-isshin: /root/shared-media/Media/retriever --progress -vv

let me know if it works

you can always try it with --dry-run for test

5

Thank you much!

Unfortunately, I still don't see a file. Here's the result of that command:

2023/07/27 14:05:33 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "copy" "musou-isshin:" "/root/shared-media/Media/retriever" "--progress" "-vv"]
2023/07/27 14:05:33 DEBUG : Creating backend with remote "musou-isshin:"
2023/07/27 14:05:33 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/07/27 14:05:33 DEBUG : Creating backend with remote "server:ServerName/shelter"
2023/07/27 14:05:34 DEBUG : Couldn't decode error response: EOF
2023/07/27 14:05:34 DEBUG : Creating backend with remote "/root/shared-media/Media/retriever"
2023-07-27 14:05:34 DEBUG : shelter/rclone.conf: Size and modification time the same (differ by 0s, within tolerance 1ms)
2023-07-27 14:05:34 DEBUG : shelter/rclone.conf: Unchanged skipping
2023-07-27 14:05:35 DEBUG : shelter/shelter/rclone.conf: Need to transfer - File not found at Destination
2023-07-27 14:05:35 DEBUG : Local file system at /root/shared-media/Media/retriever: Waiting for checks to finish
2023-07-27 14:05:35 DEBUG : Local file system at /root/shared-media/Media/retriever: Waiting for transfers to finish
2023-07-27 14:05:35 DEBUG : shelter/shelter/rclone.conf.wihepop7.partial: renamed to: shelter/shelter/rclone.conf
2023-07-27 14:05:35 INFO  : shelter/shelter/rclone.conf: Copied (new)
Transferred:            331 B / 331 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         2.2s
2023/07/27 14:05:35 INFO  :
Transferred:            331 B / 331 B, 100%, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Transferred:            1 / 1, 100%
Elapsed time:         2.2s

So it seems to have worked on some level, at least.

6

OK. maybe nothing is there:)

Your crypt remote points to server:ServerName/shelter. This is where your encrypted data lives.

Check what is there:

rclone lsd server:ServerName/shelter

and

rclone lsd musou-isshin:

7

This is the result of the first command:

 -1 1999-12-31 18:00:00        -1 247.tifmufs

Which seems to be correct? I have two of those folders and two files, both the files are the same, but that didn't list the files, just the folder. And one of those two files is on the same level as the folder, but isn't visible here.

The second command gave me this:

-1 1999-12-31 18:00:00        -1 shelter

I hope that's helpful. Thank you much for your help so far!

8

ok now run:

rclone lsd musou-isshin:shelter

and

rclone ls musou-isshin:shelter

9

First command:

 -1 1999-12-31 18:00:00        -1 shelter

Second command:

331 shelter/rclone.conf
331 rclone.conf
10

Yes. So you have one file there. Everything works as it should. When you run your copy command:

you copy this one file to your local folder /root/shared-media/Media/retriever.

There is nothing else in musou-isshin:shelter.

11

hi, maybe a bit off-topic, but did you intend to have two folders named shelter, one is a subdir of the other?
musou-isshin:shelter and musou-isshin:shelter/shelter
if you did, then please ignore this....

12

I did not. I was really confused on how to get this working, and I kept trying different commands, so it happened unintentionally. I'm very new to selfhosting and working with a server in general.

13

This is all terribly odd, because I'm able to look into the folder itself via what I think is Samba letting me see it on my computer like a folder, but the retriever folder is empty.

And running realpath for shared-media shows that it's the correct path.

/root/shared-media

Everything else in that folder was created by me on my computer, not via command line. So I'm not sure why this particular thing isn't showing.

Would it be better to make an entirely new folder for it? shared-media has stuff in it already.

14

Yes - this is very valid point:) using the same shelter name is obvious recipe for confusion:)

15

I think if you do not have tones of important data in your B2 cloud then yes start from the beginning - probably easier.

your crypt remote is musou-isshin:

all real data lives in b2 cloud in ServerName/shelter - but you can forget it forever.

Always use musou-isshin:

16

imho, first fix/clean/organize the source, only after that is done, try rclone copy to dest.

to see the structure, try

  • rclone tree musou-isshin:
  • rclone ncdu musou-isshin:
1 Like
17

That makes sense! When I do the first command, it just gives me:

/
0 directories, 0 files

Is that supposed to happen? The second command gives me blank space with nothing in it.

Thank you guys for your help!

18

please, always post the exact command and the output, not just the output. thanks

add -vv and post the command and output

19

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.