"Skipping undecryptable dir name" after updating rclone

[lopelisoli (Leonardo)]

What is the problem you are having with rclone?

I recently updated rclone, and all files in my crypt remote became unreadable. In the logs I see messages such as:

Skipping undecryptable dir name: illegal base32768 data at input byte 0

If I downgrade rclone, the files are once again readable. Through trial and error, I found out that the latest version where files are readable is v1.57.0. If I update to v1.58.0 through selfupdate, I get the error message above. Same result for all later versions up to v1.61.1.

Before my first attempt at updating, I think I was running v1.50.2. According to the documentation, this is the version distributed with Ubuntu 20.04 - and I hadn't realized, before reading about rclone selfupdate, that rclone wasn't being updated through apt with the rest of the system.

Run the command 'rclone version' and share the full output of the command.

This is the version I tried to install, and then noticed the above error:

rclone v1.61.1
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.15.79.1-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.4
- go/linking: static
- go/tags: none

This the latest version that works:

rclone v1.57.0
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.15.79.1-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.2
- go/linking: static
- go/tags: none

This is the first/oldest version where it doesn't work:

rclone v1.58.0
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.15.79.1-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.8
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

OneDrive + Crypt

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone lsd od-aquisteve-rclone: -vv

The rclone config contents with secrets removed.

[od-aqui]
type = onedrive
token = <redacted>
drive_id =  <redacted>
drive_type = personal
client_id =  <redacted>
client_secret =  <redacted>

[od-aqui-rclone]
type = crypt
remote = od-aqui:rclone
password =  <redacted>
password2 =  <redacted>
filename_encoding = base32768

A log from the command with the -vv flag

When running v1.61.1 (latest - but the log is identical with v1.58.0, or any version in between):

2023/01/07 11:32:05 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "lsd" "od-aqui-rclone:" "-vv"]
2023/01/07 11:32:05 DEBUG : Creating backend with remote "od-aqui-rclone:"
2023/01/07 11:32:05 DEBUG : Using config file from "/home/lopelisoli/.config/rclone/rclone.conf"
2023/01/07 11:32:05 DEBUG : Creating backend with remote "od-aqui:rclone"
2023/01/07 11:32:06 DEBUG : 37umgl36u2cdf1mqgqtggvbri8: Skipping undecryptable dir name: illegal base32768 data at input byte 0
2023/01/07 11:32:06 DEBUG : a57qdt404j9o4o9gd43vpko8i4j6o1ra1k68m66k6g90pdtmhqe0: Skipping undecryptable dir name: illegal base32768 data at input byte 0
2023/01/07 11:32:06 DEBUG : al20kd2a7u3nfo7dlkpa5n2ma8: Skipping undecryptable dir name: illegal base32768 data at input byte 0
2023/01/07 11:32:06 DEBUG : ilptp63tcqv56s12jcmf3ebph8: Skipping undecryptable dir name: illegal base32768 data at input byte 0
2023/01/07 11:32:06 DEBUG : sdpdfk6abe1k2l85266v6uc4b4: Skipping undecryptable dir name: illegal base32768 data at input byte 0
2023/01/07 11:32:06 DEBUG : 3 go routines active

When running v1.57.0 (the latest that works):

2023/01/07 11:29:04 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "lsd" "od-aqui-rclone:" "-vv"]
2023/01/07 11:29:04 DEBUG : Creating backend with remote "od-aqui-rclone:"
2023/01/07 11:29:04 DEBUG : Using config file from "/home/lopelisoli/.config/rclone/rclone.conf"
2023/01/07 11:29:04 DEBUG : Creating backend with remote "od-aqui:rclone"
          -1 2023-01-01 15:27:41        11 Downloads
          -1 2023-01-06 21:26:28         2 PhotoPrism
          -1 2022-12-29 05:41:00         4 Pictures
          -1 2022-12-29 05:54:18         3 Videos
          -1 2023-01-01 23:54:09         9 downloaded_videos
2023/01/07 11:29:06 DEBUG : 3 go routines active

[asdffdsa (jojothehumanmonkey)]

hi,
the erorr is DEBUG : illegal base32768
the remote has filename_encoding = base32768
however base32768 was added at v1.58.0

so did you recently add base32768?
perhaps remove that and re-test v1.61.1

[lopelisoli (Leonardo)]

That fixed it: my files are once again readable after upgrading to rclone v1.61.1.

so did you recently add base32768 ?

Not recently, but I guess I must have read about it in the documentation without realizing it wasn't available at the version I had installed. Rclone must have been silently ignoring the unknown option since then, and the problem manifested when I finally upgraded to a version where the option was no longer unknown.

That begs the question: should rclone produce some kind of warning when the user specifies an unknown option/flag, instead of silently ignoring it?

In any case, thank you for your help @asdffdsa!

[asdffdsa (jojothehumanmonkey)]

if you must upgrade your current crypt to base32768,
then this is as close to --magic as it can get
to change file name encryption type without re-uploading all the data

edit:
given the current state of your crypt, not sure if that is the next safe step?