Copy crypt-A->crypt-B/mount crypt-A no longer working- failed to authenticate decrypted block

mastervash · January 4, 2023, 7:35pm

What is the problem you are having with rclone?

As of 3 hours ago I am no longer able to copy files from crypt-A over to crypt-B or download files to server/locally. Crypts use same pass and salt. Data is still visible inside crypt-A, but can not be streamed or downloaded via mount. Checking file size of crypt-A still seems to show correct values. Crypt-B seems to be fine.

Run the command 'rclone version' and share the full output of the command.

rclone v1.61.0, os/version: alpine 3.12.12 (64 bit), os/kernel: 4.15.0-200-generic (x86_64)

Which cloud storage system are you using? (eg Google Drive)

Both crypts are gsuite shared team drives.

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy crypt-A:Media crypt-B:Media

rclone copy crypt-A:"TV/Fringe/Season01/Fringe.S01E01.mkv" /storage/tmp

The rclone config contents with secrets removed.

[gdrive]
type = drive
client_id =  
client_secret = 
scope = drive
service_account_file = /storage/rclone_sa/3.json
team_drive = ############
root_folder_id = 

[crypt-A]
type = crypt
remote = gdrive:storage
password = ##########################
password2 = ##########################

[gsuite]
type = drive
client_id =  
client_secret = 
scope = drive
service_account_file = /storage/rclone_sa/2.json
team_drive = #############
root_folder_id = 

[crypt-B]
type = crypt
remote = gsuite:storage
password = ##########################
password2 = ##########################

A log from the command with the `-vv` flag

Output when attempting to download single specific file:

2023/01/04 19:21:39 INFO  :
Transferred:   	          0 B / 2.373 GiB, 0%, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:         7.1s
Transferring:
* Fringe.S01E01.mkv:  0% /2.373Gi, 0/s, -

2023/01/04 19:21:39 ERROR : Fringe.S01E01.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:39 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:40 INFO  :
Transferred:   	          0 B / 2.373 GiB, 0%, 0 B/s, ETA -
Transferred:            0 / 1, 0%
Elapsed time:         8.1s
Transferring:
* Fringe.S01E01.mkv:  0% /2.373Gi, 0/s, -

2023/01/04 19:21:41 ERROR : Fringe.S01E01.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:41 ERROR : Attempt 2/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:41 INFO  :
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         9.1s

2023/01/04 19:21:42 ERROR : Fringe.S01E01.mkv: Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:42 ERROR : Attempt 3/3 failed with 1 errors and: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?
2023/01/04 19:21:42 INFO  :
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         9.9s

2023/01/04 19:21:42 Failed to copy: multipart copy: failed to open source: failed to authenticate decrypted block - bad password?

Due to set up from seedbox provider some additinal relevant data I can provide to my issue is a snipit out rclone_mount.log

2023/01/04 17:32:00 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2023/01/04 17:32:00 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2023/01/04 17:32:02 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/01/04 17:32:02 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)

2023/01/04 17:32:57 ERROR : IO error: failed to authenticate decrypted block - bad password?
2023/01/04 17:32:58 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 1/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:32:58 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 2/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:32:59 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 3/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:32:59 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 4/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:32:59 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 5/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:00 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 6/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:00 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 7/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:01 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 8/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:01 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 9/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:01 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 10/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:02 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2023/01/04 17:33:02 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:02 ERROR : IO error: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:02 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 1/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:02 INFO  : vfs cache: cleaned: objects 7 (was 7) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/01/04 17:33:02 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 2/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:03 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 3/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:03 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/01/04 17:33:03 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 4/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:04 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 5/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:04 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 6/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:04 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 7/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:05 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 8/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:05 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 9/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:06 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: low level retry 10/10: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:06 ERROR : TV/Gilmore Girls/Season 1/Gilmore Girls - S01E02 - The Lorelais' First Day at Chilton WEBDL-1080p.mkv: ReadFileHandle.Read error: failed to authenticate decrypted block - bad password?
2023/01/04 17:33:06 ERROR : IO error: failed to authenticate decrypted block - bad password?

ncw · January 5, 2023, 2:45pm

This error indicates either corruption of the source, or the password is wrong. Is either of those possible?

mastervash · January 6, 2023, 2:09am

Thank you very much, for your reply! Password/salt is the same for crypt-A and crypt-B, and seeing as the data inside of Crypt-B appears to still be fully accessible, sadly it would suggest that it was the latter of the 2 options that you had mentioned..

After spending more time digging into things, it does appear that large chunks of the remote/crypt have indeed corrupted. Going back through my rclone_mount.log, the errors began appearing as far back as 3 weeks ago, without my realizing.
I must have been seriously lucky, for it continue working without serious problems, for as long as it did.

Luckily the data that did I no longer have access to that wasnt already redundant is pretty managable.. not to mention very well cataloged. So I'll just consider myself fortunate I suppose, and try and learn from my error going forward.

ncw · January 6, 2023, 9:58am

Any ideas what caused the corruption?

Possible ideas in rough order of likelihood

bad memory in your computer
a bug in rclone
bad disk in your computer
bad network card in your computer
google corrupted the data

mastervash · January 12, 2023, 11:50pm

tl;dr honest answer - it was probably user error. Although I couldn't be happier blaming google, thank you for that.

The bad hadware sugtgestions of course could be a contributing factor, however my hosting is with one of most trusted and reputable Seedbox providers out there. It feels almost irresbonsible to blame their hardware.

The honest answer is that I've done far too much experimenting and nowhere near enough reading on the subject. I was bouncing back and forth between authenticating and service accounts. I would just copy my .conf from server to server and even some windows machines (took me a lot less time than I would have expected to figure out the slashes need to be reversed) I was also operating sonarr and radarr's media rename and move over a mounted crypt. I didn't realize that the only time the data should actually be decrypted is when it's being scanned or served via Plex/Jellyfin. I tried to bypass the drive restrictions and attempted deployment of Autorclone and later Gclone directly from a VM running inside Google's Cloud. When something spat out errors I focused on making those operations happen or finding a workaround. In short, I behaved like an irresponsible asshole with my data, and the universe for some reason let it slide for nearly a year and a half before it snapped the strings. But at the very least I was honest with myself and exported a complete file list from the drives every other day, so if there does end up being something worth missing, I'll be able to figure out exactly what/where it should be.

system · February 11, 2023, 11:50pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.