Bit rot and how to salvage?

Help and Support
1

What is the problem you are having with rclone?

It seems silent corruption occured on my data stored on GDrive. One of the file failed to decrypt after 583073792 byte into the file. I downloaded this file directly from GDrive and have tried to locally decrypt it. rclone cat generates a truncated file whereas rclone copyto just quits when it can't get past the corruption. Is there a way to force rclone to push past the corrupted bits and greedily decrypt the rest? It's a video so loosing a few frames won't be too bad...

Run the command 'rclone version' and share the full output of the command.

v1.63.1

Which cloud storage system are you using? (eg Google Drive)

GDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone cat -vv --config=temp.conf localvideos:Wedding.avi > file
rclone copyto -vv --config=temp.conf localvideos:Wedding.avi test.avi

The rclone config contents with secrets removed.

[localvideos]
type = crypt
remote = /dev/shm/Downloads/test
filename_encryption = standard
directory_name_encryption = true
password = *stuff*
password2 = *stuff*

A log from the command with the -vv flag

rclone cat -vv --config=temp.conf localvideos:Wedding.avi > file
2023/08/20 01:48:47 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "cat" "-vv" "--config=temp.conf" "localvideos:Wedding.avi"]
2023/08/20 01:48:47 DEBUG : Creating backend with remote "localvideos:Wedding.avi"
2023/08/20 01:48:47 DEBUG : Using config file from "/dev/shm/Downloads/temp.conf"
2023/08/20 01:48:47 DEBUG : Creating backend with remote "/dev/shm/Downloads/test/92bd8ahs1n8gvtjrlg6n2unjlo"
2023/08/20 01:48:47 DEBUG : fs cache: adding new entry for parent of "/dev/shm/Downloads/test/92bd8ahs1n8gvtjrlg6n2unjlo", "/dev/shm/Downloads/test"
2023/08/20 01:48:48 DEBUG : Wedding.avi: Reopening on read failure after 583073792 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/08/20 01:48:48 DEBUG : Wedding.avi: Reopen failed after 583073792 bytes read: failed to authenticate decrypted block - bad password?
2023/08/20 01:48:48 ERROR : Wedding.avi: Failed to send to output: failed to authenticate decrypted block - bad password?
2023/08/20 01:48:48 INFO  : can't close account: file already closed
2023/08/20 01:48:48 DEBUG : 5 go routines active
2023/08/20 01:48:48 Failed to cat: failed to authenticate decrypted block - bad password?

rclone copyto -vv --config=temp.conf localvideos:Wedding.avi test.avi
2023/08/20 01:51:25 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "copyto" "-vv" "--config=temp.conf" "localvideos:Wedding.avi" "test.avi"]
2023/08/20 01:51:25 DEBUG : Creating backend with remote "localvideos:Wedding.avi"
2023/08/20 01:51:25 DEBUG : Using config file from "/dev/shm/Downloads/temp.conf"
2023/08/20 01:51:25 DEBUG : Creating backend with remote "/dev/shm/Downloads/test/92bd8ahs1n8gvtjrlg6n2unjlo"
2023/08/20 01:51:25 DEBUG : fs cache: adding new entry for parent of "/dev/shm/Downloads/test/92bd8ahs1n8gvtjrlg6n2unjlo", "/dev/shm/Downloads/test"
2023/08/20 01:51:25 DEBUG : Creating backend with remote "."
2023/08/20 01:51:25 DEBUG : fs cache: renaming cache item "." to be canonical "/dev/shm/Downloads"
2023/08/20 01:51:25 DEBUG : Wedding.avi: Sizes differ (src 848233878 vs dst 0)
2023/08/20 01:51:25 DEBUG : Wedding.avi: Starting multi-thread copy with 3 parts of size 269.688Mi
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 (565575680-848233878) size 269.564Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 (0-282787840) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 (282787840-565575680) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopening on read failure after 17498112 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopen failed after 17498112 bytes read: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 failed: context canceled
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 failed: context canceled
2023/08/20 01:51:25 ERROR : Wedding.avi: Failed to copy: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 INFO  : test.avi.qagabac0.partial: Removing failed copy
2023/08/20 01:51:25 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: Sizes differ (src 848233878 vs dst 0)
2023/08/20 01:51:25 DEBUG : Wedding.avi: Starting multi-thread copy with 3 parts of size 269.688Mi
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 (565575680-848233878) size 269.564Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 (282787840-565575680) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 (0-282787840) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopening on read failure after 17498112 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopen failed after 17498112 bytes read: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 failed: context canceled
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 failed: context canceled
2023/08/20 01:51:25 ERROR : Wedding.avi: Failed to copy: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 INFO  : test.avi.gixigoc2.partial: Removing failed copy
2023/08/20 01:51:25 ERROR : Attempt 2/3 failed with 1 errors and: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: Sizes differ (src 848233878 vs dst 0)
2023/08/20 01:51:25 DEBUG : Wedding.avi: Starting multi-thread copy with 3 parts of size 269.688Mi
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 (565575680-848233878) size 269.564Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 (0-282787840) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 (282787840-565575680) size 269.688Mi starting
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopening on read failure after 17498112 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: Reopen failed after 17498112 bytes read: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 failed: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 failed: context canceled
2023/08/20 01:51:25 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 failed: context canceled
2023/08/20 01:51:25 ERROR : Wedding.avi: Failed to copy: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 INFO  : test.avi.nokisor4.partial: Removing failed copy
2023/08/20 01:51:25 ERROR : Attempt 3/3 failed with 1 errors and: multipart copy: read failed: failed to authenticate decrypted block - bad password?
2023/08/20 01:51:25 INFO  : 
Transferred:   	  107.938 MiB / 107.938 MiB, 100%, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.9s

2023/08/20 01:51:25 DEBUG : 6 go routines active
2023/08/20 01:51:25 Failed to copyto: multipart copy: read failed: failed to authenticate decrypted block - bad password?

-rw-r--r--. 1 user 583073792 Aug 20 01:48 file
-rw-------. 1 user      5404 Aug 20 00:52 temp.conf
drwxr-xr-x. 2 user        60 Aug 20 01:23 test/
-rw-r--r--. 1 user         0 Aug 20 00:33 test.avi
1 Like
2

Try

--crypt-pass-bad-blocks

This will return as zeroes chunks that fail their checksum. The chunks are 64kBytes long so hopefully you just get one.

3

Seems quite a number of 64kBytes chunks but seems to work

rclone cat -vv --config=./localconfig/temp.conf --crypt-pass-bad-blocks localvideos:"Wedding.avi" > file
2023/08/20 12:35:52 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "cat" "-vv" "--config=./localconfig/temp.conf" "--crypt-pass-bad-blocks" "localvideos:Wedding.avi"]
2023/08/20 12:35:52 DEBUG : Creating backend with remote "localvideos:Wedding.avi"
2023/08/20 12:35:52 DEBUG : Using config file from "/home/user/eEternalStores/Multimedia/bitrot/localconfig/temp.conf"
2023/08/20 12:35:52 DEBUG : localvideos: detected overridden config - adding "{hu89K}" suffix to name
2023/08/20 12:35:52 DEBUG : Creating backend with remote "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo"
2023/08/20 12:35:52 DEBUG : fs cache: adding new entry for parent of "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo", "/home/user/eEternalStores/Multimedia/bitrot/localcrypt"
2023/08/20 12:35:52 DEBUG : fs cache: adding new entry for parent of "localvideos:Wedding.avi", "localvideos{hu89K}:Wedding.avi"
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:35:55 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 12:36:00 DEBUG : 5 go routines active
4

I think the copyto command shows more clearly where the rot took place...Maybe?

rclone copyto -vv --config=./localconfig/temp.conf --crypt-pass-bad-blocks localvideos:"Wedding.avi" file2.avi
2023/08/20 13:23:15 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "copyto" "-vv" "--config=./localconfig/temp.conf" "--crypt-pass-bad-blocks" "localvideos:Wedding.avi" "file2.avi"]
2023/08/20 13:23:15 DEBUG : Creating backend with remote "localvideos:Wedding.avi"
2023/08/20 13:23:15 DEBUG : Using config file from "/home/user/eEternalStores/Multimedia/bitrot/localconfig/temp.conf"
2023/08/20 13:23:15 DEBUG : localvideos: detected overridden config - adding "{hu89K}" suffix to name
2023/08/20 13:23:15 DEBUG : Creating backend with remote "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo"
2023/08/20 13:23:15 DEBUG : fs cache: adding new entry for parent of "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo", "/home/user/eEternalStores/Multimedia/bitrot/localcrypt"
2023/08/20 13:23:15 DEBUG : fs cache: adding new entry for parent of "localvideos:Wedding.avi", "localvideos{hu89K}:Wedding.avi"
2023/08/20 13:23:15 DEBUG : Creating backend with remote "."
2023/08/20 13:23:15 DEBUG : fs cache: renaming cache item "." to be canonical "/home/user/eEternalStores/Multimedia/bitrot"
2023/08/20 13:23:15 DEBUG : Wedding.avi: Need to transfer - File not found at Destination
2023/08/20 13:23:15 DEBUG : Wedding.avi: Starting multi-thread copy with 3 parts of size 269.688Mi
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 (565575680-848233878) size 269.564Mi starting
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 (282787840-565575680) size 269.688Mi starting
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 (0-282787840) size 269.688Mi starting
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 13:23:15 DEBUG : Wedding.avi: multi-thread copy: write buffer set to 128Ki
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:16 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:17 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/20 13:23:33 DEBUG : Wedding.avi: multi-thread copy: stream 2/3 (282787840-565575680) size 269.688Mi finished
2023/08/20 13:23:33 DEBUG : Wedding.avi: multi-thread copy: stream 3/3 (565575680-848233878) size 269.564Mi finished
2023/08/20 13:23:33 DEBUG : Wedding.avi: multi-thread copy: stream 1/3 (0-282787840) size 269.688Mi finished
2023/08/20 13:23:33 DEBUG : Wedding.avi: Finished multi-thread copy with 3 parts of size 269.688Mi
2023/08/20 13:23:33 DEBUG : file2.avi.tumuqix4.partial: renamed to: file2.avi
2023/08/20 13:23:33 INFO  : Wedding.avi: Multi-thread Copied (new) to: file2.avi
2023/08/20 13:23:33 INFO  : 
Transferred:   	  808.939 MiB / 808.939 MiB, 100%, 41.154 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:        17.8s

2023/08/20 13:23:33 DEBUG : 6 go routines active

Crypted file was 848441014 bytes while decrypted file is 848233878 bytes, so maybe lost of 207136 bytes?

[user@yellowtrain bitrot]$  ls
total 1656728
-rw-r--r--. 1 user 848233878 Aug 20 12:36 file
-rw-r--r--. 1 user 848233878 Aug 19 23:49 file2.avi
drwxr-xr-x. 2 user      4096 Aug 20 12:33 localconfig/
drwxr-xr-x. 2 user      4096 Aug 20 02:16 localcrypt/
[user@yellowtrain bitrot]$  ls localcrypt/
total 828560
-rw-r--r--. 1 user 848441014 Aug 19 23:49 92bd8ahs1n8gvtjrlg6n2unjlo
5

You'll use one 64k block for each message

ERROR : crypt: ignoring: failed to authenticate decrypted block - bad

When I say lose - that 64k will be set to all zeros so you can see them in the output with a hex editor. I count 48 of them which is 3MB. So you'll find there is a 3 MB chunk of zeroes in your video. Most video players will cope with that kind of thing just find, so you'll have a glitch with a few seconds missing most likely.

You might want to try copying it with --multi-thread-streams 0 also - that might not make a difference, but it might so it is worth a try.

6

were you ever able to read the file of gdrive? If yes, maybe then its bitro (though I have my doubts), but if this is your first time reading it, I'd hazzard to say, it might be more likely to be a problem on your side (i.e. memory corruption or the like at the time of copying to gdrive) and might want to check out the system that was used to copy to gdrive to see if there are any hardware problems on it.

7

multi-thread-stream 0 does not make a difference. But doesn't matter since the recovered video is sufficiently intact, which is very good for me. Thanks

rclone copyto -vv --config=./localconfig/temp.conf --crypt-pass-bad-blocks --multi-thread-streams 0 localvideos:"Wedding.avi" file3.avi
2023/08/22 06:11:08 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "copyto" "-vv" "--config=./localconfig/temp.conf" "--crypt-pass-bad-blocks" "--multi-thread-streams" "0" "localvideos:Wedding.avi" "file3.avi"]
2023/08/22 06:11:08 DEBUG : Creating backend with remote "localvideos:Wedding.avi"
2023/08/22 06:11:08 DEBUG : Using config file from "/home/user/eEternalStores/Multimedia/bitrot/localconfig/temp.conf"
2023/08/22 06:11:08 DEBUG : localvideos: detected overridden config - adding "{hu89K}" suffix to name
2023/08/22 06:11:08 DEBUG : Creating backend with remote "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo"
2023/08/22 06:11:08 DEBUG : fs cache: adding new entry for parent of "/home/user/eEternalStores/Multimedia/bitrot/localcrypt/92bd8ahs1n8gvtjrlg6n2unjlo", "/home/user/eEternalStores/Multimedia/bitrot/localcrypt"
2023/08/22 06:11:08 DEBUG : fs cache: adding new entry for parent of "localvideos:Wedding.avi", "localvideos{hu89K}:Wedding.avi"
2023/08/22 06:11:08 DEBUG : Creating backend with remote "."
2023/08/22 06:11:08 DEBUG : fs cache: renaming cache item "." to be canonical "/home/user/eEternalStores/Multimedia/bitrot"
2023/08/22 06:11:08 DEBUG : Wedding.avi: Need to transfer - File not found at Destination
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:11 ERROR : crypt: ignoring: failed to authenticate decrypted block - bad password?
2023/08/22 06:11:12 DEBUG : file3.avi.vujurup6.partial: renamed to: file3.avi
2023/08/22 06:11:12 INFO  : Wedding.avi: Copied (new) to: file3.avi
2023/08/22 06:11:12 INFO  : 
Transferred:   	  808.939 MiB / 808.939 MiB, 100%, 192.479 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         4.3s

2023/08/22 06:11:12 DEBUG : 6 go routines active
8

Of course, the video was able to be played off gdrive with some frames missing. It's been about 5 years since I stored this particular video on GDrive. I know it's bit rot because I remember doing a thorough checksum of this particular file and recalled that they were identical. It's just too bad that at the time I wasn't in the habit of making and keeping local parity archives of things I stored on GDrive, which is usually way smaller than the source. This is a relatively rare incident though as out of the 9 TB or so that I had stored only this file had any bit rot. So take note and always keep some parity archives of things you hold to be precious in the case some corrupted bytes need to be reconstructed.

9

It was worth a try just in case we are seeing a bug in google drive's ranging algorithm.

That is good :slight_smile:

Can you try an experiment for me?

Can you try using rclone to download the encrypted file?

You'll first need to find out its encrypted name which you'd do something like

rclone backend encode localvideos: Wedding.avi

Then you'd take that name and try to copy it from the google drive with rclone

rclone copyto --multi-thread-streams 0 -vv gdrive:path/the_encrypted_name_from_above /tmp/

What I'd like to know is, does that fail the checksum test? Ie is the MD5SUM attached to the file correct or not.

I don't know how you downloaded the file to /dev/shm/Downloads/test - maybe you did it with rclone in which case there is no need for this test!

10

This is what it looked like on the GDrive

2023/08/19 10:23:14 INFO  : Starting bandwidth limiter at 30Mi Byte/s
2023/08/19 10:23:14 INFO  : Starting transaction limiter: max 12 transactions/s with burst 1
2023/08/19 10:23:14 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "ls" "tresplas_Collections_Videos:/Events/Weddings" "-vv" "--transfers" "12" "--checkers" "12" "--tpslimit" "12" "--fast-list" "--checksum" "--bwlimit" "30M:30M" "--progress" "--rc" "--rc-addr=localhost:6000" "--ask-password=false"]
2023/08/19 10:23:14 NOTICE: Serving remote control on http://127.0.0.1:6000/
2023/08/19 10:23:14 DEBUG : Creating backend with remote "tresplas_Collections_Videos:/Events/Weddings"
2023/08/19 10:23:14 DEBUG : Using RCLONE_CONFIG_PASS password.
2023/08/19 10:23:14 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2023/08/19 10:23:14 DEBUG : Creating backend with remote "tresplas:/Collections/Videos/m8s85ibih5pvifrgl8rkr0se04/a1h43c7nqc3jkt0ttr3eqdv88k"
2023/08/19 10:23:15 DEBUG : fs cache: renaming cache item "tresplas:/Collections/Videos/m8s85ibih5pvifrgl8rkr0se04/a1h43c7nqc3jkt0ttr3eqdv88k" to be canonical "tresplas:Collections/Videos/m8s85ibih5pvifrgl8rkr0se04/a1h43c7nqc3jkt0ttr3eqdv88k"
2023/08/19 10:23:15 DEBUG : fs cache: switching user supplied name "tresplas:/Collections/Videos/m8s85ibih5pvifrgl8rkr0se04/a1h43c7nqc3jkt0ttr3eqdv88k" for canonical name "tresplas:Collections/Videos/m8s85ibih5pvifrgl8rkr0se04/a1h43c7nqc3jkt0ttr3eqdv88k"
848441014 Wedding.avi
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         1.2s
2023/08/19 10:23:15 DEBUG : 8 go routines active

I already vacated most of the storage on GDrive, so I can not use rclone to download. When I tried to use Google's restoration service, this particular file was not found within the restored set.
What I did was I went to GDrive and downloaded the file directly from the web interface. So the process should have copied the crypted file as is, warts and all. This is what I did to prepare the file for local decryption.

11

just wanted to see if google's idea of the MD5SUM was different from the actual MD5SUM of the file (including the bit-rot). That would tell us something about how google look after your files. But if it isn't on google drive any more we can't do that!

Interesting. I wonder if that was because it had bit-rotted and the exporter noticed.

12

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.