Failed to authenticate decrypted block - bad password?

Help and Support
1

What is the problem you are having with rclone?

I am encountering the error "Failed to copy: failed to authenticate decrypted block - bad password?" when trying to decrypt/download my files from an rclone crypt with my local computer as the backend.

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 6.5.0-17-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.21.6
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

[Chain of Data Storage]

  • Local -> (Crypt) Google Drive -> Local
  • Local -> (Crypt) Google Drive -> (Crypt) Local -> Local

Both cases end up with the same errors.

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy crypt: /path/to/local/directory

The rclone config contents with secrets removed.

I've modified the backend names to be more general.

[google]
type = drive
client_id = <redacted>
client_secret = <redacted>
scope = drive
token = <redacted>
server_side_across_configs = true
stop_on_upload_limit = true
root_folder_id = <redacted>

[google-crypt]
type = crypt
remote = google:something
filename_encryption = standard
directory_name_encryption = true
password = <redacted>
password2 = <redacted>
server_side_across_configs = true
stop_on_upload_limit = true

[local]
type = local

[local-crypt]
type = crypt
remote = local:/path/to/crypt
filename_encryption = standard
directory_name_encryption = true
password = <redacted>
password2 = <redacted>

A log from the command with the -vv flag

2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: <redacted>.sajaqef3.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR :<redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 NOTICE: <redacted>.vucuken4.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR : <redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
(Repetition of the same notices and errors for the rest of my files)

A log from the command "rclone cryptcheck" with the -vv flag on the encrypted files and directories

2024/02/20 18:42:30 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "cryptcheck" "-vv" "local:/path/to/local-crypt/" "local-crypt:"]
2024/02/20 18:42:30 DEBUG : Creating backend with remote "<redacted>"
2024/02/20 18:42:30 DEBUG : Using config file from "<redacted>"
2024/02/20 18:42:30 DEBUG : fs cache: renaming cache item "<redacted>" to be canonical "<redacted>"
2024/02/20 18:42:30 DEBUG : Creating backend with remote "local-crypt:"
2024/02/20 18:42:30 DEBUG : fs cache: switching user supplied name "local:<redacted>" for canonical name "<redacted>"
2024/02/20 18:42:30 INFO  : Using md5 for hash comparisons
2024/02/20 18:42:30 DEBUG : Encrypted drive 'local-crypt:': Waiting for checks to finish
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at /path/to/local-crypt
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/f2c3hej0948dk2tjbn8al6dqo7hmn6d167rsoa571a1kaukcshrg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/g8hnmmnlk0l40qp3uqgn2babd8ut6ek7c95tk4k0qgpmpf71n8e0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/ghoo7d292fqie1otm7e6p3e5k8: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/i48hlal38mpjo1nn051n8d17j71qre9h65pebihicllvi9uduj70: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/jeekevl27hl3r3abkpefhhme9odn4vrpqdv2e59i056avfkov3h0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/lcmbcff3paunlmecsb5lj0u95cpoo7ahdft6uurtcb65pn1at8e0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/n8q13d0t3927lb91gshqr0c1t9g683djimari1mbdil55qdkocag: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/nrq1sjci90r1o9all7i1uev4u847ib2pausaohv6dj0a1d8es4hdjp9v1rj979s3jtdj9qakjpo5k: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/tab8oal2trpuvvmsbvkmmddsq0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/uh0empj7ldil9dgg56avcn7qcg01ct66j0i3ciqd1bnemnbp88hg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/t6qcidd9sm072ssf6fnpt5f368/1td87jf3ccojg9osqthaafgdrvg17qrqogs4qhcdkb8j742qsu1g/ffeesr45dof4j1sfsrh9li65knqhti739qepar8egcd0pled3vi0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/5ool5b302erbn83fk0dams6k1he90qba45r5p2mbqik10hn4p4fg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/91u1m0fc5ob0jq1mocf3naodgsn21i7aumc5dr969d88qcl8f8ug: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/k9oefg3ocvp8vq3che31tb6ldgi414gqdoaggcb8tt2h4je14nfg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/kmbhpg923tpqsaptm6ktftihis: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/obl8f7pbjeaacjnfccr3us0hf44nbna5epchncojcmncssg5sni0: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/pvd3pq6gop94ucg60g00jpgvskvouioot087gprpif782n7j8sfg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/qeq81bek4tl8nrgu8ngpntvvjesgt9bcad986c6ngdv6e1m49gdg: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : ghfr5k0ljim5mhlihqngmi4m8o/m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/s0tju4c5bf0ljivtg3bbh72sh3l2uokqkm45ouse327uj027sp1g: file not in Encrypted drive 'local-crypt:'
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>
2024/02/20 18:42:30 ERROR : <redacted>: file not in Local file system at <redacted>

(Omitted)

2024/02/20 18:42:34 NOTICE: Encrypted drive 'local-crypt:': 44069 files missing
2024/02/20 18:42:34 NOTICE: Local file system at <redacted>: 44069 files missing
2024/02/20 18:42:34 NOTICE: Encrypted drive 'local-crypt:': 88138 differences found
2024/02/20 18:42:34 NOTICE: Encrypted drive 'local-crypt:': 88138 errors while checking
2024/02/20 18:42:34 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:             88138 (retrying may help)
Elapsed time:         3.2s

2024/02/20 18:42:34 DEBUG : 5 go routines active
2024/02/20 18:42:34 Failed to cryptcheck with 88138 errors: last error was: 88138 differences found

Other things of notice

  • Each encrypted file is of non-zero size. It takes up the correct amount of space on the disk and reports the correct size of the original file.
  • When Using the open source rclone browser to peruse through my files, the decrypted names show up correctly. But if I try to download any of the files, I get the current errors. Using rclone mount yields the same results. File and directory names are correctly decrypted but I/O error on trying to copy files out to local system.
  • Based on inspection of encrypted files using a hex editor, the headers seem to be correct and the contents of each file are different from each other and non-zero/null; possibly indicating that the files themselves are still there.
2

hi,

in the config file, there is no gdrive remote, no crypt remote?

that looks like local -> local. no gdrive?

3

in the config file, there is no gdrive remote, no crypt remote?

Sorry for not mentioning in detail.

At this point in time, all encrypted material has been verified to have been downloaded to local; the same as Google Drive. I mentioned the part about the Google Drive just for full clarity on the chain of data storage. But currently all data is on local in an encrypted state.

But I can assure you that I made sure multiple times that I was able to perform a complete download of the encrypted material to local. I've just edited the post to add the configs for the Google Drive for your reference anyways though.

Thanks for pointing this out.

that looks like local -> local. no gdrive?

I only posted the logs for the local -> local because my organization purged the Google Drive right after I finished downloading the encrypted material to local.

4

the more you redact and not post, the harder to understand your work flow?
we cannot see into your machine and the exact commands you are running.

sorry, not sure what that means? the downloaded files, are they crypted or decrypted?
you can assure but yet rclone errors out?
without the exact commands, hard to know if you made a mistake or what?

fwiw, as a test, i would download/decrypt files from gdrive to local and run cryptcheck on that.
to make sure the files in gdrive crypt are good.
only after that, try using local as middle-man.

5

Sorry for the confusion. Here's a more refined and detailed account of the story.

[History]

  1. Upload original data to (crypt) Google Drive
rclone copy local:/path/to/somewhere google-crypt:/path/to/somewhere

=> Success. I don't have the logs for this anymore but there were no errors in the upload summary.

  1. Attempt to download decrypted data to Local
rclone copy google-crypt:/path/to/somewhere local:/path/to/somewhere

=> Failure
Logs:
I don't have the original logs now, but they gave the same errors as below.

2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: <redacted>.sajaqef3.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR :<redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 NOTICE: <redacted>.vucuken4.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR : <redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
(Repetition of the same notices and errors for the rest of my files)
  1. Organization requests urgent deletion of data from Google Drive. So I copy all the encrypted material to Local.
rclone copy google:/path/to/google-crypt local:/path/to/somewhere

=> Success. I don't have the logs for this anymore but there were no errors in the download summary.

  1. Organization purges Google Drive.

  2. Attempt to decrypt (copy out) files from Local copy of google-crypt (named "local-crypt")

rclone copy local-crypt:/path/to/somewhere local:/path/to/somewhere

=> Failure
Logs:

2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: 2024/02/20 18:59:35 NOTICE: <redacted>.sajaqef3.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR :<redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 NOTICE: <redacted>.vucuken4.partial: Removing partially written file on error: failed to authenticate decrypted block - bad password?
2024/02/20 18:59:35 ERROR : <redacted>: Failed to copy: failed to authenticate decrypted block - bad password?
(Repetition of the same notices and errors for the rest of my files)

fwiw, as a test, i would download/decrypt files from gdrive to local and run cryptcheck on that.
to make sure the files in gdrive crypt are good.
only after that, try using local as middle-man.

As the Google Drive is know purged, I wouldn't be able to do that now. But I clearly remember that there were no error messages in the download summary from google-crypt -> local (decrypted).

I'd be happy to answer any further questions. Thank you for trying to help.

Edit: Given the above situation, I am working under the theory that I have an exact copy of encrypted material that used to be in Google Drive. What perplexes me is that, as I note at the end of my original post, when I use the open source rclone browser I can successfully peruse through the local-crypt backend and see all of the decrypted names of folders and files. But only when I try to download/copy out something, I get the stated errors. If I was using the wrong password, I shouldn't be able to see the decrypted names of the folders and files, right?

6

Can you try the same but without using local remote?

So first change your local-crypt to:

[local-crypt]
type = crypt
remote =/path/to/crypt
filename_encryption = standard
directory_name_encryption = true
password = <redacted>
password2 = <redacted>

and then:

rclone copy local-crypt:path/to/somewhere /path/to/somewhere
7

Right. My guess would be that it is the correct password, but individual blocks in the data of the file somehow got corrupted -- probably during the original upload (for example, if the source file was changing while it was being uploaded).

You may be able to recover some of the data with --crypt-pass-bad-blocks.

8

Of course. Here are the results.
Logs:

2024/02/21 15:43:12 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "-vv" "copy" "local-crypt:" "/path/to/somewhere/"]
2024/02/21 15:43:12 DEBUG : Creating backend with remote "local-crypt:"
2024/02/21 15:43:12 DEBUG : Using config file from "/path/to/rclone.conf"
2024/02/21 15:43:12 DEBUG : Creating backend with remote "/path/to/local-crypt/"
2024/02/21 15:43:12 DEBUG : fs cache: renaming cache item "/path/to/local-crypt/" to be canonical "/path/to/local-crypt/"
2024/02/21 15:43:12 DEBUG : Creating backend with remote "/path/to/somewhere/"
2024/02/21 15:43:12 DEBUG : fs cache: renaming cache item "/path/to/somewhere/" to be canonical "/home/imtl/Desktop/test"
2024/02/21 15:43:12 DEBUG : <redacted>: Need to transfer - File not found at Destination
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Need to transfer - File not found at Destination
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 2/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 1/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 3/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 2/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 4/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 3/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 5/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 4/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 6/10: failed to authenticate decrypted block - bad password?
2024/02/21 15:43:12 DEBUG : <redacted>: Reopening on read failure after offset 0 bytes: retry 7/10: failed to authenticate decrypted block - bad password?

(Omitted repeated errors/debugs for different files)

2024/02/21 16:17:22 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:             43981 (retrying may help)
Checks:               176 / 176, 100%
Transferred:           88 / 88, 100%
Elapsed time:     34m10.1s

2024/02/21 16:17:22 DEBUG : 7 go routines active
2024/02/21 16:17:22 Failed to copy with 43981 errors: last error was: failed to authenticate decrypted block - bad password?

The local folder which I pointed to to store the results of the attempt at data decryption gave me a perfectly decrypted directory name and structure; but all the files were not there, just a perfect but empty nest of directories.

9

It definitely looks like your data is corrupted.

Do you still have access to crypt remote on gdrive?

10

Based on above it looks like your encrypted remote never worked.... difficult to expect different results now from local when in the first place it did not work anyway.

11

@nielash Thank you for your suggestion. I've just tried, but I'm getting either:

<redacted>: Need to transfer - File not found at Destination

or

2024/02/21 18:30:40 ERROR : local-crypt: ignoring: failed to authenticate decrypted block - bad password?

An inspection of the hexes give me perfect null bytes for everything.

@kapitainsky No, unfortunately, my organization purged the google-crypt after we got a full copy of the contents of the Google Drive.

While I no longer have the logs for the upload, I certainly do remember that there were absolutely no errors in the upload summary. I took care to turn on the options for slowing down the upload to be able to upload 24/7 without hitting the rate limit. Also, the option to stop on rate limit exceeding were in place. Just out of fear of the corrupted during upload horror stories, I also did the same routine thrice if I recall correctly; upload to Google Drive, delete and upload again.

Based on inspection of encrypted files using a hex editor, the headers seem to be correct and the contents of each file are different from each other and non-zero/null; possibly indicating that the files themselves are still there.

If the files were corrupted during upload though, I would expect that an inspection of the hex return complete gibberish. Yet the encrypted files all have the correct rclone header. Do you have any ideas on this phenomenon?

12

But you tried:

So problem was already on google drive. Why? I have no idea. But as many people use crypt without any issues (including myself) I suspect something very specific with your configuration.

13

Whelp. I guess my data is most likely lost, save for a very lucky session with data recovery software on the relevant HDD.

But just to get to the bottom of the issue, my point here

If the files were corrupted during upload though, I would expect that an inspection of the hex return complete gibberish. Yet the encrypted files all have the correct rclone header. Do you have any ideas on this phenomenon?

was that I thought that IF rclone encryption was successful, the header should be correct, which it is. ELSE I should get complete gibberish on hex inspection. Also, IF Google silently messed up my files, I should again get complete gibberish, at least for one file. As I believe that the probability of Google messing up exactly the part after the header only, converges to zero. Yet every single file has a perfectly intact rclone header. ELSE my files should have good headers, which they do have.

I guess I'll have to agree that my case is a highly isolated incident, given the circumstances and outside input. But given the circumstances, wouldn't it be more probable that the encryption somehow went south in my case compared to the probability of Google messing up exactly some portion of my data after the header?

14

Do you still have access to your gdrive account?

Try to run all process again with some small test directory.

Copy it to gdrive-crypt and then try to copy back.

This way we can maybe figure out why it did not work in the first place.

15

Unfortunately, no. IT was rushing everyone off Google. But as you mentioned, I do agree that the incident is highly isolated, else the forum and Github would have a considerably higher number of similar complaints. I've also had no issues of this kind on other instances of using rclone crypt.

Apart from that, would you know of any possible way of maybe skipping the block authentication? Please excuse my lack of knowledge on encryption. But, if I were to be able to skip the block authentication and "force decrypt" the data, maybe I could get lucky with at least a handful of files?

16

Not possible to my knowledge but maybe others know some way.

I am thinking what happened here. Have you ever moved your encrypted files on google drive? Maybe you used different rclone.conf at some stage? e.g. trying to change filenames encoding? And names are encrypted using different password than content?

Not sure why you add

server_side_across_configs = true

to your configurations. Also stop_on_upload_limit = true for crypt does not make any sense.

Not that this is the cause of your issues. At least should not when doing simple rclone copy local gdrive-crypt:

17

I am thinking what happened here. Have you ever moved your encrypted files on google drive? Maybe you used different rclone.conf at some stage? e.g. trying to change filenames encoding? And names are encrypted using different password than content?

I have never done any of those things before. Just plain upload and download. And one day it broke.

Not that this is the cause of your issues. At least should not when doing simple rclone copy local gdrive-crypt:

Admittedly, this was just a copy and paste for every single backend for when I was trying to make sure I could benefit from server side operations on all backends I used. So, it was not an intentional addition to the configuration in this case.

18

There might be one more thing to try. Are you sure that you have correct permissions? Maybe rclone can only list files but can not read anything?

Try if you can copy any files using rclone e.g. by running

rclone copy /path/to/crypt /some/test/path

Because:

sort of says that it fails to read anything and tries to decrypt empty file.

19

There was similar issue discussed in the past:

not sure about conclusions though.

As your previous tests show that data was already corrupted on google drive you do not have access to anymore (so nothing can be tested) the only lesson here is that it is always worth to double check everything before deleting any data you do not have extra copy. And even better follow boring 3-2-1 backup strategy.

In this particular case i do not think anything else can be done. Data is corrupted. How it happened will remain mystery as it is not possible to test anything right now. Could be anything gdrive problems, your computer problems, rclone bug etc.

20

Thanks you for your suggestion. Below are the logs from running rclone copy -vv /path/to/local-crypt/ /some/path/test

2024/02/21 22:06:08 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "copy" "-vv" "/path/to/local-crypt" "/some/test/path"]
2024/02/21 22:06:08 DEBUG : Creating backend with remote "/path/to/local-crypt"
2024/02/21 22:06:08 DEBUG : Creating backend with remote "/some/test/path"
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e: md5 = ba9f1439ffb0dfbbfd69925712ec0960 OK
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e.vodajaj3.partial: renamed to: m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e
2024/02/21 22:06:08 INFO  : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ruf6839ln4i0agopk0n1j5hth2e48vr59irhke1afmgnk1f0obct8inigq5fildifkndrkf8al02e: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/f2c3hej0948dk2tjbn8al6dqo7hmn6d167rsoa571a1kaukcshrg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/g8hnmmnlk0l40qp3uqgn2babd8ut6ek7c95tk4k0qgpmpf71n8e0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/ghoo7d292fqie1otm7e6p3e5k8: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/i48hlal38mpjo1nn051n8d17j71qre9h65pebihicllvi9uduj70: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/jeekevl27hl3r3abkpefhhme9odn4vrpqdv2e59i056avfkov3h0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/lcmbcff3paunlmecsb5lj0u95cpoo7ahdft6uurtcb65pn1at8e0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n8q13d0t3927lb91gshqr0c1t9g683djimari1mbdil55qdkocag: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/nrq1sjci90r1o9all7i1uev4u847ib2pausaohv6dj0a1d8es4hdjp9v1rj979s3jtdj9qakjpo5k: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/tab8oal2trpuvvmsbvkmmddsq0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/uh0empj7ldil9dgg56avcn7qcg01ct66j0i3ciqd1bnemnbp88hg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/5ool5b302erbn83fk0dams6k1he90qba45r5p2mbqik10hn4p4fg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/91u1m0fc5ob0jq1mocf3naodgsn21i7aumc5dr969d88qcl8f8ug: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/k9oefg3ocvp8vq3che31tb6ldgi414gqdoaggcb8tt2h4je14nfg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/kmbhpg923tpqsaptm6ktftihis: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/obl8f7pbjeaacjnfccr3us0hf44nbna5epchncojcmncssg5sni0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/pvd3pq6gop94ucg60g00jpgvskvouioot087gprpif782n7j8sfg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/qeq81bek4tl8nrgu8ngpntvvjesgt9bcad986c6ngdv6e1m49gdg: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/c46uijom6ftmdqv02s0prjgih7daek5km3pp2fdve07i2quma04c6j0jaa3uo2fuvo5ss546rgtoq/s0tju4c5bf0ljivtg3bbh72sh3l2uokqkm45ouse327uj027sp1g: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg: md5 = c85c67a0af55e08ef7c526b9c5259908 OK
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0: md5 = 3ac705bc3d52fcfd4631bf890c8415c2 OK
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1td87jf3ccojg9osqthaafgdrvg17qrqogs4qhcdkb8j742qsu1g/ffeesr45dof4j1sfsrh9li65knqhti739qepar8egcd0pled3vi0: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg.napadik6.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg
2024/02/21 22:06:08 INFO  : t6qcidd9sm072ssf6fnpt5f368/1013eop21cnia6ph4g5saaqhd539gtdc1kn3bl9e8pqv4b3co5tg: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0.qapezes7.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0
2024/02/21 22:06:08 INFO  : t6qcidd9sm072ssf6fnpt5f368/0q0gmmssml50borc2nmdpqcp5rbv75isaf71av2b55rogg8sksi0: Copied (new)
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq: md5 = df59c7147fd2c3b2357b2834b2097194 OK
2024/02/21 22:06:08 DEBUG : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq.niditeq8.partial: renamed to: m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq
2024/02/21 22:06:08 INFO  : m8q035t7n886gkbcmae5vlav0nvns3v8pd4qq1uq0jtrvikhnm8g/26q50o285sdn10i3t9a330bbqc/ee40rg8r6756iopqren443d9qc/ngo6m6n5kl3ie1jm3g8ib280ps/l50jrhsrmnssn92ma13m1njavthh7nhthsub3tfi4h3fgovv86htg3sln8dno4sr01imbord1ednq: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750: md5 = d6bfb46ffe2b86c99bba705f42e2820d OK
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750.joteten7.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750
2024/02/21 22:06:08 INFO  : t6qcidd9sm072ssf6fnpt5f368/1u62dsirtjg7qvsa0b2pfbi30611m5d3r6o4jrj3glde2eals750: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs: md5 = 295b96d5e1f63febe8f08b76c6d1568c OK
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs.xogavek6.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs
2024/02/21 22:06:08 INFO  : t6qcidd9sm072ssf6fnpt5f368/2k6uei6k537ps1kk59jr1ivcrs: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/780sls9075mluoprm3i6g46ems/as37qec4gp1ijace2e0bn5e1hdefbnchuqlbrdbao8b61456ssep8bsoqcvujku58fu88roc6p9q0sn8akiv24mub6j4u0511pu4b78: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/780sls9075mluoprm3i6g46ems/ftj7199s8a83burl5at9rr0pad3rsejkfngv9evt65tma4b54p3hnd55tvgloimtqms60d6vstrru: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/780sls9075mluoprm3i6g46ems/ktog25m8ft7si33tqanp9n708dgdtu8qm5ll8lm2l1dpkqrto76bfauuh52v57dhlh77rrnf6rdpli6b1ib7f15d5879rifcj13paoo: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/780sls9075mluoprm3i6g46ems/s9dv5tbk5ngko8ikeus68o6vehqr8mhc8qkvlpgsv7fhrlirq080: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140: md5 = cd3d5cca22fab3eaefb8a828d8a0546f OK
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140.mazebet2.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140
2024/02/21 22:06:08 INFO  : t6qcidd9sm072ssf6fnpt5f368/32p4lnpgupghad7h8hen3mn140: Copied (new)
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/gld0jbb1nvel47ne9mdo821blbt90pnodsiulcab4vlsa2snob2g/odnclantqms92b73ajmol7f2o0/7chlbo3iifno4th6kblkcrkksm0hdpj8iq470b76lsd26eu2uv30: Need to transfer - File not found at Destination
2024/02/21 22:06:08 DEBUG : t6qcidd9sm072ssf6fnpt5f368/gld0jbb1nvel47ne9mdo821blbt90pnodsiulcab4vlsa2snob2g/odnclantqms92b73ajmol7f2o0/jjqcgio87ntmmipdipaihogvi4: Need to transfer - File not found at Destination
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0: md5 = 8cd5d1846b8699c53fafbfc5d2a15c3d OK
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0.pexaloz3.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0
2024/02/21 22:06:09 INFO  : t6qcidd9sm072ssf6fnpt5f368/87fcbght7ca9ojmciqa0625tks6g6bcubolmueh0cctksb2suqu0: Copied (new)
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts: md5 = f1ca6030b27b1bddb75a26834f8c7eaf OK
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts.jemazut3.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts
2024/02/21 22:06:09 INFO  : t6qcidd9sm072ssf6fnpt5f368/a118havjb9g7oefvo4nfne0vts: Copied (new)
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s: md5 = c34fa7dc3c4fa51aee37d5ed5b0d36bd OK
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s.zacadub0.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s
2024/02/21 22:06:09 INFO  : t6qcidd9sm072ssf6fnpt5f368/7c08vkto4lqa60fq7no2s9gq1jaes459p54c90s07fu9v427jkqv6rgrlev4mbjgldvom8pbbd12s: Copied (new)
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g: md5 = 21bd43e8d13fca6f18bd7fe8fb76b241 OK
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g.pisexac9.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g
2024/02/21 22:06:09 INFO  : t6qcidd9sm072ssf6fnpt5f368/31jrl4c35qll9ek0behg17v8ndsfq02puaoeiam7kr8l3i479k6g: Copied (new)
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg: md5 = 3ee07d709f4b8217cfa8da4492fbc411 OK
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg.wohudub7.partial: renamed to: t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg
2024/02/21 22:06:09 INFO  : t6qcidd9sm072ssf6fnpt5f368/bpe7mrlelgh45qoquatnknknu04me8tf4t4893asb3nrc4ffrsbg: Copied (new)
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n9su6pfkuqjj322fq4cpvj958c/1oef1kun7h2pdpd7sm4blqhb0a53v5qv0lqakpj62m2a91h6sb00: Need to transfer - File not found at Destination
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n9su6pfkuqjj322fq4cpvj958c/4psbt5mmnpdabmu5mq2gkha0tplii5k4hdtrk10800f8d4tq8qs9qckms2cue53bcqpcfba9mv9oc: Need to transfer - File not found at Destination
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n9su6pfkuqjj322fq4cpvj958c/93153ngul7rnltn6dulhnv3jj11inak21260iu4ebs9meshkam60: Need to transfer - File not found at Destination
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n9su6pfkuqjj322fq4cpvj958c/ahu9lnpnpgg4aiden84idf9gn8: Need to transfer - File not found at Destination
2024/02/21 22:06:09 DEBUG : t6qcidd9sm072ssf6fnpt5f368/n9su6pfkuqjj322fq4cpvj958c/anv89jtbgg9ganiub7hk64vsru793s147h3oqdavlb9jm3i1uca0: Need to transfer - File not found at Destination

(Omitted)

Which I really don't get the reason why. If the file/directory name can be deciphered, then the file should be there. If I get an error related to data corruption, I could understand. But Need to transfer - File not found at Destination leaves me bewildered. I've performed chmod -R 777 /path/to/local-crypt before running your suggested commands, just in case it's a permission issue like you say. But, I guess to no avail.

Lesson learnt. The hard way. After this fiasco, I did away with Google Drive and went for a good NAS with good old battle tested Ultrastar DC HDDs. Multiple disks with a UPS, set to RAID 1 right now, and pending an upgrade to a RAID 5 configuration once I can replenish my stock of HDDs at a fairer price. I'm also using the open source borg and borgmatic to back up my data to two geographically distant offsite storage centers. I couldn't feel safer now.

I guess I'll have to try my luck with recovery software on the original HDD which used to hold the decrypted version of the data. But just for reference, in my case, I've used both rclone and Cryptomator for data encryption on the cloud. While both are robust pieces of art, I have yet to encounter a fatal issue like this using Cryptomator; under the same conditions with the amount/type of data and Google Drive.

Anyhow, I really appreciate the effort behind rclone and your help with my issue. I'll be more careful from now on.

P.S. Your RcloneBrowser does miracles for me by the way, thanks for developing it @kapitainsky :slight_smile:

1 Like